This site from the Library of Congress contains many historical materials they have digitized, including photos, film & audio recordings, letters, newspapers, and much, much more. While note all of these materials are primary sources, many are.
The Digital Public Library of America collects digitized materials from library across the US. It has a wealth of historical materials, many of which are primary sources. Of particular note are the Primary Source Sets which gather primary sources on specific themes.
