34

I recently set out to do this. https://www.datakick.org/ The mission: Build a database of every product in the world that is free to everyone. It's licensed under CC0 (Public Domain Dedication) and all the information is available for download. There aren't many products yet, but it's a start for those who want to make this a reality. EDIT: DataKick has ...


29

Sci-Hub is a paywall-bypassing website that uses "shared" user credentials to provide PDF or HTML scientific papers. The website itself doesn't store any papers. (There are interesting comments on your same question on another site.) But LibGen (via wayback machine) is said to archive each PDF retrieved by Sci-Hub. http://gen.lib.rus.ec has a downloads ...


23

As it turns out there are several resources one can use for all main cryptocurrencies so I will post here the most relevant and flexible I was able to gather. All Cryptocurrencies Coinmetrics https://coinmetrics.io/data-downloads/ This page has data for: Bitcoin, Litecoin, Ethereum, NEM, Decred, ZCash (transparent transactions only), Dash, Dogecoin, ...


22

hrecipe (and microformats in general) are the bees knees and lucky for you are widely employed across the web; here's a list of sites actively publishing hrecipes in the wild; you can scrape and parse as you please! http://www.eat-vegan.rocks/ http://funcook.com/ http://www.therecipedepository.com http://sabores.sapo.pt/ http://www.epicurious.com/ http://www....


22

Nicknames and Diminutive Names Lookup (CSV) CSV, Database of Common Nicknames and its GitHub Repository: Common Nickname CSV (Database) Name to Nickname CSV and Nickname to Name CSV


21

There is a pretty massive list of given (first) names (~50,000), and it's carefully curated (not machine generated). More details are available on another answer: The best source of international human given (first) names comes from a German computer magazine. The text file has nearly 50k names that are classified by likely gender, and how popular in each ...


20

Have a look at OpenFoodFacts, which is a "free, open and collaborative database of food products from the entire world." It contains almost 920,000 items from around the world and may be helpful in solving your issue.


19

This question was previously answered for non-profits, and I think the same answer works here at least partially. In addition, you can find all U.S. companies at the Securities and Exchange Commission's EDGAR site. Technical documentation is also available. Information about Canadian companies is accessible through their open data site, but seems to be ...


18

ConceptNet is a semantic network containing lots of things computers should know about the world, especially when understanding text written by people. Trying to reproduce your relation-sequences yields: finger PartOf hand IsA body part, which looks surprisingly "dead end". chair IsA seat RelatedTo furniture MadeOf wood ...


18

California Polytechnic State University has a downloaded dataset on fatal accidents on the national highway system for the year 2007: https://wiki.csc.calpoly.edu/datasets/wiki/HighwayAccidents Data.Gov has a number of datasets on accident data by state: https://explore.data.gov/catalog/raw?tags=crash The NHTSA has summary statistics for 2012 on a state ...


18

You might want to check out the HUD zip code-county crosswalk (screenshot below). My gut feeling is that this feature would be in the US census TIGER product line https://www.census.gov/geo/maps-data/data/tiger.html maybe here: https://www.census.gov/geo/maps-data/data/relationship.html Please let us know what you find most useful.


16

The USDA now provides an Open API for the National Nutrient Database for Standard Reference using data.gov. You need a data.gov API key in order to access this, and requests are sent to api.data.gov using the REST protocol.


16

OpenFoodFacts takes care of food-related products with EAN and related information.


16

Have you seen WikiQuote by the Wikimedia Foundation? There is an API endpoint at http://en.wikiquote.org/w/api.php which uses the standard MediaWiki API for there are API clients in many different languages. EDIT: Two WikiQuote API-specific links: https://stackoverflow.com/questions/13762688/wiki-quotes-api and http://bwgz57.wordpress.com/2013/02/14/in-...


15

Short answer, no. Long answer - there are attempts at creating a "global" or should I say "universal" UPC database and there are some vendors with large UPC databases (and even those who provide API access), but none of them are hardly "universal". This is a problem that I have personally been grappling with. At work I manage a large number of SKUs (in the ...


15

There is a list of soccer datasets and APIs here from this related SO question. Hope that helps. EDIT: Quoted text from the article linked above, as requested: openfootball has started a free (open source) public domain football database. The data is historical data, meaning no lives scores but the data does include the schedule, teams and players ...


15

famfamfam icons are free and require no attribution and are quite small: http://www.famfamfam.com/lab/icons/flags/ EDIT: The Noun Project has a Flags of the World Collective, although it is not complete, and not in the desired formats of OP, but I just wanted to add them for everyone else who comes through here: http://thenounproject.com/desbenoit/...


15

The best source of international human given (first) names comes from a German computer magazine. The text file has nearly 50k names that are classified by likely gender, and how popular in each country. It's carefully curated and has a friendly license (GNU Free Documentation License 1.2). The file can be downloaded here : ftp://ftp.heise.de/pub/ct/...


15

The JHU dashboard you linked has their data available as CSV on Github: https://github.com/CSSEGISandData/COVID-19/tree/master/csse_covid_19_data in particular these CSV files, which contain all historical timeseries https://github.com/CSSEGISandData/COVID-19/tree/master/csse_covid_19_data/csse_covid_19_time_series Here is a coincidental Python3 scraper ...


14

While you will find some exceptions, sharing archived tweets is against Twitter Developer Policy. Take all reasonable efforts to do the following, provided that when requested by Twitter, you must promptly take such actions: Delete Content that Twitter reports as deleted or expired; etc If a user deletes their own content, the archive should reflect that ...


14

Sadly, Freebase has been made "read only" March 31st 2015. Alternatives are: https://www.themoviedb.org/ Actively maintained by a large community and used by a broad range of apps under a propriatary license that states free use: TMDb is committed to free and open access to our APIs for commercial and non-commercial purposes. However, providing the APIs ...


14

You can find plenty of summary data, but I have not seen any publicly available raw counter data. Here's some summaries: Federal Highway Administration Traffic Volume Trends is a monthly report based on hourly traffic count data reported by the States. These data are collected at approximately 4,000 continuous traffic counting locations nationwide and are ...


14

I think this is what you are looking for. It is a DNS registration dataset snapshot taken in 2013. Compressed - it is ~15GB and uncompressed 157GB. http://dnscensus2013.neocities.org/ They claim it contains: Dataset containing 2,676,380,336 DNS records and 106,928,034 domains


14

A quick google search found me the data page of OpenFlights.org. This page has a free (donation request) CSV file with 8000+ airports: LINK. OpenFlights.org points to OurAirports.com, which provides extensive CSV downloads with data being in the public domain. See their data page. Regarding contact info for airport management, the FAA provides this info ...


14

I've used MarineTraffic.com for finding details about yachts and ships I've seen in ports. It's a really cool website. They also have an API, but, unfortunately, there is no free access. There is an API option from FleetMon that is mostly-free: The FleetMon Public API lets software developers create great software apps that are able to display ship ...


14

Some other answers hint at this, but the caution to keep in mind is that ZIP codes are not geographies on a map. They are identifiers for postal delivery routes which are often but not always geographic. To accommodate the intense demand for data aggregated by ZIP code, the Census Bureau created ZIP Code Tabulation Areas (or ZCTAs) which are roughly what ...


14

Sounds like a case forOpenAerialMap, which after a hiatus, looks like it might get a reboot. Wish I could think of something that was active. They already have a functional beta: OpenAerialMap The OSM wiki also has some notes on aerial imagery.


13

There is a Google Internationalization project called Region Flags that structures the Wikipedia data. This package is a collection of flags for BCP 47 region codes. Most people think of these as country flags, but there are a few codes / flags that do not correspond to countries. The flags are in SVG and PNG format and named by their BCP 47 region code, ...


Only top voted, non community-wiki answers of a minimum length are eligible