22
hrecipe (and microformats in general) are the bees knees and lucky for you are widely employed across the web; here's a list of sites actively publishing hrecipes in the wild; you can scrape and parse as you please!
http://www.eat-vegan.rocks/
http://funcook.com/
http://www.therecipedepository.com
http://sabores.sapo.pt/
http://www.epicurious.com/
http://www....
20
Have a look at OpenFoodFacts, which is a "free, open and collaborative database of food products from the entire world." It contains almost 920,000 items from around the world and may be helpful in solving your issue.
18
APIs are often offered by websites so that developers can use the web-based data for apps, without having the uncertainty and difficulty of scraping the HTML. But it's not necessary to use the data to build apps, and this means that APIs can be a great source of data for research and analysis. Just to name a few types of API data: weather forecasts, ...
16
The USDA now provides an Open API for the National Nutrient Database for Standard Reference using data.gov. You need a data.gov API key in order to access this, and requests are sent to api.data.gov using the REST protocol.
16
Have you seen WikiQuote by the Wikimedia Foundation?
There is an API endpoint at http://en.wikiquote.org/w/api.php which uses the standard MediaWiki API for there are API clients in many different languages.
EDIT: Two WikiQuote API-specific links: https://stackoverflow.com/questions/13762688/wiki-quotes-api and http://bwgz57.wordpress.com/2013/02/14/in-...
15
http://vpic.nhtsa.dot.gov/api/
The National Highway Traffic Safety Administration has a free API that provides VIN decoding and lists of Makes/Models/Manufacturers/Parts/etc.
XML, JSON, CSV
Here is an example to fetch all vehicle makes:
http://vpic.nhtsa.dot.gov/api/vehicles/getallmakes?format=json
14
I've used MarineTraffic.com for finding details about yachts and ships I've seen in ports. It's a really cool website.
They also have an API, but, unfortunately, there is no free access.
There is an API option from FleetMon that is mostly-free:
The FleetMon Public API lets software developers create great software apps that are able to display ship ...
14
You probably want this:
https://www.wikidata.org/w/api.php?action=wbgetentities&props=labels&ids=Q19675&languages=es
The API command in English: Get information about some entities (action=wbgetentities), namely the label properties (props=labels) of item Q19675 (ids=Q19675) in Spanish (languages=es).
For more details, have a look at the full ...
12
Full disclosure: I am a GSA employee and the Tech Lead for FBOpen, a website and API for search and discovery of federal business opportunities.
There is indeed both bulk data and an fbo.gov API available, although I can only offer experience with the former. There are two different versions of the bulk FTP downloads, weekly files and nightly files. These ...
11
Recently, the paper Linked Soccer Data was published. In it the authors describe how they combined various football-related datasets, such as http://fussballdaten.de/. Some of the data they covered can be viewed through this demo application.
The paper also mentions other relevant sources of football data, including the openfooty API.
11
If you haven't already, check our ProgrammableWeb - it lets you search for APIs by keyword, type, etc.
http://www.programmableweb.com/search/recipe
http://www.programmableweb.com/search/allergy
Hope this helps.
9
I ended up creating my own system combining a bunch of APIs. Here is what I did:
I pulled the homepage text from each website and cleaned up all the html, javascript and styles
I pushed this text out to various APIs to process and stored the results. I used alchemyapi.com, textrazor.com, opencalais.com. Those APIs have a lot of options but mainly I focused ...
8
If you agree that "the web is an API", you may scrape statistics from HTML pages. For instance, oddsportal.com has historical betting quotes.
I suppose this data is not open but maybe helpful for personal use/fun.
If you are using the programming language R, you might find this vignette on web scraping match data (PDF) helpful.
Today I found football-data....
8
Past Self, I'm pleased to report that just after you asked this question, you were hired by a mapping company and worked on this exact thing, which was just released:
The Mapzen Elevation Tile Service is a free tile service which combines a variety of open-source terrain datasources into global elevation and normals tilesets, down to zooms 16 and 15, ...
8
You've asked three separate questions in one question, I don't think this fits into Stack Exchange's one question, one answer model, should have been three separate posts maybe. But anyway..
It appears that every API response includes a JSON piece with help information. can this be excluded?
No :) Not as far as I know. Just ignore it. I agree it seems a ...
8
The the arXiv repository contains almost 1 million of scientific articles, whose bibliographic information is accessible through a documented API, including links to other papers.
8
Instagram
Foursquare
Livejournal
Flikr
Pinterest
LinkedIn
Blogger
Wordpress
Hope it'd be enough to begin with.
8
You can use DBpedia Spotlight to extract semantic annotations from DBpedia. Here is the code for Python.
You will need these libraries:
BeautifulSoup
urllib2
urllib
json
The example is only for one link, but you can create a script to itterate through your url list.
from bs4 import BeautifulSoup
import urllib2
import json
import urllib
link = "http://...
8
You should take a look at Rank and Filed, a relatively new (Feb 2014) site about EDGAR filings, with lots of data export options.
8
You can get page counts from OpenLibrary and word counts from the linked editions on Internet Archive. Of course the latter is only going to be for public domain editions and if you are focused on review sentiment (as a proxy for purchase desirability?), you are probably more interested in modern non-public domain editions. The other drawback to IA word ...
8
Here's some more news APIs you can look into (that are free or cheap - but may have limits on usage):
USA Today API - http://developer.usatoday.com/docs/read/Breaking_News
The Guardian - http://www.theguardian.com/open-platform
The New York Times API - http://developer.nytimes.com/
8
Nearly all newspapers have all kinds of license constraints, making exploitation a legal headache, but there is a welcome exception:
https://en.wikinews.org
All of the Wikinews content is available under the Creative Commons Attribution 2.5 License.
There is an API that lets you get anything.
Unbiased readership statistics are also available.
Wikinews is ...
8
Check out the Walters Art Museum Collections API:
https://github.com/WaltersArtMuseum/walters-api
Might give you access to what you are looking for...
8
For simple, there is a webservice called LookUP which provides a web, REST and XML api for star and constellation data by name.
If that doesn't quite meet your need, there's SIMBAD Astronomical Database, which is where the above-noted LookUP tool is getting its data.
8
Why don't you use OSM's API?
A similar question was asked on gis:
How to get a list of OSM relations (id numbers) of cities and countries only?
7
This is a goal of the DemocracyMap project, which is still nascent.
The DemocracyMap API aims to provide normalized structured data for
all of the contact details and other primary information for every
government body and government official that represents you. Currently
this API is more of a meta-API that aggregates, normalizes, and caches
...
7
In Kaggle there is an "European Soccer Database" dataset.
25k+ matches and players stats for European Professional Football
https://www.kaggle.com/hugomathien/soccer
(download requires registration)
7
I don't know if the SEC has datasets for what you are looking for, but here is a link to the SEC's open datasets home page:
https://www.sec.gov/open/datasets.shtml
Below is a link and contacts to a university research paper (2012) on insider trading. You may want to consider contacting the researchers on where they got their data and methodologies on using ...
7
Dev.Last10K.com has a RESTful API for SEC filing data.
Disclaimer: I work for Last10K.com
7
Update: (October 2017) Kimono Labs API no longer available
Kimono Labs released a free open API for current and recent SEC filings with financial statements and valuation, profitability, leverage and liquidity ratios. You can find it here: http://kimonolabs.com/sec/explorer
Only top voted, non community-wiki answers of a minimum length are eligible