22
hrecipe (and microformats in general) are the bees knees and lucky for you are widely employed across the web; here's a list of sites actively publishing hrecipes in the wild; you can scrape and parse as you please!
http://www.eat-vegan.rocks/
http://funcook.com/
http://www.therecipedepository.com
http://sabores.sapo.pt/
http://www.epicurious.com/
http://www....
19
Have a look at OpenFoodFacts, which is a "free, open and collaborative database of food products from the entire world." It contains almost 920,000 items from around the world and may be helpful in solving your issue.
18
APIs are often offered by websites so that developers can use the web-based data for apps, without having the uncertainty and difficulty of scraping the HTML. But it's not necessary to use the data to build apps, and this means that APIs can be a great source of data for research and analysis. Just to name a few types of API data: weather forecasts, ...
16
The USDA now provides an Open API for the National Nutrient Database for Standard Reference using data.gov. You need a data.gov API key in order to access this, and requests are sent to api.data.gov using the REST protocol.
16
Have you seen WikiQuote by the Wikimedia Foundation?
There is an API endpoint at http://en.wikiquote.org/w/api.php which uses the standard MediaWiki API for there are API clients in many different languages.
EDIT: Two WikiQuote API-specific links: https://stackoverflow.com/questions/13762688/wiki-quotes-api and http://bwgz57.wordpress.com/2013/02/14/in-...
15
There are several different potential sources of information. I don't think any are completely comprehensive and few would count as strict "open data": apart from Open Access titles, licensing is likely to vary between publishers.
Having said that you could look at some of the following sources:
Springer API
Nature Linked Data Platform
PubMed API
PLOS API
...
14
I've used MarineTraffic.com for finding details about yachts and ships I've seen in ports. It's a really cool website.
They also have an API, but, unfortunately, there is no free access.
There is an API option from FleetMon that is mostly-free:
The FleetMon Public API lets software developers create great software apps that are able to display ship ...
14
http://vpic.nhtsa.dot.gov/api/
The National Highway Traffic Safety Administration has a free API that provides VIN decoding and lists of Makes/Models/Manufacturers/Parts/etc.
XML, JSON, CSV
Here is an example to fetch all vehicle makes:
http://vpic.nhtsa.dot.gov/api/vehicles/getallmakes?format=json
13
You can find a wealth of government APIs at the Data.gov developer page.
As far as real-time nature of the data feeds, the APIs vary in their update frequency. For example, flight status from the FAA updates every 10 - 15 minutes:
12
Full disclosure: I am a GSA employee and the Tech Lead for FBOpen, a website and API for search and discovery of federal business opportunities.
There is indeed both bulk data and an fbo.gov API available, although I can only offer experience with the former. There are two different versions of the bulk FTP downloads, weekly files and nightly files. These ...
12
You probably want this:
https://www.wikidata.org/w/api.php?action=wbgetentities&props=labels&ids=Q19675&languages=es
The API command in English: Get information about some entities (action=wbgetentities), namely the label properties (props=labels) of item Q19675 (ids=Q19675) in Spanish (languages=es).
For more details, have a look at the full ...
11
(Disclaimer: I work for the U.S. Treasury but am writing in my personal capacity.)
I do not know of an API that has what you are looking for off the shelf, but I would recommend you look into what information you can already access or request from the official system governing registration in the .gov domain. The .gov domain registration process for cities ...
11
Recently, the paper Linked Soccer Data was published. In it the authors describe how they combined various football-related datasets, such as http://fussballdaten.de/. Some of the data they covered can be viewed through this demo application.
The paper also mentions other relevant sources of football data, including the openfooty API.
11
If you haven't already, check our ProgrammableWeb - it lets you search for APIs by keyword, type, etc.
http://www.programmableweb.com/search/recipe
http://www.programmableweb.com/search/allergy
Hope this helps.
10
The other answers so far are all terrific. I'll reiterate one point, and make a new one:
The openness of an API is always important, but when complete, quality bulk data is available some of these access issues become a lot more tolerable. An API is not a substitute for bulk data. The federal government has become very API focused, and many of them have ...
9
I ended up creating my own system combining a bunch of APIs. Here is what I did:
I pulled the homepage text from each website and cleaned up all the html, javascript and styles
I pushed this text out to various APIs to process and stored the results. I used alchemyapi.com, textrazor.com, opencalais.com. Those APIs have a lot of options but mainly I focused ...
8
If you agree that "the web is an API", you may scrape statistics from HTML pages. For instance, oddsportal.com has historical betting quotes.
I suppose this data is not open but maybe helpful for personal use/fun.
If you are using the programming language R, you might find this vignette on web scraping match data (PDF) helpful.
Today I found football-data....
8
You've asked three separate questions in one question, I don't think this fits into Stack Exchange's one question, one answer model, should have been three separate posts maybe. But anyway..
It appears that every API response includes a JSON piece with help information. can this be excluded?
No :) Not as far as I know. Just ignore it. I agree it seems a ...
8
The the arXiv repository contains almost 1 million of scientific articles, whose bibliographic information is accessible through a documented API, including links to other papers.
8
Instagram
Foursquare
Livejournal
Flikr
Pinterest
LinkedIn
Blogger
Wordpress
Hope it'd be enough to begin with.
8
You can use DBpedia Spotlight to extract semantic annotations from DBpedia. Here is the code for Python.
You will need these libraries:
BeautifulSoup
urllib2
urllib
json
The example is only for one link, but you can create a script to itterate through your url list.
from bs4 import BeautifulSoup
import urllib2
import json
import urllib
link = "http://...
8
You should take a look at Rank and Filed, a relatively new (Feb 2014) site about EDGAR filings, with lots of data export options.
8
You can get page counts from OpenLibrary and word counts from the linked editions on Internet Archive. Of course the latter is only going to be for public domain editions and if you are focused on review sentiment (as a proxy for purchase desirability?), you are probably more interested in modern non-public domain editions. The other drawback to IA word ...
8
Here's some more news APIs you can look into (that are free or cheap - but may have limits on usage):
USA Today API - http://developer.usatoday.com/docs/read/Breaking_News
The Guardian - http://www.theguardian.com/open-platform
The New York Times API - http://developer.nytimes.com/
8
Nearly all newspapers have all kinds of license constraints, making exploitation a legal headache, but there is a welcome exception:
https://en.wikinews.org
All of the Wikinews content is available under the Creative Commons Attribution 2.5 License.
There is an API that lets you get anything.
Unbiased readership statistics are also available.
Wikinews is ...
8
Check out the Walters Art Museum Collections API:
https://github.com/WaltersArtMuseum/walters-api
Might give you access to what you are looking for...
8
For simple, there is a webservice called LookUP which provides a web, REST and XML api for star and constellation data by name.
If that doesn't quite meet your need, there's SIMBAD Astronomical Database, which is where the above-noted LookUP tool is getting its data.
8
Why don't you use OSM's API?
A similar question was asked on gis:
How to get a list of OSM relations (id numbers) of cities and countries only?
7
Past Self, I'm pleased to report that just after you asked this question, you were hired by a mapping company and worked on this exact thing, which was just released:
The Mapzen Elevation Tile Service is a free tile service which combines a variety of open-source terrain datasources into global elevation and normals tilesets, down to zooms 16 and 15, ...
7
This is a goal of the DemocracyMap project, which is still nascent.
The DemocracyMap API aims to provide normalized structured data for
all of the contact details and other primary information for every
government body and government official that represents you. Currently
this API is more of a meta-API that aggregates, normalizes, and caches
...
Only top voted, non community-wiki answers of a minimum length are eligible
