The complete USDA National Nutrient Database for Standard Reference can be downloaded as ASCII text files from https://www.ars.usda.gov/Services/docs.htm?docid=8964 — no PDF scraping necessary :)
Regarding product barcodes, have a look at Open Product Data, a new project by the Open Knowledge Foundation.
Have a look at OpenFoodFacts, which is a "free, open and collaborative database of food products from the entire world." It contains almost 920,000 items from around the world and may be helpful in solving your issue.
The USDA now provides an Open API for the National Nutrient Database for Standard Reference using data.gov. You need a data.gov API key in order to access this, and requests are sent to api.data.gov using the REST protocol.
We're building an open crowdsourced database for uk food products.
We have calories, ingredients, photos.
You can use it and contribute to it as well (and let your user contribute) according to the OdBL licence :-)
https://uk.openfoodfacts.org and https://world.openfoodfacts.org
It sounds like you want Consumer Price Indices for Food and Beverage for various metropolitan areas. The Bureau of Labor Statistics calculates just such indices: http://download.bls.gov/pub/time.series/cu/cu.txt
A101 New York-Northern New Jersey-Long Island, NY-NJ-CT-PA1
I think USDA.gov's NDB (full name: USDA National Nutrient Database for Standard Reference) would get you what you need.
Download links and data metadata is available on the "About the Database" file at http://www.ars.usda.gov/Services/docs.htm?docid=8964. If you're looking solely for a list of food items, the latest Food Descriptions file is at http://www....
I'll assume a dataset doesn't exist because it makes the creation of a data-story more interesting.
Here are some steps that I would take to collect the data and start to analyze it. Remember, a question is needed before we can ask the data for answers. For that reason, I'll make up the question: "Do cocoa producers have higher rates of ...
Eurostat is a European institution which collects data from its member country's statistical institutions and gathers data itself, amongst others stats on the production of vegetables. Here are the stats for celery and celeriac production across all EU countries. A summation across all countries for the years 2000-2011 shows the following production in 1000 ...
The USDA maintains a National Nutrient Database with
nutrient information on over 8,000 foods using this new and improved
search feature. You can now search by food item, group, or list to
find the nutrient information for your food items.
The Nutrient Data Laboratory gives food composition and allows you to browse foods by nutrient.
You might look at the source for Bartendro - https://github.com/partyrobotics - there is a default drink DB and I know there has been at least some community interest in building a more comprehensive open drink database.
I would be really surprised if such a data set existed. Prices will vary depending of your location and/or country. I think the best for you is to merge your source with a price index source.
For example here in Ontario, LCBO (the provincial monopoly selling alcohol) information have been made available through an API.
I found a wiki with many coctails recipes and extra info, but since I can see, it has a strict copyright. Maybe you can contact with them, if you want the database for non-commercial use.
The 2002 UK food nutrition study (McCance & Widdowson's Composition of Foods) lists 3000+ food items along with dietary information. The link below provides this info in an Excel spreadsheet (which can be converted to CSV) at the bottom of the page.
Here is a Food Fraud Database. I haven't used it, but for some
reason it was in my bookmarks.
The first publication of the database in 2012 includes more than 1300 entries based on more than 650 articles. This includes information on more than 350 different food ingredients. Each record in the database is a publicly reported unique combination of food ...
I suspect this type of dataset will have to be constructed from many local sources. Particularly since the 'meaning and access' may vary on culture and environment/conflict.
But for the US/Canada, I would suggest searching on 'food banks' and 'public food pantries'.
Some of the major cities with open data portals have such datasets. Including:
The Wayback Machine is always your best friend; Here's the data from 2014-02
OPD Product Browser Web Repository
There's also open food facts
The UK has done a family food survey for a number of years. It breaks down food categories and percentage of consumption. Has national, region, urban, rural, by age, by income, etc.
I've not review this USDA dataset, but the description seems to be what you are looking for:
It doesn't appear to be offered as data, but it would be exceedingly easy to scrape this Eat Local resource from NRDC. There's a page for each state which lists foods by month.
For each state they have "learn more" links, which probably also lead to their data sources (few of which appear to be structured data.)
The UN Food & Agriculture Organization (FAO) collects and publishes a lot of data on Africa related to farming.
Here's the entry point into the FAO's Statistics Database (FAOSTAT):
Here's the link to the World Bank's datasets on Farming in Rural Areas of the World:
If you're looking for how prices vary over time, in the U.S., there's the Consumer Price Index, which includes various categories of food prices.
I've never dug into their raw data, so I don't know how much detail they make available (eg, comparisons by state or other region).
No dataset was available, so I got 300+ people to answer a questionnaire about the topic.
General view of the data (green=spoon, red=no spoon):
Detailed analysis: http://aegif-labo.blogspot.jp/2015/04/eating-spaghetti-spoon-or-not.html
Raw data (as a Google Spreadsheet)
License: Public domain
Have you looked at the SPAM data out of the International Food Policy Research Institute?
I don't know if you're looking for the same resolution as the CropScape data, but SPAM produces 5' estimates of physical area, harvested area, production and yield on 42 crops globally circa 2000 and 2005.
You are looking at a multi-faceted solution. The grocery industry is very competitive, with operating margins around 1 to 2 percent. You are going to need to learn how to tie / relate the databases together. I have a United States of America based solution.
Food products: Supermarket API will provide you with a API to identify products within a number of ...
During the best city contest last year the Economist published a Worldwide Cost of Living Index which include food prices for multiple cities across the globe. Data are available under Attribution-NonCommercial-ShareAlike
(CC BY-NC-SA) license. Currently the Economist website is down, but I am sure you can find updated version on their website (I will try to ...
Have you tried http://www.wolframalpha.com for example http://www.wolframalpha.com/input/?i=bacardi. They have an API which will bring back this kind of data. I am not sure it works off a barcode, but that is worth a try.
I've found a couple of sources of retail prices in open access:
http://data.worldbank.org/data-catalog/crowd-sourced-price-collection (same here https://app.enigma.io/table/org.worldbank.crowd-sourced.price.collection.csv)
But the World Bank covers only 8 developing countries. And PriceStats shares only US prices with a 10-day ...