All Questions

Filter by
Sorted by
Tagged with
15
votes
6answers
12k views

Which real-time open data APIs do you know?

As far as I can tell open data is mostly offered as some kind of file download, that contains the complete data set. I'm aware of some Web services, e. g. World Bank API, that allow you to feed a ...
6
votes
2answers
1k views

Is there a resource to look up the Standard Industrial Classification codes that companies file with the SEC?

On the NICAR-L mailing list, Matt Kiefer asked: Is there a resource to look up the Standard Industrial Classification codes that companies file with the SEC? (They don't use NAICS.) I need a ...
4
votes
1answer
28 views

What open data institutes in the US are working with the Open Government Partnership?

The Open Government Partnership (OGP) is a global alliance of countries that are signatory to an Open Government Declaration. The United States is one of the eight founding signatories - I am curious ...
16
votes
4answers
333 views

Why should I care how a (structured) dataset is licenced?

When thinking about "Open Data" (possibly due to nothing more than my own ignorance) I am utterly confused as to what difference an open licence legally makes for structured data. "Open Data" for me ...
2
votes
2answers
42 views

What criteria determine a good name for an open data product?

I'm working on a new data product related to satellite atmospheric remote sensing. I'm writing an article on it for a peer-reviewed scientific journal, and the data will be publicly available. One ...
2
votes
2answers
205 views

Linking results from the FCC's TV Query API to the FCC's TV Stations Profiles API

The FCC has at least two APIs related to broadcast station data. One is TV Query, which can return pipe-delimited results like this (keys): |K02JU |- |TX |2 |DA | |...
6
votes
3answers
302 views

What is a ready to use wordpress CMS template for serving open datasets?

I am trying to serve certain open datasets in tabular form , converted to Google fusion tables/ spreadsheets etc to any interested audience. I am not a web developer but am knowledgeable enough to ...
10
votes
3answers
4k views

Database of English words pronunciation

Is there any downloadable open database of English words pronunciation in audio format?
5
votes
2answers
724 views

Load data from HTML tables into OpenRefine?

One answer to the question Wikipedia table to JSON (or other machine-readable format) suggested to use OpenRefine for handling HTML tables. All I could find regarding OpenRefine and HTML tables were ...
8
votes
3answers
100 views

How to use the DOI system as an individual?

Is anyone aware of a way for an individual developer to access the Digital Object Identifier (DOI) system? I am a software developer working in biological research but independent of any single ...
20
votes
10answers
6k views

Wikipedia table to JSON (or other machine-readable format)

I'm interested in the data listed in the tables listed here. Is there a good way to extract the information (as JSON, preferably) without resorting to HTML parsing?
5
votes
1answer
60 views

Public access laws used for real-time data?

In a question about real-time gunshot data from Will Koper, he mentioned using public records laws to access it. ... which makes me wonder if anyone's even aware of FOIA or various state public ...
6
votes
5answers
4k views

Open datasets for product reviews

Are there public repositories that have public reviews and feedback data of products (I need digital camera reviews to be specific) After searching on the internet, I found http://www.cs.uic.edu/~...
9
votes
2answers
1k views

Anyone have a good way of comparing two large and unstructured lists (~2k entries each) for commonalities between them?

Let's say, two governments have separate lists of reports, and I'm trying to figure out the most common elements between them. Think of one government administrator reporting # of sick days per year ...
7
votes
1answer
156 views

Real-time gunshot detection data?

Was curious whether anyone had successfully obtained access to streaming data from any municipality that uses a "shots fired" detection system like this one. According to their own documentation, the ...
7
votes
2answers
946 views

What data source for cloud coverage available with forecast and how to parse it?

I need to find good and reliable data source of cloud coverage (to use GIS) with forecast for few days and be able to parse it. Do you know good one? I know that NOAA provides weather data, but ...
3
votes
2answers
364 views

Open Seed for Crawl

I am currently running a crawl of the internet using Nutch. This requires a list of URLs to start as a seed. I currently have a 500k url seed. But I am looking for any open data sources to provide ...
7
votes
2answers
266 views

Recommended BitTorrent tracker/index for dataset release?

I have a large dataset which I plan to release to the public (around 80GB compressed, 1TB uncompressed), and after considering my options it appears that using the BitTorrent protocol would be the ...
4
votes
1answer
86 views

Open data for international treaties

Are there data sources listing international treaties held between countries of the world? From treaties between 2 countries, up to treaties among dozens of countries. The status of the treaty, ...
9
votes
5answers
2k views

Open alternative to weatherbase.com

Does anyone know of an open alternative to weatherbase? I'm looking for what's listed here as "Average Temperature". I'm looking for monthly averages for a city, hopefully for as many cities as ...
3
votes
1answer
128 views

Open dataset for a 65-million year temperature history of earth?

I have been trying to find a dataset for the earth's long-term historical temperature record. I have seen a few charts like this one from wikipedia. Is there an open dataset with this information? ...
4
votes
4answers
215 views

Crowdsourcing Data Submission

I have been thinking about how it would be possible to crowdsource the collection of information. There are already many data sources, but often for the desired application the data is incomplete and ...
6
votes
4answers
375 views

Data on income information for India, China, and West/East African nations with GIS coordinates

I am planning a project to look at the spatial-temporal spread of income over time. Hence, I am looking for data on household or individual level income information for India, China, and East/West ...
17
votes
2answers
23k views

Is there an open database of elementary, middle, and high schools in the United States?

Is there an up-to-date and regularly maintained open database of elementary, middle, and high schools in the United States? I'm looking for both public and private schools. Names alone would be a ...
14
votes
7answers
933 views

Should data APIs require registration and API keys?

When publishing a data API, there seems to be a conflict between requiring a user to sign-up for an API key and the principal of open access. What is best practice in publishing an open data API ...
37
votes
6answers
906 views

Let's suppose I have potentially interesting data. How to distribute?

This is a very simple question: Suppose that I have some sort of specialized data, perhaps that I've collected myself or been a part of the collection. And suppose that nothing prevents me from ...
6
votes
1answer
302 views

A database for dog, cat and other pet names?

When it comes to tracking the popularity and distribution of human names over time, Wolfram Alpha seems to be the place to go. But where to find this info for pets? In 2008, the LA Times put ...
5
votes
3answers
117 views

Availability of APHIS Data as API or bulk dump

Currently the Animal Care Information System Search Tool located at (http://acissearch.aphis.usda.gov/LPASearch/faces/CustomerSearch.jspx) provides visitors with the ability to perform a number of ...
3
votes
1answer
67 views

Bioequivalent drugs in the US and EU?

I'm looking for lists of bioequivalent drugs in the US or EU. I know there is a (quite short) list from the Chilean government at http://datos.gob.cl/datasets/ver/1303 but I'd like to know if there is ...
2
votes
1answer
143 views

Linking FCC documents from ECFS to the Federal Register

The Federal Communications Commission (FCC) publishes documents from rulemakings on its Electronic Comment Filing System (ECFS). These documents include filings from 3rd parties as well as FCC-...
94
votes
21answers
12k views

Is there a Git for data?

I know you can put CSV or XML in Git already, but there are issues for those wishing to collaborate on a dataset for creation, cleaning it up, pull requests, etc. Are there alternative version control ...
3
votes
1answer
85 views

Spend transaction data formats

What is the best format that we cam reasonably get government bodies to publish their spend transaction data in? In an ideal world we would ask for Linked Data, where every supplier was correctly ...
4
votes
2answers
93 views

Are there good examples of requiring open data in RFPs?

The recent U.S. Executive Order on open and machine-readable data requires the U.S. government to begin developing ways to integrate open data into procurement and grant-making. Are there good ...
6
votes
2answers
196 views

Census County Commuter Flow Data?

I've been banging my head on this, and I'm just not having a lot of luck. I've been using the Census' American Fact Finder to try and find it, but I'm not seeing it. What I need is to be able to ...
2
votes
2answers
289 views

Additional Detail from IPEDS Data Source

I have used NCES IPEDS data in the past, but this recent release seems to have instituted a change. In looking at the NCES college navigator site for a particular institution, I notice that they now ...
4
votes
1answer
73 views

License for data that precludes government/surveillance use

I have been looking for a few weeks now for a license that has the same force as the HESSLA, namely, restrictions on the use of software for human rights violations or user surveillance, but applied ...
13
votes
5answers
359 views

How to publish open data on my website? (Or: from CSV to RDFa)

I already spent some time importing data in a tabular form from a PDF published by an official institution. I would like to publish this table on my website. The data is nicely formatted in CSV. Is ...
3
votes
1answer
220 views

Open database of domain registration information?

Is there a central database of all domain registration information, or a way to access an aggregate of that data? I know there are already tools to help you access the registration information of a ...
2
votes
1answer
55 views

What level of government/governing agency determines the terms of use for transportation map/gis data in the U.S.?

In the work I do I often need various pieces of geographically-based information concerning public roadways and public transportation. It seems to me (and please correct me if I'm wrong) that this ...
7
votes
5answers
277 views

Finding an index of food prices

I'm trying to find an open index of food prices [like the food one might find at a grocery store], either bulk prices or prices that might be in the store. Any ideas? EDIT: I'm looking to compare ...
1
vote
4answers
2k views

What's the difference between Open Data and Big Data

Open Data can be Big Data, and Big Data can be Open Data -- but they are not synonymous. What is the major difference between the two?
1
vote
2answers
147 views

Which, if any, U.S. Federal Government agencies offer a Service Level Agreement (SLA) for their APIs?

Are there any examples of U.S. Federal Government agencies offering service level agreements (SLAs) for their APIs?
14
votes
3answers
246 views

Preservation of blog posts, articles and essays

I am curious if there is there any good way to guarantee that my articles (posted on personal sites and other blogs) will last? Is there a reliable repository for articles, post and essays? Or are ...
8
votes
6answers
2k views

Open Address Data for Restaurants

I am looking for any open data set that maintains restaurants (or places in general) with their address. If a place closes I am hoping this database will reflect that quickly.
8
votes
5answers
192 views

Standards for capturing organisational data like budgets, procurement, salaries

I'm currently starting a large project to capture and classify published CC-BY-NC data of an international aid organisation into standard open formats. (There's an overview of the project online at ...
7
votes
2answers
555 views

Open Web Crawling Dumps

I am currently using the Common Crawl dump of web crawl data. Are their any other good providers of free web crawling data that I can blend with my Common Crawl data?
7
votes
2answers
6k views

Data Source for Speed Limits

I am not even quite sure how this data would be organized. But I am looking for a data source for different speed limits in the US correlated to street name.
10
votes
2answers
4k views

Where can I find U.S. train traffic data?

I'm trying to get a general idea of railroad traffic along particular segments of track—whether it's abandoned, whether it gets one train a month, or 100 trains a day. Is there a source of such data? ...
8
votes
2answers
6k views

Is there a site where USA road traffic historical data would be available?

Is there a site where USA road traffic historical data would be available? For example, whether the usual traffic jam on Bay Bridge in Maryland on Memorial day weekend was worse in 2012 vs. 2011?
7
votes
4answers
197 views

Best practices for huge explorable linked data directories

The main requirements for our open data directory are: XML-based by default with ability to switch to JSON. It's important the easy way to make it human readable with just linking to XSL. All the ...

15 30 50 per page