All Questions

Filter by
Sorted by
Tagged with
17
votes
4answers
906 views

What are the practical limits of releasing open data via bit torrent?

I know that there are political issues (my place of work bans all peer-to-peer software without an explicit waiver), but how well does bit torrent scale for distributing large data collections where ...
20
votes
9answers
4k views

Any uses of JSON-LD?

The formal semantic web, now linked data, using RDF is largely flailing in most regions outside the UK. The main problem is the complexity in implementation compared with the tools typically used by ...
6
votes
3answers
238 views

Restrict search to open datasets on CKAN's Data Hub?

The Data Hub, powered by CKAN, is an impressive collection of datasets available on the web. Currently it lists more than 6000 datasets — however, not all of them are available under an Open Data ...
58
votes
6answers
64k views

Open API for nutritional information and/or food barcodes?

I've seen many applications (mobile and web) that use a database of nutritional information and barcodes to track daily food consumption. Smartphones have the ability to scan barcodes, and many mobile ...
142
votes
26answers
25k views

A database of open databases?

While there are many open databases available, is there a database or the project that would contain the information of such databases? In other words, is there an open meta-database of open ...
6
votes
1answer
107 views

Requirements of the Open Data Commons Attribution License

When OCLC released their WorldCat data under Open Data Commons Attribution License last year, there was a question in the library community as to exactly what would be required for adequate ...
11
votes
5answers
471 views

Standards for self-documenting text files?

One of the advantages of most scientific file formats is that you have a block of attached metadata that tells a reader how to read / interpret the file (what the fields are, for the most part -- how ...
9
votes
6answers
356 views

Are there any international non-governmental data aggregators?

We are probably all familiar with Manyeyes and google public data explorer but those are always based on governmental Statistics bureau or OECD data. Are there any projects to aggregate data that is ...
2
votes
1answer
40 views

Is there a list of Chemical Weapon Industry Facilities/Funders?

This question was recently asked on NICAR and got crickets: Can anybody point me in the right direction for data on state or regional presence (or lack) of chemical weapons industry facilities/...
6
votes
2answers
411 views

Is there an API or global source for US ballot information?

I'd like to be able to query to discover what's on the ballot - from local measures to Presidential elections. Is there a source that combines all of this data? Or is there a standard that's ...
6
votes
1answer
2k views

CC-BY vs MIT or BSD licenses regarding re-use?

My understanding is that the MIT license allows sublicensing while the BSD license does not, meaning that license restrictions can be added to things like mashups and not to the original data as a ...
4
votes
1answer
2k views

Database of fictional characters?

Is there a database of fictional characters from novels, films, dramas etc., grouped by genre? The most important entries for me are the name, nationality (real or fictional), title of the novel/film/...
13
votes
5answers
4k views

Database of ships?

Is there a database of the ships that were built until now, containing the size, weight, displacement, cost, year of built, and optionally the amount of used materials? It does not need to contain ...
7
votes
2answers
4k views

Are there open complete usenet archives?

Are there any open complete and downloadable usenet archives? I don't expect binaries to be included, only the text messages? If the complete archive is not available, than at least a partial archive ...
21
votes
9answers
6k views

Is there an open API for world terrain data?

I'm looking for open-source or publicly-available terrain data, for instance heightmaps or DEMs -- ideally GeoTIFFS by way of an easy-to-use API. For instance: you pass a pair of lat/longs and maybe a ...
8
votes
1answer
82 views

Is there a centralized schedule of data release dates for U.S. federal agencies?

Is there some centralized or streamlined source of data release schedules for major U.S. government agencies? Something that combines sources such as the BLS Schedule of Data Release, ACS Data Release ...
5
votes
1answer
75 views

Where can I find open listings of zipcodes in Indonesia?

In reviewing the data from geonames, I discovered in my spot check that Indonesia is missing. A bit of time with Google revealed a few places where I could buy data sets but nothing open. Anywhere ...
2
votes
2answers
60 views

Non US-centric databases on boards of directors and government agency memberships?

Are there any open (and preferably inter/multinational, not just US) databases on membership to boards of directors and leaders of government agencies? For instance, Little Sis has mostly US data (...
14
votes
6answers
334 views

What is the best way to request machine readable data from a FOIA request?

Maybe there is no way to request a specific file type but what is the best way to request a file (paper or digital) that can be converted easiestly?
8
votes
1answer
85 views

What is the appropriate way to timestamp/determine recency of given data set?

Certain U.S. federal grant applications require the use of "recent" data, e.g. data used to support the application should come from recent (i.e. within the past 5 years) published source Is ...
11
votes
2answers
2k views

American English SMS Text Message Corpora

I'm seeking corpora of American English SMS (<=160 characters) text messages. What corpora are available?
14
votes
4answers
679 views

Cost of ownership - CKAN for city/local government or small federal agency

What is average cost/effort to launch CKAN instance and what are operational expenses to maintain it going forward? (Assuming small size government with limited IT resources)
25
votes
12answers
3k views

Metadata standards and best practices for data dictionaries for CSV files/data

We publish most of our machine-readable open data in CSV format. What are best practices and/or standards to publish data dictionaries (e.g. definitions of columns in CSV files including human-...
5
votes
2answers
426 views

API for information about Brazilian cities/states

I can already find data about Brazilian cities/states (e.g. population, localization, crime rates etc...), on some websites such as the government's open data portal and census data (which ...
7
votes
3answers
148 views

Open Data Conflict Resolution

Assume that a person moves from one address to another. They update their driver's license, which means the DMV has the correct address. However the Town Clerk has the previous address. Both the DMV ...
14
votes
3answers
684 views

What are the available tools for managing crowdsourced data-cleaning tasks?

The Zooniverse team has had amazing success with the OldWeather project to crowdsource coding of old ships logs to extract climate data. And I believe Sunlight did some crowdsourcing (with Mechanical ...
9
votes
4answers
5k views

What is the best source for finding what businesses have opened/exist/closed in a given geographical area?

Is there a a standard source for finding out what businesses (with brick and mortar locations) exist in a geographical area (particularly in the U.S.)? This doesn't necessarily have to be a ...
25
votes
8answers
2k views

Tools for merging similar datasets continuously

How do I merge similar datasets, not just once but on an ongoing basis? This seems like a reasonably common problem so I'd be interested if there is a tool out there aimed at this problem, as a guided ...
25
votes
7answers
2k views

Extracting tables from multiple PDFs

What's the best practice of extracting tables from a large number of PDF, which may be formatted differently? For example, I have a series of PDFs like this one, and I would like to extract the ...
10
votes
1answer
112 views

Where can I find high-precision cartographic data of French rural areas?

While OpenStreetMap is rather good for cartographic information (and rendered maps) in urban areas of France, it is rather unsatisfactory in rural areas (except in the area where I live, where I ...
35
votes
7answers
6k views

Are there any good libraries available for doing normalization of company names?

I've run into a number of use cases where I need to normalize company names in a database before running automated and manual matching. We've usually ended up writing a specific script with endless ...
6
votes
3answers
147 views

How can I access open data on the Indian rupee value, inflation and sensex index over time?

I would like to have an open data source on inflation, rupee value and sensex index data over period of 10 years of India.
8
votes
3answers
177 views

Is there any world-wide real time catastrophe information system?

Disasters happens, in this situations information is everything. Is there any information system that works worldwide and would: Notify the possible victims that the something is coming (in cases it ...
24
votes
7answers
7k views

How can I download the complete Wikidata database?

Wikidata is a new Wikimedia project: It centralizes access to and management of structured data, such as interwiki references and statistical information. This data would be of enormous interest ...
6
votes
3answers
380 views

Data download for Chinese meteorological satellites

Data for NOAA meteorological satellites can be downloaded through the NOAA CLASS archive. Where, if anywhere, can I download data for the Chinese FY-3* meteorological satellites?
12
votes
6answers
7k views

Where can I find open data on historical forex rates for financial reporting purposes?

I am looking for historical foreign exchange (forex) data for financial reporting purposes. For example, I would like to distribute a data source that could be used for determining forex gains and ...
14
votes
8answers
5k views

What is the most comprehensive resource for querying french and english books having an ISBN code?

I would like to know if a repository of all known ISBN exists; either a worldwide database, or per country. If there is no such downloadable database, among all the available API's for querying ...
22
votes
11answers
4k views

Graph visualization/analysis tool?

Since the Harvard Business Review claimed that Data Scientist is The Sexiest Job of the 21st Century, graph analysis and big data are becoming very popular topics at my university. I'm familiar with ...
35
votes
11answers
28k views

Good tools to parse repetitive unstructured data

I'm looking to parse a large number of lines of repetitive but unstructured data. This is a task that happens at least once every project, in my experience, so I'm looking for a tool to transform ...
4
votes
2answers
143 views

GPU hardware specifications data?

When I buy a computer, besides the price, one of the most important characteristics is the processor. CPU DB is a website that aims to list cpus hardware specifications. Where can I get similar data ...
6
votes
2answers
142 views

Where can I get digital cartographic maps of Brazil?

I have a personal database of cartographic maps that I used for many purposes, mostly planning campings and other outside adventures. I'd like to have similar data about Brazil.
19
votes
6answers
413 views

Open Data Scorecards?

How can one evaluate a government entity's progress in making their data open? I've read the 8 Principles of Open Government Data, but I'd like to know if there are tools to specifically grade an ...
11
votes
4answers
3k views

What server and technologies can I use to extract data out of Wikipedia's infoboxes (e.g., ATC code for drugs)

Wikipedia is a significant source of data. Data from Wikipedia may be available in various formats via other servers (e.g., SPARQL end point). For a task of extracting all pairs of "ATC code" - "...
8
votes
1answer
205 views

Database with the historical prices of most popular products in U.S.?

Is there an open database that would contained the historical prices of the most popular products in U.S.? At best with the product classification, so that it would be possible to make analysis, how ...
40
votes
12answers
11k views

Multinational list of popular first names and surnames?

Is there a database containing the list of the most popular first names and surnames (with occurrence count, or at least sorted by popularity) for many nations/countries? I need such data for the ...
9
votes
1answer
1k views

Database with English words with grammatical classification?

Is there open database with English words with grammatical classification? I mean the list of words, with the information, which part of speech this word is (f.e. verb, noun, pronoun etc.).
38
votes
8answers
871 views

Should I approach an agency unofficially before FOIAing them?

Are there drawbacks to FOIAing (Freedom of Information Act, either federally or equivalent state/local laws) an agency? For example, can it lead to an adversarial relationship?
13
votes
7answers
2k views

Is there a free downloadable administrative division database of Germany?

Is there downloadable and freely available database with administrative units of Germany (lands, cities, and if available, streets with zip codes)? In many countries such databases are provided ...
19
votes
3answers
206 views

Is there an official/complete list of all US government agency “developers' pages”?

The FCC's developers page happens to have a sidebar linking to many other US government agencies' developers pages, APIs, etc. It's a handy list, but I assume the FCC hosts it only out of the goodness ...
16
votes
9answers
1k views

What's an easy-to-use tool to manage datasets?

I am quite new to open data. I see a lot of people looking for machine-readable data, but to start, I am wondering which tool I can use to start playing with some dataset. I am particularly looking ...

15 30 50 per page