All Questions

Filter by
Sorted by
Tagged with
5
votes
2answers
436 views

API for information about Brazilian cities/states

I can already find data about Brazilian cities/states (e.g. population, localization, crime rates etc...), on some websites such as the government's open data portal and census data (which ...
7
votes
3answers
148 views

Open Data Conflict Resolution

Assume that a person moves from one address to another. They update their driver's license, which means the DMV has the correct address. However the Town Clerk has the previous address. Both the DMV ...
14
votes
3answers
687 views

What are the available tools for managing crowdsourced data-cleaning tasks?

The Zooniverse team has had amazing success with the OldWeather project to crowdsource coding of old ships logs to extract climate data. And I believe Sunlight did some crowdsourcing (with Mechanical ...
10
votes
4answers
5k views

What is the best source for finding what businesses have opened/exist/closed in a given geographical area?

Is there a a standard source for finding out what businesses (with brick and mortar locations) exist in a geographical area (particularly in the U.S.)? This doesn't necessarily have to be a ...
25
votes
8answers
2k views

Tools for merging similar datasets continuously

How do I merge similar datasets, not just once but on an ongoing basis? This seems like a reasonably common problem so I'd be interested if there is a tool out there aimed at this problem, as a guided ...
25
votes
7answers
3k views

Extracting tables from multiple PDFs

What's the best practice of extracting tables from a large number of PDF, which may be formatted differently? For example, I have a series of PDFs like this one, and I would like to extract the ...
10
votes
1answer
112 views

Where can I find high-precision cartographic data of French rural areas?

While OpenStreetMap is rather good for cartographic information (and rendered maps) in urban areas of France, it is rather unsatisfactory in rural areas (except in the area where I live, where I ...
35
votes
7answers
6k views

Are there any good libraries available for doing normalization of company names?

I've run into a number of use cases where I need to normalize company names in a database before running automated and manual matching. We've usually ended up writing a specific script with endless ...
6
votes
3answers
147 views

How can I access open data on the Indian rupee value, inflation and sensex index over time?

I would like to have an open data source on inflation, rupee value and sensex index data over period of 10 years of India.
8
votes
3answers
181 views

Is there any world-wide real time catastrophe information system?

Disasters happens, in this situations information is everything. Is there any information system that works worldwide and would: Notify the possible victims that the something is coming (in cases it ...
24
votes
7answers
7k views

How can I download the complete Wikidata database?

Wikidata is a new Wikimedia project: It centralizes access to and management of structured data, such as interwiki references and statistical information. This data would be of enormous interest ...
6
votes
3answers
382 views

Data download for Chinese meteorological satellites

Data for NOAA meteorological satellites can be downloaded through the NOAA CLASS archive. Where, if anywhere, can I download data for the Chinese FY-3* meteorological satellites?
12
votes
6answers
7k views

Where can I find open data on historical forex rates for financial reporting purposes?

I am looking for historical foreign exchange (forex) data for financial reporting purposes. For example, I would like to distribute a data source that could be used for determining forex gains and ...
14
votes
8answers
6k views

What is the most comprehensive resource for querying french and english books having an ISBN code?

I would like to know if a repository of all known ISBN exists; either a worldwide database, or per country. If there is no such downloadable database, among all the available API's for querying ...
22
votes
11answers
4k views

Graph visualization/analysis tool?

Since the Harvard Business Review claimed that Data Scientist is The Sexiest Job of the 21st Century, graph analysis and big data are becoming very popular topics at my university. I'm familiar with ...
35
votes
11answers
29k views

Good tools to parse repetitive unstructured data

I'm looking to parse a large number of lines of repetitive but unstructured data. This is a task that happens at least once every project, in my experience, so I'm looking for a tool to transform ...
4
votes
2answers
143 views

GPU hardware specifications data?

When I buy a computer, besides the price, one of the most important characteristics is the processor. CPU DB is a website that aims to list cpus hardware specifications. Where can I get similar data ...
6
votes
2answers
142 views

Where can I get digital cartographic maps of Brazil?

I have a personal database of cartographic maps that I used for many purposes, mostly planning campings and other outside adventures. I'd like to have similar data about Brazil.
19
votes
6answers
415 views

Open Data Scorecards?

How can one evaluate a government entity's progress in making their data open? I've read the 8 Principles of Open Government Data, but I'd like to know if there are tools to specifically grade an ...
11
votes
4answers
3k views

What server and technologies can I use to extract data out of Wikipedia's infoboxes (e.g., ATC code for drugs)

Wikipedia is a significant source of data. Data from Wikipedia may be available in various formats via other servers (e.g., SPARQL end point). For a task of extracting all pairs of "ATC code" - "...
8
votes
1answer
208 views

Database with the historical prices of most popular products in U.S.?

Is there an open database that would contained the historical prices of the most popular products in U.S.? At best with the product classification, so that it would be possible to make analysis, how ...
41
votes
12answers
12k views

Multinational list of popular first names and surnames?

Is there a database containing the list of the most popular first names and surnames (with occurrence count, or at least sorted by popularity) for many nations/countries? I need such data for the ...
9
votes
1answer
1k views

Database with English words with grammatical classification?

Is there open database with English words with grammatical classification? I mean the list of words, with the information, which part of speech this word is (f.e. verb, noun, pronoun etc.).
38
votes
8answers
879 views

Should I approach an agency unofficially before FOIAing them?

Are there drawbacks to FOIAing (Freedom of Information Act, either federally or equivalent state/local laws) an agency? For example, can it lead to an adversarial relationship?
13
votes
7answers
2k views

Is there a free downloadable administrative division database of Germany?

Is there downloadable and freely available database with administrative units of Germany (lands, cities, and if available, streets with zip codes)? In many countries such databases are provided ...
19
votes
3answers
210 views

Is there an official/complete list of all US government agency “developers' pages”?

The FCC's developers page happens to have a sidebar linking to many other US government agencies' developers pages, APIs, etc. It's a handy list, but I assume the FCC hosts it only out of the goodness ...
16
votes
9answers
1k views

What's an easy-to-use tool to manage datasets?

I am quite new to open data. I see a lot of people looking for machine-readable data, but to start, I am wondering which tool I can use to start playing with some dataset. I am particularly looking ...
41
votes
9answers
1k views

Benefits of using CC0 over CC-BY for data

I've heard a few times that for data one should use rather CC0 (Creative Commons - Public Domain Dedication) license than CC-BY (Creative Commons - Attribution). What is the reason for that? (As ...
20
votes
8answers
669 views

How can I trust the authenticity of an open data source?

If some site claims to offer a definitive data source, how can I trust that it is not purposely biased? Even excluding elaborate conspiracies, how could I know that it isn't just a big hoax? It ...
14
votes
5answers
304 views

How can I get a list of all non-geodata datasets on Data.gov?

Data.gov has a lot of datasets, and a super-majority of them are mapping. Is there a way to generate a list of all datasets other than geodata?
4
votes
2answers
89 views

Given a federal agency, what can I expect to find on the regulations.gov API?

As an example, I'm very interested in working with rulemaking data from the FCC. Because the FCC is an independent agency, I've heard that its publishing requirements are different from non-...
19
votes
5answers
2k views

Is there a complete list of all US tax-exempt nonprofits in machine-readable format?

I've seen they can be purchased from Guidestar, but wondered if there was an freely available open data source.
14
votes
2answers
268 views

Is the data used to calculate national CPI public?

What data is used to calculate the CPI (Consumer Price Index) and if it is open, where can I find it?
19
votes
6answers
3k views

De-identified patient data

Are there any medical or clinical data sources that have de-identified patient data (name, date of birth, sex) as well as basic physical parameters such as weight, or height? I'm specifically ...
9
votes
5answers
124 views

Does any City have POIA (Public Online Information act) laws in place?

A few years ago, Sunlight Foundation advocated for the Public Online Information Act (POIA). Do you know of any city that has adopted such a law or statue? In the age of the Internet, government is ...
16
votes
6answers
9k views

U.S. City and County Web Data (API)

Are there any websites that have basic City and County information for the U.S.?
9
votes
3answers
591 views

Is there a list of all utilities that offer the Green Button Download and Green Button Connect?

I see the Green Button data standard on greenbuttondata.org. But I am trying to figure out which geographic regions have the standard ALREADY deployed.
15
votes
2answers
105 views

Is there a list of all municipal government forms in a machine readable format?

I've found a list of government forms at the US federal level by looking at the OIRA PRA Information Collections XML file. Is there a list of similar forms at the state/local level for the US?
31
votes
12answers
3k views

Is there a list of all US Government agencies and sub agencies and is it available via API?

Specifically I'm looking for: Agency canonical names Agency abbreviature/acronym Hierarchy of agencies e.g. Census Bureau is part of Department of Commerce Agency logos Website/social media accounts ...
5
votes
3answers
14k views

Download a sample database of calls in telecommunication [duplicate]

I am trying to do a project for data analysis based on the details of calls stored in Call Details Record (CDR) of telecommunications industry. It will take some time to obtain the real data, and ...

15 30 50 per page