Stack Exchange Network

Stack Exchange network consists of 175 Q&A communities including Stack Overflow, the largest, most trusted online community for developers to learn, share their knowledge, and build their careers.

Visit Stack Exchange

Questions tagged [data.gov]

For questions related to data.gov, the home of the U.S. Government’s open data.

19
votes
3answers
205 views

Is there an official/complete list of all US government agency “developers' pages”?

The FCC's developers page happens to have a sidebar linking to many other US government agencies' developers pages, APIs, etc. It's a handy list, but I assume the FCC hosts it only out of the goodness ...
14
votes
5answers
304 views

How can I get a list of all non-geodata datasets on Data.gov?

Data.gov has a lot of datasets, and a super-majority of them are mapping. Is there a way to generate a list of all datasets other than geodata?
14
votes
5answers
5k views

Trying to locate US Census Shapefiles for all MSA's (Metropolitan & Micropolitan Statistical Areas)

I've been rooting around at the US Census Dept's Tigerline Shapefile download area through the web portal here: http://www.census.gov/cgi-bin/geo/shapefiles2013/main And have been pretty successful ...
14
votes
3answers
2k views

Where can I get bulk access to IRS 990 filings for US non-profits

There's another question about a list of all nonprofits, and this answer is kind of buried in the answers to that one. Also, this question came up today on the NICAR-L mailing list. It's a common ...
13
votes
6answers
2k views

Raw data from US Census and BLS

Is the raw data of US Census or BLS available? By raw I mean the datapoints that later comprise the summary tables. For instance, the average employment by firm size. Apart from means that you can ...
12
votes
4answers
203 views

How should governments build community around their datasets?

The likes of data.gov.uk and data.gov are keen to build a community around their data. How should that best be done? The main aim is to create a feedback loop, encouraging use of the data and release ...
11
votes
3answers
1k views

USDA Plant Hardiness Zone Map (PHZM) data

I want to obtain the entire dataset for all zip codes in the US along with their corresponding USDA Plant Hardiness Zone Map (PHZM) data. There are many sites that seem to offer a zipcode lookup tool ...
11
votes
1answer
4k views

FedBizopps Raw Data - API

I'm trying to locate the raw data from FedBizOpps or an API to the daily information. On their site they provide a link, but the page is a 404. Is there a way to download all active electronic ...
10
votes
2answers
194 views

Data Licenses for US Government Data not in data.gov

I want to know when commercial use of US government data is permitted and for what uses. Below, there are 5 questions that I have for 4 different primary data sources. So far, I have seen the data ...
10
votes
2answers
2k views

Catalog.data.gov using CKAN API with python requests package

I'm not sure if this is a requests issue, a CKAN API issue, or a catalog.data.gov issue. I can do this GET query: import requests import json r = requests.get('http://catalog.data.gov/api/search/...
9
votes
4answers
326 views

How can I register a new API key for api.data.gov programatically?

UPDATE: The government generously increased the API request limit to 1,000 per IP per hour. This question is now obsolete. api.data.gov allows for up to 1,000 API requests per user per hour, which is ...
9
votes
2answers
2k views

How do I get a full list of datasets available on Data.Gov using the CKAN API?

I'm fairly new to python, but I've been struggling to get anything more than ten results from a package_list request from Data.Gov's CKAN API. Here's what I'm using: response = urlopen('http://...
9
votes
3answers
2k views

Average Job Salary by Title/Location/Etc. (US or Intl)

I'm trying to find an open data source to use for estimating average salaries based on job titles and locations. I had initially considered using Glassdoor's API, but it seems to be too basic for my ...
9
votes
1answer
132 views

Graph of Landsat Downloads?

Where can I find find a graph of Landsat downloads, to show the effect free access has had?
9
votes
2answers
82 views

Data Standards for Campaign Finance

While there are some nice APIs for campaign finance at the federal level, they differ significantly. https://www.opensecrets.org/resources/create/api_doc.php http://developer.nytimes.com/docs/...
8
votes
4answers
517 views

What are the data quality measures for open data?

How does a consumer know they are getting good data? Are there standard frameworks for grading the quality of an open data set? Should there be metrics published around accuracy, completeness, ...
8
votes
4answers
472 views

Does anyone know of a U.S. city that has crime data with location?

More specifically I want to repeat this study for another city than Chicago: http://blog.uber.com/chicagotaxicrime The data for Chicago: https://data.cityofchicago.org/Public-Safety/Crimes-2001-to-...
8
votes
2answers
1k views

Medical Terminology in Patient Medical Records - Public Data Sets

I am interested in sample data of real patient medical records (anonymized or demographics removed completely) for the purpose of running through NLP system - specifically diagnoses, admissions and ...
8
votes
1answer
82 views

Is there a centralized schedule of data release dates for U.S. federal agencies?

Is there some centralized or streamlined source of data release schedules for major U.S. government agencies? Something that combines sources such as the BLS Schedule of Data Release, ACS Data Release ...
8
votes
3answers
245 views

Where to get usa coastline/shoreline data

From where I can collect the USA coastline/shoreline data classified by name. I have the shoreline data but not classified. By classified I mean name of the coastline in different region. e.g. '...
8
votes
1answer
159 views

Dataset on donations to charities?

Is there a feed/database on individuals/companies that have donated to IRS verified charities? I have done quite some Googling, and cannot seem to find anything :/
8
votes
1answer
447 views

Geospatial, temporal and keyword search using CKAN API on data.gov using ckanclient

Thanks to this answer , I can successfully use the python ckanclient package to search data.gov for "sea_water_temperature": import ckanclient q = 'tags:sea_water_temperature' ckan = ckanclient....
8
votes
1answer
1k views

California water district boundaries

I'm looking for California water district boundaries, both private and public in any geographic format. This data appears to be available on Data.gov HERE and HERE, but the links are dead. I've ...
8
votes
2answers
107 views

What is the governance of the US Government's Project Open Data?

The US Government just launched Project Open Data on GitHub, which includes best practices, free tools to accelerate adoption of open data practices, and common core metadata for the federal ...
7
votes
1answer
427 views

American Indian reservation boundaries

Complete reservation boundaries from the BIA's TAAMS program and BLM's cadastral survey shape files for American Indian reservations. It seems BIA is not contributing datasets for reservation ...
7
votes
2answers
1k views

How to get all the DrugList

I want to fetch all the drugList, lets say -> DrugName, Manufacturer, Prescribed for, Description. I tried using https://api.fda.gov/drug/event.json?count=patient.drug.openfda.manufacturer_name.exact ...
7
votes
1answer
2k views

Looking for data on bankruptcy prediction

I am wondering if anyone knows where I can find data to train a classification model for bankruptcy prediction. Bankruptcy prediction appears to be a popular topic, and there are tons of papers ...
7
votes
2answers
195 views

Gov data may be used only for statistical purposes?

Sometimes when I try to download a data zip file I see a popup that states like this: "Under law, public use data collected and distributed by the National Center for Education Statistics (NCES) ...
7
votes
2answers
150 views

What are open data sources about current sea state?

I wonder where (links/APIs) can be obtained data that is related to current (alike realtime - no past) sea state data (worldwide, but regional is good two, salt\waves length\hight etc)? I am only ...
7
votes
2answers
2k views

Weather radar data for Europe, especially Latvia

I would like to ask if there is a homepage where I can get weather radar data for Europe territory for free. I have looked in the internet, but can't find them. I will be very glad if someone can help ...
7
votes
1answer
129 views

Database of trademarked words

Does anybody know where I can download a complete & up to date database of trademarked words? I have found http://trademarks.reedtech.com/tmappxml.php but I'm looking for something that is already ...
7
votes
1answer
177 views

Issues harvesting metadata from Data.gov

I'm trying to harvest data from the CKAN API of Data.gov, using Python code. Doing this however, I ran into problems. I use the following URL: http://catalog.data.gov/api/3/action/package_search?...
7
votes
1answer
112 views

Missing medical device recall information? OpenFDA not finding recalls from FDA database

To ensure I was understanding how openFDA works, I have been checking my queries against the searchable medical device recall database the FDA already has (http://www.accessdata.fda.gov/scripts/cdrh/...
6
votes
5answers
833 views

How to acquire data about the speed and density of vehicle on freeways?

I'd like to find out the relation between the speed and density of traffic flow, and now I need some real data, but I don't know how to find it. Could you please tell me?
6
votes
2answers
127 views

What is the plan for the US Government's Data.gov?

The US Government recently announced an intent to upgrade Data.gov. What are the specific technical plans to do so?
6
votes
3answers
142 views

What are the sources of data on Data.gov?

I was browsing through the datasets on the website, and datasets like "Tax Year 2007--" caught my attention. At first I thought it might be Census data. However, if you look at the "About" tag for ...
6
votes
2answers
316 views

CKAN API questions

I'm looking to search Data.gov and using the CKAN API for this. as a start I want to do a simple text search like this one for environmental data. some questions related to this: It appears that ...
6
votes
1answer
94 views

How to flag incorrect links to data on data.gov?

Just looking around, and noticed that the CSV dataset that should be a list of all elementary schools in the US, is actually a population breakdown of Canadian provinces. http://catalog-next.data....
6
votes
1answer
312 views

Accurately Using Census Tract Data and Total Population

I am trying to gather the total population of Pittsburgh and overlay it onto a Google Map. I took the Census Tract .shp files from http://www.census.gov/geo/maps-data/data/gazetteer2010.html and put ...
6
votes
1answer
737 views

Seattle City Buildings Data Set

I am working on project where I need Seattle City Buildings Data Set. I found Building permits data set, this data set contains only buildings in the last 5 years. https://data.seattle.gov/Permitting/...
6
votes
1answer
129 views

US Radiation measurements

Is there a service that provides gamma energy data from RadNet in machine readable format such as JSON or CSV? The current RadNet UI is restricted to html and charts. Excel report itself is limited ...
6
votes
1answer
38 views

Finding data yielded in search results

I am looking to access datasets surrounding Medicaid enrollment, Medicaid buy-in, Medicaid statistics, eligibility criteria, etc. My searches yield plenty of results, but the actual data comes back ...
6
votes
1answer
79 views

How I can get list of licenses used in Data.gov?

I'm investigating what licenses are used in Data.gov portal. How I can get the list of the licenses from the portal?
6
votes
1answer
68 views

DOL Wage and Hour data: Counting backwages under Fair Labor Standards Act

I have a question about the Wage and Hour Compliance Action Data of the Department of Labor's Wage and Hour division: http://prd-enforce-xfr-02.dol.gov/data_catalog/WHD/whd_whisard_20141105.csv.zip ...
6
votes
1answer
108 views

How can I access FDA drug and medical device recall data from 1970 to 2014?

The FDA only provides drug and medical device recall data since 2002. As a journalist seeking a more comprehensive data set, I really need to have access to this information.
6
votes
1answer
75 views

How do US agencies connect their APIs to Data.gov's registration system?

Data.gov contains over 190,000 data sets, but only a select few are integrated into Data.gov's API key registration system. What is the process to integrate an existing API with data.gov as an API ...
6
votes
1answer
157 views

The Data.gov organization_list CKAN API is not working

This file is supposed to be giving the JSON format of all the organizations present in Data.gov as per the CKAN API documentation. However, that file gives an HTTP 400 (Bad request) error. Is there a ...
6
votes
1answer
64 views

Plans and documentation to tidy RAW data in Maude?

MAUDE is the Manufacturer and User Facility Device Experience database from the FDA. The MAUDE database houses medical device reports submitted to the FDA by mandatory reporters 1 (manufacturers, ...
6
votes
1answer
101 views

Is there a way to get a drug's experimental name on open FDA?

This query can return the product label for the drug Cetuximab: https://api.fda.gov/drug/label.json?search=set_id:8bc6397e-4bd8-4d37-a007-a327e4da34d9 But can we link it to its former name when it ...
6
votes
1answer
225 views

How to convert risk adjustment scores into dollar amounts from the Medical Expenditure Panel Survey?

I want to take the 2002-2009 Risk Adjustment Scores of the Medical Expenditure Panel Survey and convert them to dollar amounts. The documentation has a table for conversion, but since there are ...