An official source for agency information: https://www.federalregister.gov/api/v1/agencies
GSA API: http://www.usa.gov/About/developer-resources/federal-agency-directory/index.shtml
Here is most comprehensive list of all .gov /Developer pages compiled by Gray Brooks at GSA
You can suggest new additions if some info is missing. It is currently well maintained.
The Open Data Institute are building Open Data Certificates ( https://certificates.theodi.org/ ) as a mechanism for describing how a particular dataset does in terms of legal, practical, technical and social information.
It's still being built, but you can see an example at: https://certificates.theodi.org/datasets/347/certificates/90 . Although it does ...
The CPI is based on surveys conducted by BLS (Bureau of Labor Statistics). Those surveys collect price information which is reviewed by commodity experts. Those experts review (and possible adjust) the data based on their knowledge of the particular commodity. That adjusted data is then averaged to calculate the CPI. You can definitely get the values that ...
As a work of the US government, there isn't any license appropriate for the work, because it's already in the public domain (in the United States). So a license like the Unlicense (or CC0), in which the licensor is entering the covered work into the public domain, doesn't work. Some text that acknowledges the public domain status in the US is helpful (and ...
Figuring out the cost for running CKAN boils down to two different categories: the cost of running the software itself, as well as the cost of building and maintaining your open data catalog going forward.
The cost of the software itself is simpler to answer: CKAN itself is free/open-source, and available as a hosted solution.
If you go the open-source ...
It's hard to know if this is canonical, and it's not structured, but there is the USA.gov Government Departments and Agencies page, which includes an A-Z list. It doesn't have all of the data you are looking for, but it's a start.
Some of the information you are looking for can be found by looking at the tags portion of the web site you can see how people are tagging their questions. Of the More popular tags the one I think you would most interested in is API (at the time of this writing approximately 1 in 7 questions are tagged with API). I think the most important thing in an API is ...
I think it would be foolish to try and replace the NAICS system. NAICS is the federal government's categorization system, and in my experience, it is also in use at the municipal level in the United States. Here's a longer description:
NAICS was developed under the auspices of the Office of Management and Budget (OMB), and adopted in 1997 to replace the ...
There is definitely no such list for Washington, DC (Government of the District of Columbia).
There was forms automation project back in 2006/2007 where some forms where converted to database backend using LiquidOffice tool. You can see list of all currently published forms for DC.gov here http://forms.dc.gov/index.html (click Forms on the ...
The basics for FOIA are:
be very clear in your request
Remember that while there are government officials who are hostile to records requests, not all of them are. There are many people in government who want to do the right thing.
There are a few websites designed to help you file FOIA requests. In the US, Muck Rock has been ...
We started a worldwide crowdsourcing data collection on policy measures, including lockdowns at the admin1 level (region) and the country level. Currently we coded data for ~13 countries and are continously expanding. You can access the data here:
Collaborative Google Sheets on Policy Measures Against Covid19.
These data are free to use for anybody. We rely ...
[Disclosure: I'm the co-founder of OpenCorporates]
Given this site is about 'open data', I'm assuming that the questioner wanted to know about those with a licence that conforms to the Open Knowledge Definition.
There are to the best of our knowledge no such sources of data under an open licence. All the proprietary ones (D&B, Lexis-Nexis, Jigsaw, etc) ...
On Data.gov we haven't looked at trying to aggregate a forward-looking schedule. In general we encourage agencies to release data as quickly as possible. Some data releases occur on a very regular basis, but there is often some fluctuation based on the internal approval processes. I expect as agencies respond to the actions to comply with the new Open Data ...
Great question! Cities follow many different paths, but some best practices are starting to emerge. Two particularly helpful guides/roadmaps are published by:
Open Data Field Guide from Socrata
Open Data Handbook from the Open Knowledge Foundation (available in multiple languages)
Both provide a nice how-to guide and future plans for cities and localities ...
Bad manners have nothing to do with it. As a taxpayer, it's your data, and they're making it available for you to download. Your country also benefits from having backups of their dataset floating around out there.
You could take the public service angle of it to the next level by uploading a copy of the full archive to the Internet Archive using their S3-...
For a wider listing of diplomatic entities, consider using Open Street Maps.
For example, you can use the Tag: amenity=embassy. This data source includes the following dimensions:
We created this API to power GSA's Social Media Registry. http://registry.usa.gov/agencies (see also http://registry.usa.gov/agencies.json)
Here's what it has:
Basically every organization within the executive, legislative, and judicial branches.
Basically every independent organization.
Some sub-agencies that people think are independent, like the FBI, ...
Pascal Romain and Elie Sloïm presented about their Opquast open data quality standards checklist at the W3C Open Data on the Web conference about a month ago:
With these grading schemes I believe it's important to grade the "openness" of the data, but even more importantly the quality and the availability of the ...
Maybe there are privacy implications I haven't thought of, but it would be great if the IRS would release a database of EIN, legal name, and jurisdiction of record for all US businesses that pay taxes. (I don't mean tax $ amounts, just identifying info)
You don't identify what kind of areas you're looking for advice on. But I'll highlight several that I think are particularly relevant for Government sources:
Where feasible, data should not just be made available via an API, but also available for download. This supports other kinds of uses. I think this is important as one goal of Open Government Data is ...
The Open Data Policy and Executive Order are for federal datasets and does not mandate the same for state or local governments, although such policies does influence more local policies.
See http://www.data.gov/opendatasites for a large (but not comprehensive) listing of Open Data sites at the international, state and local levels.
For state-level open ...
Data.gov is down because of the US government shutdown. You can see almost identcal language on the census.gov website, which explains that the shutdown is causing the site to go offline.
Here is an article explaining more details about what is and is not available during the shutdown.
And if you are interested in seeing what APIs are available for when ...
I just solved a problem exactly like this with the United States' 2012 Census Block Groups. I used ArcGIS to breakdown the borders to their individual line segments (in other words each line that consists of only two vertices), and captured the line length of each segment of each area. I then transformed the lines into midpoints and did an intersect analysis....
There's an Open Plant Hardiness Zones (OPHZ) project on Github where various people have reverse-engineered a pdf of the hardiness zones (pdf, really large) to produce a GIS file (SHP) of the zone boundaries. The ophz-c version is the latest. It's public domain.
You could use GIS software or tools, and a list of the center point of each zip, to find the ...
Just released on Github!!
A parser and resulting dataset for USDA plant hardiness zones. It uses the ZIP-querying API built into the U.S. Department of Agriculture’s Plant Hardiness Zone website (e.g., http://planthardiness.ars.usda.gov/PHZMWeb/ZipProxy.ashx?ZipCode=55555
Full data set:
CSV (1 MB) (archive.org link)
MySQL (1.8 MB) (archive....
this is easy if you use the public-use microdata.
the public/private-sector workforce variable in the current population survey (cps) is a_clswkr and the educational attainment variable is a_hga
open up cps or acs, subset by public vs private-firm worker, and calculate educational attainment rates.
cps and acs are both representative at the state-level. ...