All Questions

Filter by
Sorted by
Tagged with
1
vote
1answer
44 views

What do the permit types in Chicago's Building Permit Data mean?

The documentation for Chicago's building permit data seems to be out date. Anybody know what Permit Type "PERMIT - NEW CONSTRUCTION" and "PERMIT - RENOVATION/ALTERATION" mean?
12
votes
2answers
373 views

GitHub license for code written by US Government Employee

When I open a new project on Github, I see a selection of licenses in a drop-down list, which currently looks like this: None Apache v2 License MIT license Affero GPL Artistic License 2.0 BSD (3-...
9
votes
1answer
146 views

Is data scraped from Govt agencies and in public domain considered open data?

We have been scraping information regarding oil wells drilled in a particular state using web scraper from the state regulatory agency. This agency provides an arcane interface for this information. ...
13
votes
3answers
3k views

What does OpenRefine offer that other data-parsing tools don't?

I see OpenRefine mentioned a lot here, but I don't see it doing much that R and others can't. What capabilities does it offer that I'm not seeing in the promo page that R or other data packages ...
5
votes
3answers
3k views

Postal codes and city districts worldwide for download

I am searching a database of all zipcodes / postal codes and the city districts (part of the cities) in the world. Is there some service like the GeoNames database? I spoke with GeoNames, but they don'...
3
votes
1answer
265 views

Programatically request recent close prices for a list of stock tickers

I have a list of stock tickers and for each ticker I need today's close price and yesterday's close price. I could use (have used) Yahoo Historical Data API by sending GET requests of the following ...
11
votes
4answers
726 views

Examples of scraping from “real-world” data sources using OCR, etc?

Are there any examples of open data that have been scraped from "real-world" sources? To explain what I mean by "real-world", here are some (made up) examples and then some criteria: Train departure ...
6
votes
1answer
114 views

Requirements of the Open Data Commons Attribution License

When OCLC released their WorldCat data under Open Data Commons Attribution License last year, there was a question in the library community as to exactly what would be required for adequate ...
2
votes
2answers
150 views

Metropolitan Railway Datasets

Where can I find commuter-related datasets for underground transportation (subway, metro)? The NY MTA is a good example, and there is also the Transport for London data feeds. I would like to have ...
3
votes
1answer
215 views

Crawling user data from different applications

I would like to know if there is an existing tool/crawler/scraper/service to crawl the data of a particular user from different websites and applications. For example, can I crawl the data of a user A ...
6
votes
1answer
94 views

How to flag incorrect links to data on data.gov?

Just looking around, and noticed that the CSV dataset that should be a list of all elementary schools in the US, is actually a population breakdown of Canadian provinces. http://catalog-next.data....
4
votes
1answer
34 views

U.S. Supreme Court record items

Is there source of U.S. Supreme Court record items (merit and amicus briefs, appendices, etc.) from 1942? I'm interested in a general answer, but in particular, I'm interested in the record from ...
5
votes
2answers
824 views

Load data from HTML tables into OpenRefine?

One answer to the question Wikipedia table to JSON (or other machine-readable format) suggested to use OpenRefine for handling HTML tables. All I could find regarding OpenRefine and HTML tables were ...
8
votes
2answers
125 views

Is “open” data free as in speech, free as in beer, both, or something else?

In open data, should I understand open to mean: Free as in speech Free as in beer, gratis Both? Something else? For example, the Swedish Meteorological and Hydrological Institute (SMHI) has ...
2
votes
1answer
49 views

Where are the concentrations of digital companies in the UK?

New research published this weekend suggests that the UK currently has 270,000 digital companies out of about 2.1 million total businesses. But does anyone have access to how many people are employed ...
4
votes
2answers
138 views

Examples of metadata for non-uniform collections

Are there examples of metadata — lists of what a site offers, that users search to help them decide what to download — for non-uniform collections like UCI ml or openml.org ? Metadata is ...
4
votes
1answer
176 views

Who are non-schema.org data standards for?

I'm a contributor to a project that presents municipal legislation to the public. I have been reading about the Popolo project http://popoloproject.com/ and other data specifications for legislation ...
3
votes
3answers
4k views

Self-documenting RESTful APIs: examples with WADL?

One of the hurdles in taking advantage of a data API, particularly the ever more popular RESTful APIs, is either in implementing or finding an existing implementation of the API in one's programming ...
3
votes
2answers
95 views

Need clarification: if state or city gov releases data in non-open formats (i.e. book, microfiche), *must* they now also release it in CSV format?

Consider the following not-so-hypothetical situation: A state or city government has, for many years now, released a certain data set in various "old school" formats, such as a printed book or ...
16
votes
4answers
342 views

Why should I care how a (structured) dataset is licenced?

When thinking about "Open Data" (possibly due to nothing more than my own ignorance) I am utterly confused as to what difference an open licence legally makes for structured data. "Open Data" for me ...
2
votes
2answers
214 views

Linking results from the FCC's TV Query API to the FCC's TV Stations Profiles API

The FCC has at least two APIs related to broadcast station data. One is TV Query, which can return pipe-delimited results like this (keys): |K02JU |- |TX |2 |DA | |...
17
votes
2answers
4k views

IPA phonology database

Is there any open database of English words and their pronunciation in IPA? What about other languages (Arabic, French,...)? (Please also point out the license of the DB) Update: I tried to convert ...
4
votes
1answer
29 views

What open data institutes in the US are working with the Open Government Partnership?

The Open Government Partnership (OGP) is a global alliance of countries that are signatory to an Open Government Declaration. The United States is one of the eight founding signatories - I am curious ...
14
votes
2answers
276 views

Is the data used to calculate national CPI public?

What data is used to calculate the CPI (Consumer Price Index) and if it is open, where can I find it?
2
votes
2answers
42 views

What criteria determine a good name for an open data product?

I'm working on a new data product related to satellite atmospheric remote sensing. I'm writing an article on it for a peer-reviewed scientific journal, and the data will be publicly available. One ...
7
votes
2answers
344 views

Recommended BitTorrent tracker/index for dataset release?

I have a large dataset which I plan to release to the public (around 80GB compressed, 1TB uncompressed), and after considering my options it appears that using the BitTorrent protocol would be the ...
3
votes
2answers
396 views

Open Seed for Crawl

I am currently running a crawl of the internet using Nutch. This requires a list of URLs to start as a seed. I currently have a 500k url seed. But I am looking for any open data sources to provide ...
17
votes
4answers
342 views

What new open data do you need from the U.S. government?

Data.gov provides ~400,000 datasets from 180 federal agencies. However, I know you are interested in more data and more specific data than what is already included. What additional topics, formats, or ...
4
votes
4answers
220 views

Crowdsourcing Data Submission

I have been thinking about how it would be possible to crowdsource the collection of information. There are already many data sources, but often for the desired application the data is incomplete and ...
2
votes
2answers
295 views

Additional Detail from IPEDS Data Source

I have used NCES IPEDS data in the past, but this recent release seems to have instituted a change. In looking at the NCES college navigator site for a particular institution, I notice that they now ...
3
votes
1answer
68 views

Bioequivalent drugs in the US and EU?

I'm looking for lists of bioequivalent drugs in the US or EU. I know there is a (quite short) list from the Chilean government at http://datos.gob.cl/datasets/ver/1303 but I'd like to know if there is ...
9
votes
6answers
365 views

Are there any international non-governmental data aggregators?

We are probably all familiar with Manyeyes and google public data explorer but those are always based on governmental Statistics bureau or OECD data. Are there any projects to aggregate data that is ...
14
votes
7answers
955 views

Should data APIs require registration and API keys?

When publishing a data API, there seems to be a conflict between requiring a user to sign-up for an API key and the principal of open access. What is best practice in publishing an open data API ...
8
votes
2answers
109 views

Standards for documenting use caveats?

One of the problems with distributing data is that people think they understand it, and try to use it in ways that may be incompatable with the files. Examples: Years ago, one of the scientists I ...
14
votes
4answers
451 views

Releasing old historical/genealogical datasets as open data

I work with a a couple of small non-profit genealogical and historical groups and we are interested in releasing some of the datasets we've compiled over the years as open data. This information is ...
2
votes
1answer
145 views

Linking FCC documents from ECFS to the Federal Register

The Federal Communications Commission (FCC) publishes documents from rulemakings on its Electronic Comment Filing System (ECFS). These documents include filings from 3rd parties as well as FCC-...
3
votes
1answer
90 views

Spend transaction data formats

What is the best format that we cam reasonably get government bodies to publish their spend transaction data in? In an ideal world we would ask for Linked Data, where every supplier was correctly ...
7
votes
2answers
656 views

Open Web Crawling Dumps

I am currently using the Common Crawl dump of web crawl data. Are their any other good providers of free web crawling data that I can blend with my Common Crawl data?
8
votes
2answers
271 views

Sources of topograpical maps for use in LaTeX documents

I would like to add a partial map of Prague into my LaTeX document but I am lost where to begin search for maps and how to get them into the document. I suppose that once I can get EPS or PDF of map ...
4
votes
1answer
74 views

License for data that precludes government/surveillance use

I have been looking for a few weeks now for a license that has the same force as the HESSLA, namely, restrictions on the use of software for human rights violations or user surveillance, but applied ...
7
votes
4answers
198 views

Best practices for huge explorable linked data directories

The main requirements for our open data directory are: XML-based by default with ability to switch to JSON. It's important the easy way to make it human readable with just linking to XSL. All the ...
2
votes
1answer
55 views

What level of government/governing agency determines the terms of use for transportation map/gis data in the U.S.?

In the work I do I often need various pieces of geographically-based information concerning public roadways and public transportation. It seems to me (and please correct me if I'm wrong) that this ...
6
votes
1answer
2k views

CC-BY vs MIT or BSD licenses regarding re-use?

My understanding is that the MIT license allows sublicensing while the BSD license does not, meaning that license restrictions can be added to things like mashups and not to the original data as a ...
5
votes
3answers
413 views

How can a data governance framework be adapted for Open Data?

I'm interested in seeing if anyone has experience to offer in extending an organization's existing data governance model to include open data release practices. For example, how have organizations ...
3
votes
2answers
84 views

Are there best practices that government API producers should follow more so than non-government API producers?

Clearly, government agencies should default to observing the broader trends of API producers but are there particular best practices that a government API should follow? (Disclaimer - I am the Sr. ...
5
votes
1answer
285 views

Geolocation - UK places with 100,000 people within a 30 mile radius

I have a bunch of locations in a google fusion table, I've also got a population density spreadsheet from The Guardian so I have some data on population density. But I was wondering if there was a ...
7
votes
2answers
6k views

Data Source for Speed Limits

I am not even quite sure how this data would be organized. But I am looking for a data source for different speed limits in the US correlated to street name.
6
votes
4answers
290 views

Appealing a “Mosaic Effect” restriction?

The U.S. Government Policy on Open Data Memo directs agencies to take into account the "mosaic effect." Theoretically, it seems like the mosaic effect could justify the restriction of almost any data....
12
votes
4answers
2k views

What is the major difference between Open data and Linked data?

Although this is not an apple to apple comparison and there is significant overlap i would like to know examples or specific cases where a data set falls into either category but not both. Can data be ...
4
votes
2answers
244 views

Is there data on the types of cars bought and turned in during the “cash for clunkers” program?

I'm interested in determining what sort of cars were traded in and what sort of cars were purchased through the cash for clunkers program. Does anyone know where to find that data? I would hope it ...

15 30 50 per page