All Questions

Filter by
Sorted by
Tagged with
2
votes
2answers
235 views

How do I escape a single quote in a Socrata SODA 2 API call?

I'd like to request a query that includes a single quote '. http://data.cityofchicago.org/resource/xh8b-g55w.json?$where=license_description="Caterer's Liquor License"&$limit=1 returns { "code"...
6
votes
2answers
1k views

How do I Get that Juicy Economic Data from BLS.gov (Bureau of Labor Statistics) into Zip Code Format?

You go to BLS.gov. Click on any one of the links up on their menu that you fancy - I specifically am interested in Consumer Expenditures or disposable income...potential demand..things of those ...
4
votes
1answer
66 views

How do you respond when government cites costs for not releasing data?

We've rounded up some of the reasons governments cite for not releasing data to the public. We're asking for help now in refuting those reasons. You can read more in this blog post: http://...
41
votes
9answers
1k views

Benefits of using CC0 over CC-BY for data

I've heard a few times that for data one should use rather CC0 (Creative Commons - Public Domain Dedication) license than CC-BY (Creative Commons - Attribution). What is the reason for that? (As ...
1
vote
1answer
43 views

What do the permit types in Chicago's Building Permit Data mean?

The documentation for Chicago's building permit data seems to be out date. Anybody know what Permit Type "PERMIT - NEW CONSTRUCTION" and "PERMIT - RENOVATION/ALTERATION" mean?
12
votes
2answers
359 views

GitHub license for code written by US Government Employee

When I open a new project on Github, I see a selection of licenses in a drop-down list, which currently looks like this: None Apache v2 License MIT license Affero GPL Artistic License 2.0 BSD (3-...
9
votes
1answer
144 views

Is data scraped from Govt agencies and in public domain considered open data?

We have been scraping information regarding oil wells drilled in a particular state using web scraper from the state regulatory agency. This agency provides an arcane interface for this information. ...
13
votes
3answers
3k views

What does OpenRefine offer that other data-parsing tools don't?

I see OpenRefine mentioned a lot here, but I don't see it doing much that R and others can't. What capabilities does it offer that I'm not seeing in the promo page that R or other data packages ...
5
votes
3answers
3k views

Postal codes and city districts worldwide for download

I am searching a database of all zipcodes / postal codes and the city districts (part of the cities) in the world. Is there some service like the GeoNames database? I spoke with GeoNames, but they don'...
3
votes
1answer
263 views

Programatically request recent close prices for a list of stock tickers

I have a list of stock tickers and for each ticker I need today's close price and yesterday's close price. I could use (have used) Yahoo Historical Data API by sending GET requests of the following ...
10
votes
4answers
705 views

Examples of scraping from “real-world” data sources using OCR, etc?

Are there any examples of open data that have been scraped from "real-world" sources? To explain what I mean by "real-world", here are some (made up) examples and then some criteria: Train departure ...
6
votes
1answer
109 views

Requirements of the Open Data Commons Attribution License

When OCLC released their WorldCat data under Open Data Commons Attribution License last year, there was a question in the library community as to exactly what would be required for adequate ...
2
votes
2answers
147 views

Metropolitan Railway Datasets

Where can I find commuter-related datasets for underground transportation (subway, metro)? The NY MTA is a good example, and there is also the Transport for London data feeds. I would like to have ...
3
votes
1answer
213 views

Crawling user data from different applications

I would like to know if there is an existing tool/crawler/scraper/service to crawl the data of a particular user from different websites and applications. For example, can I crawl the data of a user A ...
6
votes
1answer
94 views

How to flag incorrect links to data on data.gov?

Just looking around, and noticed that the CSV dataset that should be a list of all elementary schools in the US, is actually a population breakdown of Canadian provinces. http://catalog-next.data....
4
votes
1answer
34 views

U.S. Supreme Court record items

Is there source of U.S. Supreme Court record items (merit and amicus briefs, appendices, etc.) from 1942? I'm interested in a general answer, but in particular, I'm interested in the record from ...
5
votes
2answers
721 views

Load data from HTML tables into OpenRefine?

One answer to the question Wikipedia table to JSON (or other machine-readable format) suggested to use OpenRefine for handling HTML tables. All I could find regarding OpenRefine and HTML tables were ...
7
votes
2answers
123 views

Is “open” data free as in speech, free as in beer, both, or something else?

In open data, should I understand open to mean: Free as in speech Free as in beer, gratis Both? Something else? For example, the Swedish Meteorological and Hydrological Institute (SMHI) has ...
2
votes
1answer
45 views

Where are the concentrations of digital companies in the UK?

New research published this weekend suggests that the UK currently has 270,000 digital companies out of about 2.1 million total businesses. But does anyone have access to how many people are employed ...
4
votes
2answers
134 views

Examples of metadata for non-uniform collections

Are there examples of metadata — lists of what a site offers, that users search to help them decide what to download — for non-uniform collections like UCI ml or openml.org ? Metadata is ...
4
votes
1answer
171 views

Who are non-schema.org data standards for?

I'm a contributor to a project that presents municipal legislation to the public. I have been reading about the Popolo project http://popoloproject.com/ and other data specifications for legislation ...
3
votes
3answers
4k views

Self-documenting RESTful APIs: examples with WADL?

One of the hurdles in taking advantage of a data API, particularly the ever more popular RESTful APIs, is either in implementing or finding an existing implementation of the API in one's programming ...
3
votes
2answers
95 views

Need clarification: if state or city gov releases data in non-open formats (i.e. book, microfiche), *must* they now also release it in CSV format?

Consider the following not-so-hypothetical situation: A state or city government has, for many years now, released a certain data set in various "old school" formats, such as a printed book or ...
16
votes
4answers
333 views

Why should I care how a (structured) dataset is licenced?

When thinking about "Open Data" (possibly due to nothing more than my own ignorance) I am utterly confused as to what difference an open licence legally makes for structured data. "Open Data" for me ...
2
votes
2answers
205 views

Linking results from the FCC's TV Query API to the FCC's TV Stations Profiles API

The FCC has at least two APIs related to broadcast station data. One is TV Query, which can return pipe-delimited results like this (keys): |K02JU |- |TX |2 |DA | |...
16
votes
2answers
3k views

IPA phonology database

Is there any open database of English words and their pronunciation in IPA? What about other languages (Arabic, French,...)? (Please also point out the license of the DB) Update: I tried to convert ...
4
votes
1answer
28 views

What open data institutes in the US are working with the Open Government Partnership?

The Open Government Partnership (OGP) is a global alliance of countries that are signatory to an Open Government Declaration. The United States is one of the eight founding signatories - I am curious ...
14
votes
2answers
268 views

Is the data used to calculate national CPI public?

What data is used to calculate the CPI (Consumer Price Index) and if it is open, where can I find it?
2
votes
2answers
42 views

What criteria determine a good name for an open data product?

I'm working on a new data product related to satellite atmospheric remote sensing. I'm writing an article on it for a peer-reviewed scientific journal, and the data will be publicly available. One ...
7
votes
2answers
266 views

Recommended BitTorrent tracker/index for dataset release?

I have a large dataset which I plan to release to the public (around 80GB compressed, 1TB uncompressed), and after considering my options it appears that using the BitTorrent protocol would be the ...
4
votes
1answer
2k views

Database of fictional characters?

Is there a database of fictional characters from novels, films, dramas etc., grouped by genre? The most important entries for me are the name, nationality (real or fictional), title of the novel/film/...
3
votes
2answers
363 views

Open Seed for Crawl

I am currently running a crawl of the internet using Nutch. This requires a list of URLs to start as a seed. I currently have a 500k url seed. But I am looking for any open data sources to provide ...
17
votes
4answers
334 views

What new open data do you need from the U.S. government?

Data.gov provides ~400,000 datasets from 180 federal agencies. However, I know you are interested in more data and more specific data than what is already included. What additional topics, formats, or ...
4
votes
4answers
214 views

Crowdsourcing Data Submission

I have been thinking about how it would be possible to crowdsource the collection of information. There are already many data sources, but often for the desired application the data is incomplete and ...
2
votes
2answers
289 views

Additional Detail from IPEDS Data Source

I have used NCES IPEDS data in the past, but this recent release seems to have instituted a change. In looking at the NCES college navigator site for a particular institution, I notice that they now ...
3
votes
1answer
67 views

Bioequivalent drugs in the US and EU?

I'm looking for lists of bioequivalent drugs in the US or EU. I know there is a (quite short) list from the Chilean government at http://datos.gob.cl/datasets/ver/1303 but I'd like to know if there is ...
9
votes
6answers
356 views

Are there any international non-governmental data aggregators?

We are probably all familiar with Manyeyes and google public data explorer but those are always based on governmental Statistics bureau or OECD data. Are there any projects to aggregate data that is ...
14
votes
7answers
931 views

Should data APIs require registration and API keys?

When publishing a data API, there seems to be a conflict between requiring a user to sign-up for an API key and the principal of open access. What is best practice in publishing an open data API ...
6
votes
1answer
302 views

A database for dog, cat and other pet names?

When it comes to tracking the popularity and distribution of human names over time, Wolfram Alpha seems to be the place to go. But where to find this info for pets? In 2008, the LA Times put ...
8
votes
2answers
107 views

Standards for documenting use caveats?

One of the problems with distributing data is that people think they understand it, and try to use it in ways that may be incompatable with the files. Examples: Years ago, one of the scientists I ...
13
votes
4answers
434 views

Releasing old historical/genealogical datasets as open data

I work with a a couple of small non-profit genealogical and historical groups and we are interested in releasing some of the datasets we've compiled over the years as open data. This information is ...
2
votes
1answer
143 views

Linking FCC documents from ECFS to the Federal Register

The Federal Communications Commission (FCC) publishes documents from rulemakings on its Electronic Comment Filing System (ECFS). These documents include filings from 3rd parties as well as FCC-...
3
votes
1answer
85 views

Spend transaction data formats

What is the best format that we cam reasonably get government bodies to publish their spend transaction data in? In an ideal world we would ask for Linked Data, where every supplier was correctly ...
7
votes
2answers
554 views

Open Web Crawling Dumps

I am currently using the Common Crawl dump of web crawl data. Are their any other good providers of free web crawling data that I can blend with my Common Crawl data?
8
votes
2answers
270 views

Sources of topograpical maps for use in LaTeX documents

I would like to add a partial map of Prague into my LaTeX document but I am lost where to begin search for maps and how to get them into the document. I suppose that once I can get EPS or PDF of map ...
4
votes
1answer
73 views

License for data that precludes government/surveillance use

I have been looking for a few weeks now for a license that has the same force as the HESSLA, namely, restrictions on the use of software for human rights violations or user surveillance, but applied ...
7
votes
4answers
197 views

Best practices for huge explorable linked data directories

The main requirements for our open data directory are: XML-based by default with ability to switch to JSON. It's important the easy way to make it human readable with just linking to XSL. All the ...
2
votes
1answer
55 views

What level of government/governing agency determines the terms of use for transportation map/gis data in the U.S.?

In the work I do I often need various pieces of geographically-based information concerning public roadways and public transportation. It seems to me (and please correct me if I'm wrong) that this ...
6
votes
1answer
2k views

CC-BY vs MIT or BSD licenses regarding re-use?

My understanding is that the MIT license allows sublicensing while the BSD license does not, meaning that license restrictions can be added to things like mashups and not to the original data as a ...
5
votes
3answers
391 views

How can a data governance framework be adapted for Open Data?

I'm interested in seeing if anyone has experience to offer in extending an organization's existing data governance model to include open data release practices. For example, how have organizations ...

15 30 50 per page