All Questions

Filter by
Sorted by
Tagged with
7
votes
2answers
270 views

Recommended BitTorrent tracker/index for dataset release?

I have a large dataset which I plan to release to the public (around 80GB compressed, 1TB uncompressed), and after considering my options it appears that using the BitTorrent protocol would be the ...
4
votes
1answer
2k views

Database of fictional characters?

Is there a database of fictional characters from novels, films, dramas etc., grouped by genre? The most important entries for me are the name, nationality (real or fictional), title of the novel/film/...
3
votes
2answers
368 views

Open Seed for Crawl

I am currently running a crawl of the internet using Nutch. This requires a list of URLs to start as a seed. I currently have a 500k url seed. But I am looking for any open data sources to provide ...
17
votes
4answers
334 views

What new open data do you need from the U.S. government?

Data.gov provides ~400,000 datasets from 180 federal agencies. However, I know you are interested in more data and more specific data than what is already included. What additional topics, formats, or ...
4
votes
4answers
216 views

Crowdsourcing Data Submission

I have been thinking about how it would be possible to crowdsource the collection of information. There are already many data sources, but often for the desired application the data is incomplete and ...
2
votes
2answers
289 views

Additional Detail from IPEDS Data Source

I have used NCES IPEDS data in the past, but this recent release seems to have instituted a change. In looking at the NCES college navigator site for a particular institution, I notice that they now ...
3
votes
1answer
67 views

Bioequivalent drugs in the US and EU?

I'm looking for lists of bioequivalent drugs in the US or EU. I know there is a (quite short) list from the Chilean government at http://datos.gob.cl/datasets/ver/1303 but I'd like to know if there is ...
9
votes
6answers
357 views

Are there any international non-governmental data aggregators?

We are probably all familiar with Manyeyes and google public data explorer but those are always based on governmental Statistics bureau or OECD data. Are there any projects to aggregate data that is ...
14
votes
7answers
938 views

Should data APIs require registration and API keys?

When publishing a data API, there seems to be a conflict between requiring a user to sign-up for an API key and the principal of open access. What is best practice in publishing an open data API ...
6
votes
1answer
303 views

A database for dog, cat and other pet names?

When it comes to tracking the popularity and distribution of human names over time, Wolfram Alpha seems to be the place to go. But where to find this info for pets? In 2008, the LA Times put ...
8
votes
2answers
107 views

Standards for documenting use caveats?

One of the problems with distributing data is that people think they understand it, and try to use it in ways that may be incompatable with the files. Examples: Years ago, one of the scientists I ...
13
votes
4answers
434 views

Releasing old historical/genealogical datasets as open data

I work with a a couple of small non-profit genealogical and historical groups and we are interested in releasing some of the datasets we've compiled over the years as open data. This information is ...
2
votes
1answer
143 views

Linking FCC documents from ECFS to the Federal Register

The Federal Communications Commission (FCC) publishes documents from rulemakings on its Electronic Comment Filing System (ECFS). These documents include filings from 3rd parties as well as FCC-...
3
votes
1answer
86 views

Spend transaction data formats

What is the best format that we cam reasonably get government bodies to publish their spend transaction data in? In an ideal world we would ask for Linked Data, where every supplier was correctly ...
7
votes
2answers
560 views

Open Web Crawling Dumps

I am currently using the Common Crawl dump of web crawl data. Are their any other good providers of free web crawling data that I can blend with my Common Crawl data?
8
votes
2answers
270 views

Sources of topograpical maps for use in LaTeX documents

I would like to add a partial map of Prague into my LaTeX document but I am lost where to begin search for maps and how to get them into the document. I suppose that once I can get EPS or PDF of map ...
4
votes
1answer
73 views

License for data that precludes government/surveillance use

I have been looking for a few weeks now for a license that has the same force as the HESSLA, namely, restrictions on the use of software for human rights violations or user surveillance, but applied ...
7
votes
4answers
197 views

Best practices for huge explorable linked data directories

The main requirements for our open data directory are: XML-based by default with ability to switch to JSON. It's important the easy way to make it human readable with just linking to XSL. All the ...
2
votes
1answer
55 views

What level of government/governing agency determines the terms of use for transportation map/gis data in the U.S.?

In the work I do I often need various pieces of geographically-based information concerning public roadways and public transportation. It seems to me (and please correct me if I'm wrong) that this ...
6
votes
1answer
2k views

CC-BY vs MIT or BSD licenses regarding re-use?

My understanding is that the MIT license allows sublicensing while the BSD license does not, meaning that license restrictions can be added to things like mashups and not to the original data as a ...
5
votes
3answers
395 views

How can a data governance framework be adapted for Open Data?

I'm interested in seeing if anyone has experience to offer in extending an organization's existing data governance model to include open data release practices. For example, how have organizations ...
3
votes
2answers
84 views

Are there best practices that government API producers should follow more so than non-government API producers?

Clearly, government agencies should default to observing the broader trends of API producers but are there particular best practices that a government API should follow? (Disclaimer - I am the Sr. ...
5
votes
1answer
284 views

Geolocation - UK places with 100,000 people within a 30 mile radius

I have a bunch of locations in a google fusion table, I've also got a population density spreadsheet from The Guardian so I have some data on population density. But I was wondering if there was a ...
7
votes
2answers
6k views

Data Source for Speed Limits

I am not even quite sure how this data would be organized. But I am looking for a data source for different speed limits in the US correlated to street name.
6
votes
4answers
289 views

Appealing a “Mosaic Effect” restriction?

The U.S. Government Policy on Open Data Memo directs agencies to take into account the "mosaic effect." Theoretically, it seems like the mosaic effect could justify the restriction of almost any data....
12
votes
4answers
2k views

What is the major difference between Open data and Linked data?

Although this is not an apple to apple comparison and there is significant overlap i would like to know examples or specific cases where a data set falls into either category but not both. Can data be ...
4
votes
2answers
232 views

Is there data on the types of cars bought and turned in during the “cash for clunkers” program?

I'm interested in determining what sort of cars were traded in and what sort of cars were purchased through the cash for clunkers program. Does anyone know where to find that data? I would hope it ...
9
votes
6answers
233 views

What would be particularly useful basic APIs for the US Federal Government to offer?

There are already certain basic APIs for census tracts, school districts, energy costs, a range of geo data, zip codes, etc. What I'm wondering is what would be other fundamental web services that ...
3
votes
1answer
78 views

Are there best practices about data lifecycle management involving citizens?

Different data portals from different countries treat feedback about datasets (i.e., errors, annotations, comments) differently, but none seems to consider feedback towards the citizens. Are there ...
6
votes
3answers
150 views

How can I access open data on the Indian rupee value, inflation and sensex index over time?

I would like to have an open data source on inflation, rupee value and sensex index data over period of 10 years of India.
1
vote
2answers
60 views

Capturing development/aid project perfromance in IATI format

IATI Standard has "result" element, which includes "baseline" and "indicator" elements to represent project performance. http://iatistandard.org/activities-standard/result/ Is there an example how it ...
2
votes
1answer
49 views

Reporting non-country specific administrative spending in IATI standard

Is there a way to represent Administrative Fund spendings? e.g. organization overhead paying for organization's admin/hr functions at HQ, not allocated to specific countries aid/development projects. ...
6
votes
2answers
278 views

Tales of woe from fixed-format (non-delimited) ASCII data distribution

It seems that many/most government surveys in the health sector are distributed in a fixed-format ASCII, often with SAS code provided to create variables out of the mess (e.g. NHAMCS values and ...
1
vote
1answer
90 views

Seeking real-world networks that have an approximately linear structure

I'm currently looking into real-world networks which can be well approximated by interval graphs. It seems natural to suspect that networks that have constraints forcing them to be approximately ...
16
votes
9answers
1k views

What's an easy-to-use tool to manage datasets?

I am quite new to open data. I see a lot of people looking for machine-readable data, but to start, I am wondering which tool I can use to start playing with some dataset. I am particularly looking ...
6
votes
3answers
308 views

How should I adapt a Schema.org microdata format for legislation?

Has anyone adapted a microdata format from schema.org for pieces of legislation?
6
votes
4answers
140 views

Ethics of publicizing public data

Recently, I worked on a project that scrapes the county sheriff's inmate locator site as a roundabout way to get insight into where the delays occur in the local court system. The photograph, name, ...
4
votes
1answer
74 views

Open and proprietary data in determining federal funding eligibility

For federal grant applications, specific geographical areas and populations often have to meet minimum qualifications in order to demonstrate a need that allows them to apply for a grant (e.g. median ...
14
votes
6answers
338 views

What is the best way to request machine readable data from a FOIA request?

Maybe there is no way to request a specific file type but what is the best way to request a file (paper or digital) that can be converted easiestly?
3
votes
1answer
114 views

What finance data sets would be particularly useful to release?

The U.S. government publishes a range of finance data sets (see, e.g., www.Treasury.gov/financedata). What additional data sets that the government already collects would be valuable if released in ...
5
votes
1answer
167 views

How should I categorize municipal legislation?

I'm working on a site to help Chicagoans understand what their city council is doing. As part of that effort, I would like to roll up the many different types of legislation into a handful of ...
1
vote
1answer
40 views

Checklist for soliciting non-identifiable data from FOSS-users for open data project

So, looking at geonames, I am finding that there are a significant number of blindspots regarding zipcode mappings. Many countries are missing. Some countries have abbreviated data (prefixes in ...
9
votes
2answers
98 views

Categories and varieties of Open Data licensing?

My background with open/free licensing is only within FOSS. An example of category differences within FOSS is Copyleft/Permissive. There is a variety of licenses even within these categories. GPL, MIT ...
8
votes
2answers
107 views

What is the governance of the US Government's Project Open Data?

The US Government just launched Project Open Data on GitHub, which includes best practices, free tools to accelerate adoption of open data practices, and common core metadata for the federal ...
6
votes
3answers
240 views

Restrict search to open datasets on CKAN's Data Hub?

The Data Hub, powered by CKAN, is an impressive collection of datasets available on the web. Currently it lists more than 6000 datasets — however, not all of them are available under an Open Data ...
6
votes
2answers
127 views

What is the plan for the US Government's Data.gov?

The US Government recently announced an intent to upgrade Data.gov. What are the specific technical plans to do so?
7
votes
1answer
53 views

How do United States federal agencies release data?

I'm interested in the process of how an agency, like the EPA, GSA, or Department of State, finds a dataset they wish to release, selects it, and how they go about releasing it to the public. How do ...
6
votes
2answers
412 views

Is there an API or global source for US ballot information?

I'd like to be able to query to discover what's on the ballot - from local measures to Presidential elections. Is there a source that combines all of this data? Or is there a standard that's ...
2
votes
1answer
40 views

Is there a list of Chemical Weapon Industry Facilities/Funders?

This question was recently asked on NICAR and got crickets: Can anybody point me in the right direction for data on state or regional presence (or lack) of chemical weapons industry facilities/...
8
votes
1answer
85 views

What is the appropriate way to timestamp/determine recency of given data set?

Certain U.S. federal grant applications require the use of "recent" data, e.g. data used to support the application should come from recent (i.e. within the past 5 years) published source Is ...

15 30 50 per page