Hot answers tagged

8

In my understanding the data of Kaggle contests remain available indefinitely each with their own rules for sharing and publication. However, I only know of one instance where the data was removed. Criteo Display Advertising Challenge data was removed from Kaggle's website but it's still available on Criteo's and it was also re-released with a more ...


6

Since Deepbills is based on the official XML that Congress publishes, I think it'd be pretty easy to add support for passing through Deepbills' extra tags and attributes to the Ruby gem I made for working with Congress' bills, us-documents: https://github.com/unitedstates/documents It's a tool for stripping a lot of tags out of Congress' bill XML, and ...


6

This is an example of a question that we won't be able to answer until the CourtListener archive is complete. Using the data that is available, one could run queries there for particular statutes by citation or name. For example, if interested in the Convention Against Torture, do a query at CourtListener for that with surrounding quotes, or if interested ...


6

It seems like http://echoprint.me/ is the service you want: Echoprint is a music fingerprint or music identification service. It listens to music signals and tells you what song is playing. It’s backed by a huge database of music that grows with the community and further partnerships. On launch we’ve partnered with Musicbrainz. ... Does ...


6

Yes there are laws about spam: here's for the US, here are some links about Europe spam laws. I'm pretty sure that in France (not sure about other countries), unsolicited commercial emails are illegal if sent to a person BUT commercial prospection IS legal so if the email addresses are professional that would be OK. Anyway, in my opinion the ethic problem ...


5

This site helps to calculate the cost of living in different parts of the United States. There's a caveat about the fidelity and comprehensiveness of the data ("Consider the results a minimum cost threshold that serves as a benchmark, but only that."). For licensing, the site references that it is part of the Living Wage Project. However, in looking ...


5

The Sunlight Foundation makes a lot of Congressional Record data available through its Capitol Words API: http://capitolwords.org/api/1/ It's focused on speeches, and doesn't bring much order to chaos beyond that. But you're also looking for votes, and bills, and bill text? Rather than plumb the depths of the Congressional Record, you can get that from ...


5

Literal answer The Sui generis database right. It is a property right granted in several countries to creators, compilers or curators of databases. Prose answer To address your single points, here have some more text. Owning factual data: Probably not possible. License based on structure: yes, but for that, you must first have used suitables data sources ...


4

I would checkout govtrack.us. They make their datasets available as 'public domain'. https://www.govtrack.us/developers Any data files we make available from the Source Data page for which we own the copyright we release into the public domain.


4

From the ACM terms of usage page To copy otherwise, to republish, to post on servers, or to redistribute to lists, requires prior specific permission and/or a fee. Send written requests for republication to ACM Publications, Copyright & Permissions at the address above or fax +1 (212) 869-0481 or email permissions@acm.org. Thus, I believe ...


4

If you are affiliated with an academic institution that subscribes to IEEE/ACM material, talk to your library. They may be able to negotiate access on your behalf. Chances are fair it isn't the first such request they've heard.


4

I think you should check first if the agreement you have with your customers allow you to reuse and mix their data and in so in which conditions. You can also look at the standard and guideline promoted by of the Dutch DPA or the European Data Protection Supervisor in term of privacy.


4

A searchable directory of international treaties can be found here: http://www.worldtreatyindex.com/index.html Links to download the raw data of the complete database can be found here: http://www.worldtreatyindex.com/multi.html


4

If you are interested to just scrape some data from web pages, then like @magdmartin wrote, you just need to write some code to download the HTML (python requests package) and then to parse the HTML (BeautifulSoup in this case). import requests from bs4 import BeautifulSoup import re r = requests.get('https://www.canlii.org/en/ca/scc/doc/2007/2007scc4/...


4

Check out what the public domain dataset here has to offer: https://github.com/unitedstates/congress-legislators You can also check out Sunlight's Congress API for an alternate presentation: https://sunlightlabs.github.io/congress/


4

The data you are looking for is available at openstates.org. This is a project of the Sunlight Foundation. They have an API and a bulk download page (JSON and CSV) at : http://openstates.org/downloads/ The about page on their website: Open States is a collection of tools that make it possible for citizens to track what is happening in their state's capitol ...


4

here's more of an opinion, not an answer: i'm free software all the way, and i wouldn't give a care to what their terms say, i'd do whatever i pleased with it, until they killed the service. in reality, corporations will destroy you, unless you have an army of lawyers too. look how broken the patent system is, or the hacker that exposed a public url and ...


4

Here's an example from the NIH in 2008. Basically, the NIH learned that in some cases a clever algorithm could identify medical patients from two sets of open medical data. This is an early case in which attempted anonymization turned out to be insufficient. http://articles.latimes.com/2008/aug/29/local/me-dna29 FYI, here's my blog post about it at the time....


4

One you'll probably remember - Wikimedia released (CC0) search logs in 2012, realised they were insufficiently anonymised, and took them down the same day: https://blog.wikimedia.org/2012/09/19/what-are-readers-looking-for-wikipedia-search-data-now-available/ There's probably quite a few more cases like this, where the dataset has been removed shortly ...


4

The key question to ask whenever using data from an API or other source is "what licence is attached to the data?" Quandl doesn't give any definitive answer, but it points to the original dataset's licensing. In the T&C it reads Quandl is an index. It is a conduit to data published on various locations on the internet. Like any search engine, Quandl ...


4

CFPB Credit Card Agreements DB I think that is a service contract. docracy - open source legal contracts Requires sign up


3

In the UK the Computer Misuse Act from 1990 (section 1) states that it is an offence to access a computer where: the access to the data is unauthorised the offender knows that it is unauthorised This may extend to web scraping because, in some circumstances, you are accessing the website intending to use the data in a way that is not authorised by the ...


3

The UN publishes such as list for age of consent for marriage: http://data.un.org/Data.aspx?d=GenderStat&f=inID:19 Note, the age of consent for sex is in many countries lower than consent for marriage. The UN publishes this as well, but I was not able to find it at the moment.


3

Disclosure: I'm the consultant currently working on the Deepbills project with Cato. Short answer: not that we are currently aware of. Let me ask - in what way do you wish to work with the data? If you mean retrieval of the marked-up documents then that can be done via JSON for individual documents, though that would be horribly painful for large ...


3

It depends on the data that you are aggregating and what licensing has been applied to it. For example, if you are finding the data on the U.S. national open data portal, Data.gov, there is no licensing applied for data provided by federal agencies and it is open to use and reuse, including for commercial use. There is also property assessment county ...


3

In its current state Schema.org might not offer a vocabulary that's expressive enough to describe law. Yet since it's under active development and new proposals are being accepted regularly, there's a chance something will be merged into it to provide you with what you need to describe legislation. Meanwhile, you can have a look at some of the RDF ...


3

I looked up the IEEE case: Guests/Members are not permitted to do the following: create an archive of any portion of CSDL; use robots or intelligent agents to access, search and/or systematically download any portion of CSDL; So not looking good for your project. But, if your project has merit, each group may be open to something. I highly ...


3

This is not really an "open data" question, but... The answer is "you are not allowed to do this"; Japan does not allow commercial photography of otherwise copyrighted artistic works in public places, and the CC-BY-SA license allows commercial reuse, so the two are incompatible. The best resource for this sort of question is the (alarmingly comprehensive) ...


3

I can think of one instance that once open data was subsequently removed from public use in future iterations. Unfortunately I don't remember the specifics, but it involved the outcome of trials for criminal cases in a Midwestern state I can't at this moment recall. Not all of it was redacted in more recent releases, but the name of the judge and any other ...


Only top voted, non community-wiki answers of a minimum length are eligible