In my understanding the data of Kaggle contests remain available indefinitely each with their own rules for sharing and publication. However, I only know of one instance where the data was removed. Criteo Display Advertising Challenge data was removed from Kaggle's website but it's still available on Criteo's and it was also re-released with a more ...
This is an example of a question that we won't be able to answer until the CourtListener archive is complete. Using the data that is available, one could run queries there for particular statutes by citation or name.
For example, if interested in the Convention Against Torture, do a query at CourtListener for that with surrounding quotes, or if interested ...
It seems like http://echoprint.me/ is the service you want:
Echoprint is a music fingerprint or music identification service. It
listens to music signals and tells you what song is playing. It’s
backed by a huge database of music that grows with the community and
further partnerships. On launch we’ve partnered with Musicbrainz.
Yes there are laws about spam: here's for the US, here are some links about Europe spam laws.
I'm pretty sure that in France (not sure about other countries), unsolicited commercial emails are illegal if sent to a person BUT commercial prospection IS legal so if the email addresses are professional that would be OK.
Anyway, in my opinion the ethic problem ...
This site helps to calculate the cost of living in different parts of the United States. There's a caveat about the fidelity and comprehensiveness of the data ("Consider the results a minimum cost threshold that serves as a benchmark, but only that.").
For licensing, the site references that it is part of the Living Wage Project. However, in looking ...
The Sunlight Foundation makes a lot of Congressional Record data available through its Capitol Words API:
It's focused on speeches, and doesn't bring much order to chaos beyond that.
But you're also looking for votes, and bills, and bill text? Rather than plumb the depths of the Congressional Record, you can get that from ...
The Sui generis database right. It is a property right granted in several countries to creators, compilers or curators of databases.
To address your single points, here have some more text.
Owning factual data: Probably not possible.
License based on structure: yes, but for that, you must first have used suitables data sources ...
I think you should check first if the agreement you have with your customers allow you to reuse and mix their data and in so in which conditions.
You can also look at the standard and guideline promoted by of the Dutch DPA or the European Data Protection Supervisor in term of privacy.
I would checkout govtrack.us. They make their datasets available as 'public domain'.
Any data files we make available from the Source Data page for which we own the copyright we release into the public domain.
From the ACM terms of usage page
To copy otherwise, to republish, to post on servers, or to
redistribute to lists, requires prior specific permission and/or a
fee. Send written requests for republication to ACM Publications,
Copyright & Permissions at the address above or fax +1 (212) 869-0481
or email email@example.com.
Thus, I believe ...
If you are interested to just scrape some data from web pages, then like @magdmartin wrote, you just need to write some code to download the HTML (python requests package) and then to parse the HTML (BeautifulSoup in this case).
from bs4 import BeautifulSoup
r = requests.get('https://www.canlii.org/en/ca/scc/doc/2007/2007scc4/...
Check out what the public domain dataset here has to offer:
You can also check out Sunlight's Congress API for an alternate presentation:
The data you are looking for is available at openstates.org. This is a project of the Sunlight Foundation. They have an API and a bulk download page (JSON and CSV) at : http://openstates.org/downloads/
The about page on their website:
Open States is a collection of tools that make it possible for citizens to track what is happening in their state's capitol ...
here's more of an opinion, not an answer:
i'm free software all the way, and i wouldn't give a care to what their terms say, i'd do whatever i pleased with it, until they killed the service.
in reality, corporations will destroy you, unless you have an army of lawyers too. look how broken the patent system is, or the hacker that exposed a public url and ...
If you are affiliated with an academic institution that subscribes to IEEE/ACM material, talk to your library. They may be able to negotiate access on your behalf. Chances are fair it isn't the first such request they've heard.
Here's an example from the NIH in 2008. Basically, the NIH learned that in some cases a clever algorithm could identify medical patients from two sets of open medical data. This is an early case in which attempted anonymization turned out to be insufficient.
FYI, here's my blog post about it at the time....
One you'll probably remember - Wikimedia released (CC0) search logs in 2012, realised they were insufficiently anonymised, and took them down the same day:
There's probably quite a few more cases like this, where the dataset has been removed shortly ...
The key question to ask whenever using data from an API or other source is "what licence is attached to the data?"
Quandl doesn't give any definitive answer, but it points to the original dataset's licensing.
In the T&C it reads
Quandl is an index. It is a conduit to data published on various locations on the internet. Like any search engine, Quandl ...
Not sure if this fits your requirement, but the Enron Email Dataset comes to mind. There are multiple locations where you can learn about the dataset, i.e. here: https://www.cs.cmu.edu/~./enron/
The initially published dataset got cleaned because some information was too sensitive.
I looked up the IEEE case:
Guests/Members are not permitted to do the following:
create an archive of any portion of CSDL;
use robots or intelligent agents to access, search and/or systematically download any portion of CSDL;
So not looking good for your project.
But, if your project has merit, each group may be open to something. I highly ...
I can think of one instance that once open data was subsequently removed from public use in future iterations. Unfortunately I don't remember the specifics, but it involved the outcome of trials for criminal cases in a Midwestern state I can't at this moment recall. Not all of it was redacted in more recent releases, but the name of the judge and any other ...
This is not really an "open data" question, but...
The answer is "you are not allowed to do this"; Japan does not allow commercial photography of otherwise copyrighted artistic works in public places, and the CC-BY-SA license allows commercial reuse, so the two are incompatible.
The best resource for this sort of question is the (alarmingly comprehensive) ...
In the UK the Computer Misuse Act from 1990 (section 1) states that it is an offence to access a computer where:
the access to the data is unauthorised
the offender knows that it is unauthorised
This may extend to web scraping because, in some circumstances, you are accessing the website intending to use the data in a way that is not authorised by the ...
The UN publishes such as list for age of consent for marriage:
Note, the age of consent for sex is in many countries lower than consent for marriage. The UN publishes this as well, but I was not able to find it at the moment.
Not a direct answer to the legal question, but...
If you send any unsolicited email then to prevent your sending address/domain being marked as a spammer, you should use an emailing service. Once you are marked as a spammer, which is based on people putting your email in the spam folder, then very few of your emails will get through to inboxes.
The rules are different for different problems.
Having been active for some time now, this is what I've observed (Note: I play with completed competitions too for practise, and I personally haven't seen any data set getting removed till now):
Generally, the data for the recruiting problems and limited access problems are removed and/or encrypted, and one ...
The TOS are quite explicit you can't use their data without their consent and buy having a license.
Any use, reproduction, or distribution of this Site or Content without SRL's advance written consent is prohibited, except, however, you may download one copy of these materials, and you may print one copy of these materials for your use in learning about, ...
This dataset contains labeled and unlabeled legal contracts for contract element extraction. The labeled dataset POS tags as well as annotations for different contract elements. You can refer to the Read me section for more details.