13

The University of California, Irvine provides a dataset repository specifically for machine learning purposes. There are currently 239 datasets in the repository. These datasets come in many different formats and topics. The oldest datasets in the repository date back to the late 80s, and there are some datasets that are from 2013.


10

It appears that the Netflix data set is no longer available. According to the UC Irvine Machine Learning Repository: Note from donor regarding Netflix data: "Thank you for your interest in the Netflix Prize dataset. The dataset is no longer available." - http://archive.ics.uci.edu/ml/noteNetflix.txt BUT WAIT, there's more... perhaps it is available ...


8

You can use the Tatoeba website which has full sentences in text and audio as downloads. Sentences with audio Download http://downloads.tatoeba.org/exports/sentences_with_audio.tar.bz2 Fields and structure Sentence id File description Contains the ids of the sentences, in all languages, for which audio is available. Thanks to ...


7

Your question is so general it's hard to be sure I'm answering it correctly. More detail would be quite helpful. Here's a stab, though: If you're looking for datasets that are already open and are fairly standard social science data, I would look at what ICPSR holds. They have several datasets, in particular this one, contributed by Jens Ludwig at UChicago. ...


7

I ended up creating my own system combining a bunch of APIs. Here is what I did: I pulled the homepage text from each website and cleaned up all the html, javascript and styles I pushed this text out to various APIs to process and stored the results. I used alchemyapi.com, textrazor.com, opencalais.com. Those APIs have a lot of options but mainly I focused ...


7

Hilary Mason (a data scientist at bit.ly and speaker on the topic of Machine Learning) put together a list of "Research Quality" datasets in a bit.ly bundle specifically for this reason https://bitly.com/bundles/hmason/1 https://web.archive.org/web/20150320022752/https://bitly.com/bundles/hmason/1 It has some interesting datasets from a variety of ...


7

I suggest looking at the SpokenLanguages2 dataset, which is very extensive, containing a bit more than one hour of speech for each of the 172 languages: https://community.topcoder.com/longcontest/?module=ViewProblemStatement&rd=16555&pm=13978 The audio is very high quality. Although they do not provide access to the testing set, you have to do your ...


6

You can use DBpedia Spotlight to extract semantic annotations from DBpedia. Here is the code for Python. You will need these libraries: BeautifulSoup urllib2 urllib json The example is only for one link, but you can create a script to itterate through your url list. from bs4 import BeautifulSoup import urllib2 import json import urllib link = "http://...


6

From the Machine Learning Repository at UCI there are some datasets that may get you started. emails SMS For emails you may also find this StackOverflow discussion helpful, or this 300+MB dataset. For blogs marked as spam, check out this site. Twitter data are not allowed to be publically shared. You can share the analysis or the visualization, but not ...


6

Here is CGM data from a 14 year-old Type I diabetic. Data Includes Datetime Stamp, ISIG, and Glucose level.


6

F-Droid is a repository of Android apps. All data is open source and freely reusable, including app names. The app names can be extracted from the XML file https://f-droid.org/repo/index.xml by filtering on <name> tags. I just extracted them for you, there are currently 1539 app names, here they are: https://gist.github.com/nicolas-raoul/...


6

UCLA Phonetics Lab Archive offers many audio files of spoken word in many languages, although you'll have to dig through and mix-match to your liking: http://archive.phonetics.ucla.edu/ IPA Handbook downloads actually seems to be exactly what you are asking for, however its only for personal use; any other usage requires contacting them for permission...so ...


6

Maybe you can do something with https://rhinospike.com/language/ It's a bit like Tatoeba mentioned above edit : Take also a look at librivox (public domain audiobooks). It comes with an API, then you could send a request like https://librivox.org/api/feed/audiobooks?fields={url_zip_file,language}&offset=XXX&limit=YYY to extract files' id


6

The first step is splitting the image into character arrays. To do that, check out the answers in this question: Separate image of text into component character images. In particular, the ImageMagick answer from 2015. (If you can determine how the input is given, then collect the characters as separate images.) To convert the image into a 2D array, you can ...


6

A couple of new automobile insurance claim data sets have become available since this question was asked. Thought I'd list them here: Emcien: Published: Auto Insurance Claims - Automobile Insurance claims including location, policy type and claim amount http://dyzz9obi78pm5.cloudfront.net/app/image/id/560ec66d32131c9409f2ba54/n/...


5

There are two free data sources that you can use, albeit both are pretty noisy and the job title is a part of a free text field, not an enumerated one. The first is crossing the user profile page and tagged posts from the Stackoverflow public dump. See Stackoverflow downloads from the internet archive and Database schema documentation for the public data ...


5

I would suggest using crime data per city. These datasets give daily as well as historical data, as well as location and time of day. When combined with other data (weather, census, employment, types of businesses, housing, etc) many correlations can be analyzed with different models being applied. Below is a link to a blog that I wrote on this a while back ...


5

I've found something else. It is called the wide language index. See on github. It consists in a listing of radio podcasts. It's pretty impressive in the numbers of languages covered. Note : It was made for the game The Great language game which is fun ;).


4

What you're trying to do seems to fall under "topic modeling" or "clustering." Looking at the DiRT wiki's list of clustering tools, perhaps this topic-modeling tool would be a good place to start.


4

If you're already using a Python toolchain, then the easiest option is probably skdata. See the data sets it provides.


4

Kaggle hosts predictive modeling competitions where you might find the data set you are looking for to test your model.


4

You can find US and British english language phones at university linguistic departments such as Berkeley, Ca. Though, what is useful for speech recognition are the features in statistical acoustic models that are extracted from a large amount of annotated audio recordings. These acoustic model features involve hidden markov models and Mel-Frequency Cepstral ...


4

Your ideal dataset is local, relevant to their discipline (if they have one), and interesting in its own right. In the past I have used Melbourne's "urban forest" dataset of 70,000 trees. If you have hardcore computer scientists, you'll want a big and challenging dataset, maybe something transport related, like movements of taxis, or public transport, or ...


4

It's hard to know your exact audience, but there is a great blog post with (by now) more than 100 interesting data sets - 100+ Interesting Data Sets for Statistics "Data science" is pretty far-ranging, so you could do many different types of analysis: IT-related data mining - for example, Firefox browser data (alternative download site) Image processing, ...


4

There is one public access MySQL Database that hosts a large number of records about iOS apps: StatsiOS After little of cleaning I could obtain 1.98M unique app names!


4

What about StackOverflow's own dataset? https://archive.org/details/stackexchange


4

Look into MTConnect. Basically, you can read from a stream of XML coming from any type of device that utilizes the MTConnect "standard". MTConnect is part of the manufacturing solution for Internet of Things. In a nut shell, anything that has an electrical pulse can theoretically be monitored using sensors. These sensors can be tracked and the signals can ...


4

You can review this paper: A Public Domain Dataset for Human Activity Recognition Using Smartphones In particular, tracking down the references leads to this page containing the "Opportunity" activity data and this specific link to the data.


4

In addition to the API, you can use a bulk downloader* tool to collect images from a Flickr group Example of bulk downloader tool Example of Creative Commons group (pool) Wikimedia Commons Public Domain Archive Other ideas *instead of a bulk downloader tool, you can use wget wget -r -P /download/location -A jpg,jpeg,gif,png https://www.flickr.com/groups/...


Only top voted, non community-wiki answers of a minimum length are eligible