All Questions

Filter by
Sorted by
Tagged with
23
votes
6answers
27k views

Twitter open datasets

Where can I get Twitter datasets available for analysis? I found two: The May 2011 Calufa Twitter Scrape Cheng-Caverlee-Lee September 2009 - January 2010 Twitter Scrape
1
vote
0answers
14 views

How to distinguish between human and animal bones in Wikidata?

The two topics https://www.wikidata.org/wiki/Q16343 (Clavicle) https://www.wikidata.org/wiki/Q835986 (Baculum, Penis bone) are both instances of Q265868 (Bone). However, the clavicle is a human (...
2
votes
0answers
16 views

Quote request dataset /sentence templates

I'm making a quote-bot which requires NER/extraction of suburbs/postcodes/states in Australia, which, perhaps unsurprisingly, seems harder to find than equiv for US etc. Example utterances would be: ...
24
votes
3answers
10k views

Bulk download Sci-Hub papers

I wonder whether it is possible to bulk download all papers stored in Sci-Hub. I am aware of the questions: Is there a more user-friendly way to download multiple articles from arXiv? Bulk download ...
1
vote
0answers
12 views

Which is the best choice of getting bonds data from?

I have to find some data of german, greece 10 years bonds and risk premium from 2017 up to now. I found some sources, 1) https://countryeconomy.com/bonds/germany 2) https://www.bloomberg.com/quote/...
0
votes
1answer
26 views

Social media data sets for data science and exploration?

I'm looking for some open data sets of social media apps (messaging app, networking app, user sharing app, etc...) that I can use to practice modeling and visualizing within the context of social ...
3
votes
3answers
6k views

Where can I find automobile insurance claims data set?

I really need a dataset about automobile insurance claims to train and test learning algorithms. I found references to Masachussets PIP claims data and to Spanish claims data in many scientific ...
1
vote
2answers
24 views

Where I can get the full list of San Francisco Bay Area Tech Companies?

There already a SiliconValleyMap, but I want to create a San Francisco Bay Area Tech Companies Map. Where I can find the company list?
3
votes
2answers
57 views

Is there a dataset for historical US towns and roads?

I need to map US settlements/towns/cities from colonial times through roughly 1900, for example Bath, NC founded 1705 at lat/lon. The minimal data I'm looking for would contain: Name of town or ...
2
votes
3answers
59 views

Looking for suggestions of sources for data science project

I'm currently taking a first step into Data Science, and studying a specific computational method, I'm a math student, but I'm looking for reliable data sources, and if related to biology (e.g public ...
1
vote
0answers
9 views

Request for Feed The Future, Baseline Population Based Survey - Ethiopia

I am working on an MSc thesis titled women empowerment in agricultural productivity and marketed surplus: In case of Ethiopia. How can I access the data of Feed The Future, Baseline Population Based ...
5
votes
1answer
279 views

Find a missing dataset: “A Week in the life of a browser - Version 2” from Mozilla Labs

It's come up as an answer for two questions: Open, big time-series dataset (ideally web traffic) Where I can find a repository of software usage/execution logs (traces)? Here is the main page: A ...
0
votes
1answer
16 views

Open database for various DB servers

For benchmarking and testing, I am looking for an open SQL database that can be installed in various database servers (e.g. Postgres, MySQL, etc).
2
votes
2answers
40 views

Any libraries for SEC Forms, such as a 10Q, as an Interface?

I'd like to process some SEC data, such as a 10Q, but don't want to build a parser for the data myself. Are there any existing libraries that can parse or represent these types of forms?
28
votes
9answers
18k views

Open API for SEC data?

Is there any free API for programmatically grabbing SEC filing data, such as company financials or insider trading? It seems ironic that the EDGAR search gives you information in a nice tabular form, ...
1
vote
1answer
13 views

Which is the best way to work with NCBI data obtaining online partial information from the whole

I was trying to create a database from NCBI Nucleotide bank. I did a query which gave me 1124 results. From each single result I was wanting to obtain only the items realted to Accesion Country and ...
0
votes
0answers
13 views

Home automation dialogues

Is there an available dataset from home automation conversational agent vendors such as Amazon-Alexa or Google Home. I want a dataset where there are dialogues and knowledge bases of IoT devices ...
0
votes
1answer
20 views

HTTP Response Codes

For a data visualization, I'm looking for http response codes. There are many sources of this dataset, but I'm looking for machine readable (JSON preferred) reliably updated (so that my dataviz is ...
1
vote
1answer
34 views

Capacity/attendance information for US event venues

Can you think of a source for data regarding the capacity (number of seats or people that can fit in the venue) of different venues in the US, ideally large urban centers like NYC, LA, Chicago etc? ...
0
votes
0answers
6 views

automobile accident dataset with car make and year [duplicate]

I am looking for a free dataset that shows accidents with car make and year sold/in use in any country.
0
votes
0answers
17 views

Movie plots and reviews dataset

Is there any dataset with movie plots and reviews (not only rating)? I have had a look at the existing dataset, but they contain only one of the two (i.e. only plots or only reviews). I would be ...
1
vote
0answers
18 views

Dataset for English word trigrams

Does anyone know where to find such a dataset? There is Google's Ngram viewer but it is too big to be useful. I'm looking for something smaller. Perhaps with only the 100k most common English words ...
0
votes
0answers
25 views

List of the banks worldwide

Could you guys help me to find a dataset with a list of the banks worldwide (or list of European banks at least). Doesn't matter which format it will be (JSON, XML, SQL). The main problem: I need a ...
2
votes
1answer
59 views

SWIFT routing codes for all global banks

Does anyone know if it's possible to get SWIFT routing codes for all banks, or only on a per-country basis? (this came up in my Twitter feed - I thought it was a good question and I didn't find any ...
5
votes
1answer
460 views

A data set for click through rate

I'm particularly looking for the dataset in the article Predicting Clicks: Estimating the Click-Through Rate for New Ads Does anyone know if this data set is available? (Note: I checked all the ...
10
votes
3answers
5k views

Is there a source for various Scrabble dictionaries?

There are some individually maintained lists for some Scrabble dictionaries, and some websites for looking up words in those dictionaries: SOWPODS list: https://raw.github.com/jmlewis/valett/master/...
0
votes
0answers
20 views

Plant Disease Detection - Machine Learning

Does anyone knows a good dataset used to detect disease in plants? I'm using PlantVillage but it seems that the pictures are laboratorial and because of that can't be used in a real situation. Thanks ...
0
votes
0answers
4 views

HTTP/1.1 503 Service Unavailable

I am getting the 503 Service Unavailable error. Is the plan finder website down? Is there a problem with my API key?
0
votes
0answers
6 views

Where can I buy/find the digital surface model of Berlin at 50cm resolution?

I would like to find/buy the digital surface model (DSM) of Berlin at 50 cm resolution. Where can I find/buy it? Most of the open data of 3D mapping of Berlin are worse than 50 cm. I've been searching ...
0
votes
1answer
263 views

mimic iii: could a pretrained word2vec be made available?

Why reinvent the wheel? or would this be some sort of a breach since it would then be available to those who have not taken the ethics course?
2
votes
1answer
82 views

Where can I find (free) historical tick-by-tick data for crypto currencies?

I have found out how to get historical price data from the cryptocompare API but the highest resolution is on a minute-base. Is there a (free) way to get historical tick-by-tick data (so on a second-...
10
votes
4answers
6k views

Paraphrase data sets

I am looking for paraphrase data sets. I am aware of the following: PPDB: The Paraphrase Database (Ganitkevitch, Juri, Benjamin Van Durme, and Chris Callison-Burch. "PPDB: The Paraphrase Database." ...
2
votes
1answer
83 views

Soccer league and team hierarchical metadata

I'm looking for hierarchical metadata for soccer leagues and teams. I'm looking for any region or country (although Switzerland would be the first choice). There are many league or association website,...
0
votes
0answers
15 views

CKAN : ValueError: VDM only works with SQLAlchemy versions 0.4 through 0.9, not: 1.1.2

Do I need to upgrade the package vdm to make it compatible with sqlalchemy version greater then 0.9? This is a CKAN question.
0
votes
0answers
13 views

Distribution of number of years lived with cancer for each cancer type

Is it possible to view, for each cancer type, a histogram displaying number y of cancer patients that lived x years with the cancer? Where can I find such a graph? Thanks.
0
votes
0answers
5 views

Histogram for first onset development of cancer among the population

Is there a histogram which shows, for the entire population, the age at which cancer was developed on the x axis and the number of people affected by such cancer first developed at age x on the y axis,...
4
votes
1answer
42 views

Open dataset with historical plates/slides from astronomical surveys (absorption or emission spectra)?

The article 1917 astronomical plate has first-ever evidence of exoplanetary system inspired my inquiry, as the question has been on my mind for years: Where can I find star charts/plates from days ...
0
votes
0answers
6 views

Can I use an FTP or SFTP Client to access the monthly TAA petition data

I'm writing an automated script to download the Excel file (below) provided monthly by doteta.gov. Is this file available on an SFTP server so I can SFTP the file? If so, what is the SFTP host and ...
1
vote
1answer
387 views

Australian Vehicle or Car Brands, Models, Styles, and Specs API

I need to show Car Models and Specs on my Website. Similar to carsales.com.au search form. Does any one know an API to get these data? There's a lot of US APIs but no Australian APIs at all. There is ...
3
votes
3answers
42 views

How to download an online ArcGIS Feature Layer without an ArcGIS license?

On ArcGIS.com, there are many thousands of vector layers available as "Feature Layers." For example, Active_Volcanos_WFS. Access to Feature Layer is provided in the following ways: View it online in ...
0
votes
0answers
7 views

Dataset form 5500

I am curious if the form 5500 is included in any current datasets or will be included in the near future. I certainly have a workaround for this, but an API call to the dataset would be much more ...
9
votes
2answers
390 views

Human name country wise corpus

Where I can get the human name corpus country-wise, so that I can use it for training my neural network for detecting the human names out of the string. Does anyone have idea of this?
0
votes
0answers
6 views

Need A Database for tumor growth [duplicate]

For a school database, I need to find data for the tumor size of patients over time, does anyone know where I can get this?
0
votes
1answer
36 views

Data Flows from USAID Projects to Missions to Agency Level

Where can I find information about how data flows from individual USAID-funded projects (typically implemented by contractors) to the USAID Missions and ultimately to Agency-level databases and ...
1
vote
0answers
23 views

Wikidata SPARQL How to speed up this query?

I have come to this query, which retrieves wikipedia and wikidata info from a wikipedia title: SELECT ?wikipediaId ?wikipediaTitle ?wikidataId ?desc ?imageUrl (GROUP_CONCAT(?instanceOfS; SEPARATOR=";"...
0
votes
1answer
22 views

Typical Weather Averages by Lon/Lat

I would like to build a local dataset of monthly averages for rainfall, sunshine hours, temperate (C/F) for all the major cities of the world. I have all the lon/lat's stored for all the cities I ...
0
votes
1answer
25 views

Download Table from PRR drug Research tool

I used the PRR drug research tool: https://openfda.shinyapps.io/RR_D/ When I select a drug name it lists me by default the top 50 drug event combinations with PRR & ROR values. In the R shiny ...
0
votes
1answer
22 views

Which data processes are applied on FAERS data

I am trying to understand if the FAERS data are processed in OpenFDA similarly to what is done in softwares (RxLogix, ORACLE, CVW), meaning: Have the FAERS data been checked for duplicates with ...
5
votes
1answer
99 views

Japanese gairaigo database

The Japanese language has many terms imported from foreign languages, for instance タワー (pronounced "tawaa") means (and comes from) Tower. I am looking for a database of such term and the original ...
0
votes
1answer
45 views

use cases and datasets for manufacturing industry

Sorry for such a question. I am new to machine learning. I have gone through some machine learning tutorials. I currently have a dataset from manufacturing sector which include sensor data, process ...

15 30 50 per page