Questions tagged [releasing-data]
For questions related to making data available for others to use.
140
questions
0
votes
0
answers
7
views
Competitions and incentives for open source data
There are websites such as Kaggle that people compete to best analyse open source datasets, but are there any websites or organisations where people compete or are incentivised to create open source ...
1
vote
0
answers
25
views
Hydroponic dataset
I have the intention of performing a machine learning project on hydroponic culture. The real problem is that it seems that there is not a public dataset available for this purpose.
I'm particularly ...
0
votes
0
answers
20
views
How to expose open data?
Sorry for the long and complex question.
Searching for open data I often find multiple format, not normalized data, or dataset where data is difficult to correlate with other dataset.
I know, there ...
0
votes
0
answers
7
views
ISO (In search of) New Jersey Parcel data with Ownership Info
Do to a pesky law in NJ, all ownership data has been redacted from publicly available tax records and parcel data. Does anyone know a source where this data is still intact, or possibly a table that I ...
0
votes
0
answers
23
views
Wind Speed and Direction Datasets
I am trying to find historical (e.g., one year) wind speed and wind direction datasets for different suburbs in Sydney/Greater Sydney in CSV format. I tried different platforms for it but could not ...
0
votes
1
answer
41
views
How to get a computer-parseable (JSON preferably) feed of all new video game releases?
MobyGames has a "begware" API where you have to contact them and ask for access.
GameFAQs actively blocks scraper bots and appear to have no API whatsoever, and if they do, they probably ...
1
vote
1
answer
60
views
Linking to Supplemental Material on arXiv (empirical data, code, etc)
In Dec'20 the open access pre-print service, arXiv, introduced the ability to include a link to code in the metadata for a preprint. Certainly a step in the right direction. However, with a little ...
1
vote
0
answers
25
views
Is the SUBJECT_ID filed in the dataset the same as the PRODUCT_ID?
Is the SUBJECT_ID filed in the dataset same as the PRODUCT_ID as noted in downloadable datasheets at
http://www.trustlet.org/extended_epinions.html
1
vote
0
answers
17
views
Preserving user-privacy whilst enabling strangers to perform data analysis on some form of private data
Context
This question is about the intent to analyse taskwarrior data of people to improve automatic schedulers of tasks for individual taskwarrior users. This intend is accompanied with two desires. ...
1
vote
1
answer
42
views
FAERS Quarterly Extracts and openFDA
Does anyone know, on average, how long it takes for openFDA to be updated once the quarterly extracts are released? Is there a way to track this? TIA
7
votes
1
answer
80
views
Can I aggregate and reformat publicly available data for teaching?
I work and teach in a field where public data is scarce (anatomical MRI processing). I planned to organize a few practical works for students this semester. I had a pretty hard time gathering publicly ...
0
votes
1
answer
61
views
How can I get daily web traffic data for years in a website
Recently I'm doing some research on holiday effect's on web traffic data and trying to predict it more precisely using data in previous year. I need to get daily or hourly web traffic data in a ...
1
vote
0
answers
16
views
What are the public biosignals (ECG, etc) or imaging datasets of COVID-19 patients?
I am looking for public datasets of COVID-19 patients with biosignal information (ECG, for instance) and/or imaging data (X-ray, CT scans). Found some CT scan datasets but with a low number of cases (~...
2
votes
1
answer
95
views
Datasets for Fake news (Not Tweets and Facebook Posts)
Can you please tell me where can I find good pre-labeled datasets with real and fake news, but not tweets and facebook posts?
I found 4-5 on Kaggle, but I read that those are not real news (those ...
3
votes
2
answers
81
views
What is an effective way to share many geojsons that are a timeseries?
I currently have a long-running scrape that collects geojson data for Zürich bike-sharing. Each file is appended with a timestamp of when it was collected. The file structure doesn't change.
What's ...
1
vote
0
answers
24
views
Where and how can I get dataset of patient narratives on the internet to predict diseases?
My aim is to create a trained model for predicting diseases. I need data set consisting of the following fields:
Causes of the Disease
Pathogenesis (the mechanism by which the disease progresses)
Age
...
2
votes
1
answer
52
views
Why doesn't my government, and governments in general, provide useful statistics in digital format?
I live in Sweden, but this applies to all other countries as well.
I have a general interest in, and fascination of, statistics and working with data in databases. By far the biggest obstacle has ...
1
vote
0
answers
22
views
Csv format easy colums characteristic - type dataset for beginner R analisys
I had a look on kaggle but I did not find what I was looking for. I need a very simple data set, like the one of "iris" default pre-sets of R where you have differents columns with some characteristic ...
2
votes
1
answer
60
views
Can I put open source data on a public github repo?
I am using open-source data for a data sonification project and would like to put the data used for this project onto a public Github repo. Are there any legal issues with doing this? I am assuming ...
1
vote
1
answer
62
views
Open Source Data Visualization Schema
I want to capture the data needed to create a visualization (data, series names, titles etc.) in a way that is not tied to my end charting library. The goal being that I could capture the charting ...
3
votes
2
answers
210
views
Where can I upload a large image dataset?
I am applying for a grant, and one of the tasks we are seeking funding for is to make a large image database publicly available for users to train artificial intelligence (convolutional neural network)...
3
votes
1
answer
56
views
Website to clearly explain "why open data" to non-governmental stakeholders
I haven't found a clear website that I could share with non-profit organizations or companies, about how their opening of data can be used by the community for transparency, marketing, good PR, ...
4
votes
2
answers
63
views
Are version control storing solutions a good option to store Medical Imaging open data?
We are working on several medical imaging projects (i.e., BreastScreening, MIDA, and MIMBCD-UI) that deals with a huge amount of data. From medical images and data at the following modalities: (1) ...
1
vote
1
answer
32
views
Redistribute tweets without user id or tweet id
I have a dataset of tweets annotated by a group of people and I want to distribute it in Github without the user id or Tweet id, do you know if that possible?
only the tweet_text and the label.
Given ...
1
vote
2
answers
61
views
Is there a free publicly-accessible repository to store datasets derived from experiments?
I had obtained some results based on sensor data obtained from experiments that I had conducted.
In the interest of allowing others to reproduce or improve on my work, is there a way to make this ...
1
vote
0
answers
79
views
OpenFDA End Point Updates
With respect to the US Food and Drug Administration's API, I haven't seen the endpoints updated since 8/12/19. Did something change or is this common? I've noticed the endpoints refreshed fairly ...
0
votes
1
answer
18
views
Availability of PGx Biomarker data for drug labels?
Is the Pharmacogenomic Biomarkers in Drug Labeling available through the OpenFDA system?
If not, are there any plans to make this data available? Seems like this would be an easy thing to model and ...
2
votes
2
answers
227
views
How do I get my data indexed by Google Dataset Search?
Google now offers Dataset Search (beta)
https://toolbox.google.com/datasetsearch
Dataset Search enables users to find datasets stored across the Web through a simple keyword search. The tool ...
2
votes
1
answer
565
views
where can i find product packaging information data?
where can i find the dataset about world products packaging components information? For example, the packaging of coke-cola is label, plastic bottle and plastic cap. where can i find such information ...
1
vote
1
answer
36
views
Adword or web traffic dataset
looking for a website traffic analysis dataset for the project ASAP. can you direct me to any resources to download free datasets of such kind?
1
vote
0
answers
14
views
Sources of funding to curate exisiting datasets?
At my institution (a large land-grant US University), there are some long term research programs that would be of great value to the scientific community if the data were curated and published in an ...
1
vote
0
answers
8
views
Hi, does anyone know if the FDA has released ANDA submission dates?
I know the ANDA sometimes will comment on changes in ANDA review time, however the Orange book only provides the approval date and not the submission date.
Does anyone know either where the ...
0
votes
1
answer
242
views
Is there a historic drug shortage database?
I was wondering if there was a historic database of drug shortage data?
The current database (link below) appears to only reflect any shortages that have been resolved in 2017 but does not include ...
3
votes
2
answers
110
views
How to link a new dataset to an existing dataset?
I have to construct a dataset of hospitals.
For each hospital, I will indicate the the town/region in which it is located.
I already have dataset of towns/regions of the concerned geographic area.
...
3
votes
0
answers
17
views
Iraq IDP/Refugee Camps
Where can I find an updated data set on refugee and internally displaced camps in Iraq? UN OCHA has one from 2014, but it's too old. REACH has one but it holds no geographic information.
I'm working ...
1
vote
1
answer
121
views
Countryside Stewardship Water Quality Priority Areas (England)
I'm trying to acquire the 'Countryside Stewardship Water Quality Priority Areas (England)' which can be viewed here under Countryside Stewardship Targeting & Scoring Layers> Water (also shown ...
2
votes
1
answer
67
views
Are "protocols" to usgov open data also available?
The U.S. gov creates and makes available a lot of open data on various topics, but the one that I am interested in is new legislation.
Let's say that there is an open data source for new laws (which ...
13
votes
7
answers
5k
views
How can I reliably host and share large data sets?
Relevant to this answer, I discovered that datahub.io has a 100MB limit on file uploads. I was disappointed to learn this, and it tooks many server errors to realize I should read the FAQ, where I ...
3
votes
1
answer
181
views
NEISS injury dataset - machine readable and decoded
The National Electronic Injury Surveillance System (NEISS) database offers both a query tool and bulk CSV downloads at maximum one calendar year. The available data dates back to 1991.
Patient ...
1
vote
2
answers
125
views
Types of license for OpenData
In order to release the data as open it should come with a license. In the open world, there are differente licenses for different purposes (GPL, MIT, BSD licenses for Software - OpenSource; Creative ...
2
votes
1
answer
669
views
Looking for historical data on NBA player-specific salaries and other contract information
I would like to find data that describe every player contract in the NBA, as far back into the past as possible. Optimally, this would include salary, term of contract, player agency, etc.
I search ...
3
votes
0
answers
137
views
Bacterial infectious diseases dataset
Does anyone know of a dataset relating:
bacteria (not viruses or fungi)
infectiousness
symptoms
...or something of the sort?
I'm looking to classify infectiousness (ie. infectious/not infectious) ...
2
votes
1
answer
31
views
Can anyone use this Journalism tool on UK Public Bodies?
Are you looking for information on public bodies: especially links to their website and FOI request on "what do they know"?
3
votes
1
answer
128
views
Are there any public agencies which are currently streaming real-time video data?
I'm engaged in a discussion with the network security department at a public agency with the goal of making their live video data publicly available on the Internet; currently the data never leaves ...
2
votes
0
answers
22
views
Seeking spatialized Employment Information for England?
I was looking for a shapefile with employment opportunities (jobs) for England or London – at the LSOA or output level. Im not sure is this is what they call Workplace population.
Is this it?
Do ...
6
votes
2
answers
128
views
Open data quality frameworks
I'm looking for some kind of lightweight framework for assessing the quality of datasets, as a publisher. The most widely known one is Tim Berners-Lee's "5 star open data", but it's actually not very ...
4
votes
1
answer
254
views
Publishing (structured?) data about products: information about products, barcodes, photos (incl. packaging)
Is it legal to publish photos of products and their packaging?
Can such be done anonymously on some open license? (which would be the best for such data to be open for public use, as products are ...
2
votes
1
answer
168
views
Collegescorecard - individual-level anonymized data
Where does the individual-level anonymized data for the collegescorecard live? For obvious reasons, this would be more valuable to researchers than the summary data.
I don't see any access to it from ...
1
vote
0
answers
123
views
Where can I find average GPA data by graduate year and college, and ideally by major too?
I'm looking for a data source of average GPA results from each college in the US by graduate year. In an ideal world, an additional level of granularity would by by graduate major for a given college?
...
4
votes
1
answer
449
views
Is there a dataset having multiple files and multiple data formats (JSON+CSV+XML) for research purpose etc.?
I have been working on data science problems with one format(JSON or CSV).I am planning to explore datasets with multiple data formats. Any links to such datasets would be helpful.
For example:
1) ...