Questions tagged [releasing-data]
For questions related to making data available for others to use.
134
questions
1
vote
1answer
24 views
Linking to Supplemental Material on arXiv (empirical data, code, etc)
In Dec'20 the open access pre-print service, arXiv, introduced the ability to include a link to code in the metadata for a preprint. Certainly a step in the right direction. However, with a little ...
1
vote
0answers
22 views
Is the SUBJECT_ID filed in the dataset the same as the PRODUCT_ID?
Is the SUBJECT_ID filed in the dataset same as the PRODUCT_ID as noted in downloadable datasheets at
http://www.trustlet.org/extended_epinions.html
1
vote
0answers
13 views
Preserving user-privacy whilst enabling strangers to perform data analysis on some form of private data
Context
This question is about the intent to analyse taskwarrior data of people to improve automatic schedulers of tasks for individual taskwarrior users. This intend is accompanied with two desires. ...
1
vote
1answer
30 views
FAERS Quarterly Extracts and openFDA
Does anyone know, on average, how long it takes for openFDA to be updated once the quarterly extracts are released? Is there a way to track this? TIA
7
votes
1answer
57 views
Can I aggregate and reformat publicly available data for teaching?
I work and teach in a field where public data is scarce (anatomical MRI processing). I planned to organize a few practical works for students this semester. I had a pretty hard time gathering publicly ...
0
votes
1answer
43 views
How can I get daily web traffic data for years in a website
Recently I'm doing some research on holiday effect's on web traffic data and trying to predict it more precisely using data in previous year. I need to get daily or hourly web traffic data in a ...
1
vote
0answers
10 views
What are the public biosignals (ECG, etc) or imaging datasets of COVID-19 patients?
I am looking for public datasets of COVID-19 patients with biosignal information (ECG, for instance) and/or imaging data (X-ray, CT scans). Found some CT scan datasets but with a low number of cases (~...
2
votes
1answer
76 views
Datasets for Fake news (Not Tweets and Facebook Posts)
Can you please tell me where can I find good pre-labeled datasets with real and fake news, but not tweets and facebook posts?
I found 4-5 on Kaggle, but I read that those are not real news (those ...
3
votes
2answers
79 views
What is an effective way to share many geojsons that are a timeseries?
I currently have a long-running scrape that collects geojson data for Zürich bike-sharing. Each file is appended with a timestamp of when it was collected. The file structure doesn't change.
What's ...
1
vote
0answers
21 views
Where and how can I get dataset of patient narratives on the internet to predict diseases?
My aim is to create a trained model for predicting diseases. I need data set consisting of the following fields:
Causes of the Disease
Pathogenesis (the mechanism by which the disease progresses)
Age
...
2
votes
1answer
43 views
Why doesn't my government, and governments in general, provide useful statistics in digital format?
I live in Sweden, but this applies to all other countries as well.
I have a general interest in, and fascination of, statistics and working with data in databases. By far the biggest obstacle has ...
1
vote
0answers
19 views
Csv format easy colums characteristic - type dataset for beginner R analisys
I had a look on kaggle but I did not find what I was looking for. I need a very simple data set, like the one of "iris" default pre-sets of R where you have differents columns with some characteristic ...
2
votes
1answer
50 views
Can I put open source data on a public github repo?
I am using open-source data for a data sonification project and would like to put the data used for this project onto a public Github repo. Are there any legal issues with doing this? I am assuming ...
1
vote
1answer
43 views
Open Source Data Visualization Schema
I want to capture the data needed to create a visualization (data, series names, titles etc.) in a way that is not tied to my end charting library. The goal being that I could capture the charting ...
3
votes
2answers
76 views
Where can I upload a large image dataset?
I am applying for a grant, and one of the tasks we are seeking funding for is to make a large image database publicly available for users to train artificial intelligence (convolutional neural network)...
3
votes
1answer
53 views
Website to clearly explain “why open data” to non-governmental stakeholders
I haven't found a clear website that I could share with non-profit organizations or companies, about how their opening of data can be used by the community for transparency, marketing, good PR, ...
4
votes
2answers
58 views
Are version control storing solutions a good option to store Medical Imaging open data?
We are working on several medical imaging projects (i.e., BreastScreening, MIDA, and MIMBCD-UI) that deals with a huge amount of data. From medical images and data at the following modalities: (1) ...
1
vote
1answer
29 views
Redistribute tweets without user id or tweet id
I have a dataset of tweets annotated by a group of people and I want to distribute it in Github without the user id or Tweet id, do you know if that possible?
only the tweet_text and the label.
Given ...
1
vote
2answers
46 views
Is there a free publicly-accessible repository to store datasets derived from experiments?
I had obtained some results based on sensor data obtained from experiments that I had conducted.
In the interest of allowing others to reproduce or improve on my work, is there a way to make this ...
1
vote
0answers
73 views
OpenFDA End Point Updates
With respect to the US Food and Drug Administration's API, I haven't seen the end points updated since 8/12/19. Did something change or is this common? I've noticed the end points refreshed fairly ...
0
votes
1answer
17 views
Availability of PGx Biomarker data for drug labels?
Is the Pharmacogenomic Biomarkers in Drug Labeling available through the OpenFDA system?
If not, are there any plans to make this data available? Seems like this would be an easy thing to model and ...
2
votes
2answers
185 views
How do I get my data indexed by Google Dataset Search?
Google now offers Dataset Search (beta)
https://toolbox.google.com/datasetsearch
Dataset Search enables users to find datasets stored across the Web through a simple keyword search. The tool ...
2
votes
1answer
353 views
where can i find product packaging information data?
where can i find the dataset about world products packaging components information? For example, the packaging of coke-cola is label, plastic bottle and plastic cap. where can i find such information ...
1
vote
1answer
33 views
Adword or web traffic dataset
looking for a website traffic analysis dataset for the project ASAP. can you direct me to any resources to download free datasets of such kind?
1
vote
0answers
14 views
Sources of funding to curate exisiting datasets?
At my institution (a large land-grant US University), there are some long term research programs that would be of great value to the scientific community if the data were curated and published in an ...
1
vote
0answers
8 views
Hi, does anyone know if the FDA has released ANDA submission dates?
I know the ANDA sometimes will comment on changes in ANDA review time, however the Orange book only provides the approval date and not the submission date.
Does anyone know either where the ...
0
votes
1answer
208 views
Is there a historic drug shortage database?
I was wondering if there was a historic database of drug shortage data?
The current database (link below) appears to only reflect any shortages that have been resolved in 2017 but does not include ...
3
votes
2answers
103 views
How to link a new dataset to an existing dataset?
I have to construct a dataset of hospitals.
For each hospital, I will indicate the the town/region in which it is located.
I already have dataset of towns/regions of the concerned geographic area.
...
3
votes
0answers
17 views
Iraq IDP/Refugee Camps
Where can I find an updated data set on refugee and internally displaced camps in Iraq? UN OCHA has one from 2014, but it's too old. REACH has one but it holds no geographic information.
I'm working ...
1
vote
1answer
81 views
Countryside Stewardship Water Quality Priority Areas (England)
I'm trying to acquire the 'Countryside Stewardship Water Quality Priority Areas (England)' which can be viewed here under Countryside Stewardship Targeting & Scoring Layers> Water (also shown ...
2
votes
1answer
55 views
Are “protocols” to usgov open data also available?
The U.S. gov creates and makes available a lot of open data on various topics, but the one that I am interested in is new legislation.
Let's say that there is an open data source for new laws (which ...
12
votes
6answers
4k views
How can I reliably host and share large data sets?
Relevant to this answer, I discovered that datahub.io has a 100MB limit on file uploads. I was disappointed to learn this, and it tooks many server errors to realize I should read the FAQ, where I ...
3
votes
1answer
144 views
NEISS injury dataset - machine readable and decoded
The National Electronic Injury Surveillance System (NEISS) database offers both a query tool and bulk CSV downloads at maximum one calendar year. The available data dates back to 1991.
Patient ...
1
vote
2answers
92 views
Types of license for OpenData
In order to release the data as open it should come with a license. In the open world, there are differente licenses for different purposes (GPL, MIT, BSD licenses for Software - OpenSource; Creative ...
2
votes
1answer
590 views
Looking for historical data on NBA player-specific salaries and other contract information
I would like to find data that describe every player contract in the NBA, as far back into the past as possible. Optimally, this would include salary, term of contract, player agency, etc.
I search ...
3
votes
0answers
132 views
Bacterial infectious diseases dataset
Does anyone know of a dataset relating:
bacteria (not viruses or fungi)
infectiousness
symptoms
...or something of the sort?
I'm looking to classify infectiousness (ie. infectious/not infectious) ...
2
votes
1answer
31 views
Can anyone use this Journalism tool on UK Public Bodies?
Are you looking for information on public bodies: especially links to their website and FOI request on "what do they know"?
3
votes
1answer
121 views
Are there any public agencies which are currently streaming real-time video data?
I'm engaged in a discussion with the network security department at a public agency with the goal of making their live video data publicly available on the Internet; currently the data never leaves ...
2
votes
0answers
22 views
Seeking spatialized Employment Information for England?
I was looking for a shapefile with employment opportunities (jobs) for England or London – at the LSOA or output level. Im not sure is this is what they call Workplace population.
Is this it?
Do ...
6
votes
2answers
125 views
Open data quality frameworks
I'm looking for some kind of lightweight framework for assessing the quality of datasets, as a publisher. The most widely known one is Tim Berners-Lee's "5 star open data", but it's actually not very ...
4
votes
1answer
202 views
Publishing (structured?) data about products: information about products, barcodes, photos (incl. packaging)
Is it legal to publish photos of products and their packaging?
Can such be done anonymously on some open license? (which would be the best for such data to be open for public use, as products are ...
2
votes
1answer
166 views
Collegescorecard - individual-level anonymized data
Where does the individual-level anonymized data for the collegescorecard live? For obvious reasons, this would be more valuable to researchers than the summary data.
I don't see any access to it from ...
1
vote
0answers
115 views
Where can I find average GPA data by graduate year and college, and ideally by major too?
I'm looking for a data source of average GPA results from each college in the US by graduate year. In an ideal world, an additional level of granularity would by by graduate major for a given college?
...
4
votes
1answer
319 views
Is there a dataset having multiple files and multiple data formats (JSON+CSV+XML) for research purpose etc.?
I have been working on data science problems with one format(JSON or CSV).I am planning to explore datasets with multiple data formats. Any links to such datasets would be helpful.
For example:
1) ...
2
votes
3answers
3k views
Data set for Mcdonalds
Searching for any dataset on McDonald's Corporation; it doesn't necessarily have to be recent data. Any data on sales, employee, how they did during promotions, etc.
10
votes
2answers
231 views
What are the most common issues with data cleaning (e.g. outliers, duplicates)? Who has data sets that need to be prepared for analysis?
When preparing data for analysis, I often encountered issues such as outliers, data entries that are logically inconsistent (e.g. age=150/age=-2), duplicates (that are not exactly equal) etc. When ...
2
votes
1answer
75 views
Twitter - Labelling system for sentiments and other things
I have build a program that log tweets from stream by hashtag into a MongoDB database and a website to label them.
The website loads a random tweet and allows me to label them with three buttons (...
3
votes
2answers
365 views
what are the best ways to build / scrape an open-sourced data set of a retailer type (e.g. tobacco retailers?)
I'm a public health epidemiologist, and this question has come up in a number of contexts. I've heard tell of people using Google or Yelp for limited uses, but we'd be building state-wide datasets of ...
3
votes
0answers
56 views
Are there any examples or best practice for encapsulating large open data sets into R packages?
I've recently been experimenting with UK government open data with R, and it seems like I could usefully wrap up some of my work into an R package.
I'd want the package to download the data either ...
5
votes
2answers
70 views
Reliable point spatial data of cities of New Zealand
Can anyone refer to the reliable and freely available point location spatial data source of the cities of New Zealand.
N.B. I used several data source but found all of them are not accurate e.g. this ...
