18
California Polytechnic State University has a downloaded dataset on fatal accidents on the national highway system for the year 2007:
https://wiki.csc.calpoly.edu/datasets/wiki/HighwayAccidents
Data.Gov has a number of datasets on accident data by state:
https://explore.data.gov/catalog/raw?tags=crash
The NHTSA has summary statistics for 2012 on a state ...
15
Project DBpedia is a crowd-sourced community effort to extract structured information from Wikipedia.
Drugs and Chemicals infoboxes are available in structured form, already.
Check out
http://dbpedia.org/page/Rosiglitazone
15
The JHU dashboard you linked has their data available as CSV on Github:
https://github.com/CSSEGISandData/COVID-19/tree/master/csse_covid_19_data
in particular these CSV files, which contain all historical timeseries
https://github.com/CSSEGISandData/COVID-19/tree/master/csse_covid_19_data/csse_covid_19_time_series
Here is a coincidental Python3 scraper ...
11
Try the Demographic and Health Survey (DHS). They have what you are looking for, for a large set of countries. On top of that you will in part be able to identify family ties, and you can even get access to geo-coded data. The data has answers to an extensive questionnaire.
You have to "apply" to get the data. But that is just a formality -- even ...
10
Wikipedia offers two interesting ways to get its own information:
Complete database dumps in XML and SQL, as you wish.
Special export very nice XML files downloadabe from only the categories that you specify.
Images and uploaded files are stored elsewhere, also downloadable
This is a XML file from the page requested using special export, the Wikipedia ...
10
It sounds like you're looking for a line listing. There are no case data available for this outbreak, but like Skram said, I collect and maintain data from various sources on github. Sierra Leone and Liberia release some case data on the province/county level; Liberia's data is quite good. The WHO used to include town names for Guinea, but it has since ...
9
The data referenced appears to be an aggregation of Hospital Acquired Infections which are part of the CMS Hospital Compare family of data sets.
The various measures included in the dataset are listed at http://www.medicare.gov/hospitalcompare/Data/Measures-Displayed.html
There are a number of ways to access the raw data which are listed at http://www....
9
A few thoughts:
For a simple and down to the point description, Brian's suggestion of MedlinePlus' Web Services is a good start however if you do a search such as http://wsearch.nlm.nih.gov/ws/query?db=healthTopics&term=Levodopa you'll notice that it returns generic information about Parkinkson's disease and not this more appropriate page at http://www....
9
Okay, this is a very specific dataset for the !Kung San people, but it has height, weight, sex, and age fields. Reference was found in McElreath:
"The data contained in data (Howell1) are partial census data for
the Dobe area !Kung San, compiled from interviews conducted by Nancy
Howell in the late 1960s."
McElreath's github repository houses Howell1 ...
9
Index of Countries (community wiki)
Global
Johns Hopkins University
WHO
ECDC
OurWorldInData
Worlddata.AI
Europe
Belgium
Germany and another Germany
Switzerland
Spain
Italy
United Kingdom
United Kingdom Overall
Country, Region and Local Authority
North America
United States
NY Times county level
CDC
Asia
General
China
Oceania
Australia
New ...
9
We started a worldwide crowdsourcing data collection on policy measures, including lockdowns at the admin1 level (region) and the country level. Currently we coded data for ~13 countries and are continously expanding. You can access the data here:
Collaborative Google Sheets on Policy Measures Against Covid19.
These data are free to use for anybody. We rely ...
8
Not sure if my list is better (or worse), because I think it has a lot to do with Andrew's question about national/state levels. If Andrew says it's cool, I'll just have him update his answer with these links:
NCSA Publications & Data Requests
http://www-nrd.nhtsa.dot.gov/Cats/index.aspx
you probably want this guy:
http://www-nrd.nhtsa.dot.gov/Cats/...
8
Extracting data from Wikipedia infoboxes will not be necessary anymore in the not-too-distant future: The people at Wikipedia are currently working on a new project called Wikidata.
Wikidata is a free knowledge base that can be read and edited by humans and machines alike. It is for data what Wikimedia Commons is for media files: it centralizes access to ...
8
CDC's National Health Interview Survey (HIS) provides public use files containing person-level data including demographic data and physical parameters such as weight, and disability. Dating back to 1957, it is an annual survey of a nationally representative sample dates.
CDC's National Health And Nutritional Examination Survey (NHANES) provides public use ...
8
Let's try to follow the sources one by one:
Trust for America's Health has obesity ranks (sense probably inverted compared to the graphic) and the proportion (%) of obese people per state, directly linked from their homepage.
U.S. Census American Community Survey should have this data. They have per-state transport mode usage statistics.
Streetsblog is both ...
8
Did you try the World Health Organization?
http://www.who.int/csr/don/en/
Looks like July 1, 2014 is when they started providing the chart data. The data gets updated every few days.
8
Also take a look at https://github.com/cmrivers/ebola . Caitlin Rivers (@cmyeaton on Twitter) is a PhD student in computational epidemiology and is curating this data from a number of sources.
8
The NIH has published the UMLS database, which consists of more than 7 million concepts, diseases and symptoms. It's a very wealthy resource. The license is pretty permissive if you are working in the United States. Check it out on the UMLS website. It's completely free and curated by the National Library of Medicine.
8
The Italian data from the Civil Protection Agency is updated daily at
https://github.com/pcm-dpc/COVID-19
There are a few data sets (CSV) in there. Aggregated data is published at http://opendatadpc.maps.arcgis.com/apps/opsdashboard/index.html#/b0c68bce2cce478eaac82fe38d4138b1
7
As noted, there is no official public version of the file, because at this time the NTIS only provides it to subscribers.
As for parsing the file, I made a schema compatible with csvkit's in2csv utility. The schema can be downloaded from https://github.com/JoeGermuska/ffs/blob/master/us/ssa/death_master_file.csv
Once you've installed csvkit and downloaded ...
7
Update: In response to your updated question about EAV, some of the datasets below may prove helpful. If you're looking for fairly large datasets where information in certain categories is relatively sparse, the BRFSS data may prove helpful. Otherwise, the other datasets may or may not serve your purpose.
I've used the data from the CDC's Behavioral Risk ...
7
Your question is so general it's hard to be sure I'm answering it correctly. More detail would be quite helpful. Here's a stab, though:
If you're looking for datasets that are already open and are fairly standard social science data, I would look at what ICPSR holds. They have several datasets, in particular this one, contributed by Jens Ludwig at UChicago.
...
7
1) i2b2 2006 Deidentification and Smoking Challenge's data set:
NLP Data Set #1B: 889 de-identified discharge summaries with
de-identification challenge annotations, training and test sets and
ground truth.
Please cite as:
Uzuner Ö., Juo Y, Szolovits P. "Evaluating the state-of-the-art in
automatic de-identification". J Am Med Inform ...
7
At this point Wikipedia will have most of the information but not yet machine readable. For a broad data-request on global lockdowns of varying degree, and for an ongoing event, I can't image a machine readable dataset yet.
https://en.wikipedia.org/wiki/2019%E2%80%9320_coronavirus_pandemic
One example would be using school closures, for which there is a ...
6
Not sure if you need something for the entire nation, but a lot of localities publish versions of this kind of data.
Two examples:
http://www.state.nj.us/transportation/refdata/accident/rawdata01-03.shtm
http://nypd.openscrape.com/#/
Good luck!
6
Here is CGM data from a 14 year-old Type I diabetic.
Data Includes Datetime Stamp, ISIG, and Glucose level.
6
WHO and the CDC get their data directly from the effected countries ministry of health.
These countries are:
Liberia http://www.mohsw.gov.lr/content_display.php?press_id=94&sub=press_release
Lastest Report - http://mohsw.gov.lr/documents/Liberia%20Ebola%20SitRep%2089%20Aug%2012,%202014.pdf
Sierra Leone http://health.gov.sl/?page_id=583
Latest Report - ...
6
There is no one source that I know of for realtime wait times though some larger networks do have apps or mobile sites that you might look into scraping though of course that has many disadvantages.
In terms of historical data, ProPublica has some great data and analysis at https://projects.propublica.org/emergency/
I believe the sole source of the ...
6
NPR has been developing a crowdsourced database of accessible playgrounds in the US. The data is downloadable as CSV or JSON. The license for the data isn't clearly stated, but the language suggests that they want it to be freely used.
6
Here is a set of individual weights and heights for 25,000 children in Hong Kong. There is no age or gender information, though, which does limit its usefulness.
From the same site, there is a table of heights, weights and ages for 1035 baseball players, which is a highly unrepresentative sample of the general population, but possibly interesting?
There ...
Only top voted, non community-wiki answers of a minimum length are eligible
