Skip to main content
5 votes
Accepted

What does “lower status” mean in “Boston house prices dataset”?

From dataset documentation in Table IV of Harrison & Rubin (1978), LSTAT is defined as: Proportion of population that is lower status = 1/2 (proportion of adults without, some high school ...
sboysel's user avatar
  • 1,214
5 votes
Accepted

Average Monthly temperatures for cities around the world

If there is no well documented API for weatherbase.com, it might be interesting to scrape the information. Here is the list of cities the site contains with their URL. You can select some cities and ...
Ettore Rizza's user avatar
4 votes
Accepted

I get 'certificate verify failed' URLError when trying to download data from openFDA

I'm not sure what underlying HTTP packages pandas uses, but I found that the default settings of the requests package in python does not work with SSL and this site: import requests url = 'https://...
philshem's user avatar
  • 17.6k
3 votes
Accepted

to which extend we can use the data of healthsite.io - can we use maps etc. too?

Great question! The data license is the same as the ODbL of OpenStreetMap. ## ODC Open Database License (ODbL) Preamble The Open Database License (ODbL) is a license agreement intended to allow ...
mangamonk's user avatar
2 votes

Python crashing when trying to read zipped json files

For those who might get to this question and look for an answer, here is the link to my other post with the answer. https://stackoverflow.com/questions/40824807/reading-zipped-json-files
h.das's user avatar
  • 41
2 votes
Accepted

Access ECMWF Data via python script

I know this topic is six months old, but for reference: the ECMWF API is now supported on Windows. Please see here for details The OP created a file '.ecmwfapirc.txt'. This is wrong, it has to be ...
user7858's user avatar
2 votes

Access ECMWF Data via python script

You can create a UNIX environment from Windows by several ways. Cygwin is a Unix-like environment and command-line interface for Microsoft Windows. Cygwin provides native integration of Windows-...
philshem's user avatar
  • 17.6k
2 votes

Load NSF Research Award Abstracts in Python or R

This is one way of working with the dataset in Python 3.5. The code and document are available here: https://github.com/HamidehIraj/ReadNSF Import Libraries import re import os Loading Data indir ...
Hamideh's user avatar
  • 261
2 votes
Accepted

Lobby meetings of European Commission - Integrity Watch

With a hint from a person from Transparency International and some further browsing through the source code this link eventually made it work: http://static.tttp.eu/doi/data/meeting.csv
moezelot's user avatar
  • 153
2 votes

How do I get historical data from coinmarketcap.com?

Here's a quick python3 script to get the table from each html page as a local csv file. basically, you have to create a loop over all dates and then make a web requests. the python library pandas has ...
philshem's user avatar
  • 17.6k
2 votes

CKAN - ckanext-scheming - Add dataset button

You can override the template snippets/add_dataset.html if you just want to have multiple add buttons. Here is what you can do (tested on CKAN 2.8.3): {# Adds 'Add Dataset' button #} {% set ...
Francesco Frassinelli's user avatar
1 vote

Wikidata dump in another language

The dump files should contain all language content - Wikidata does not have different language editions and so there are no language-specific dumps. In general all items and properties exist in all ...
Andrew is gone's user avatar
1 vote
Accepted

augment/enrich latitude longitude data

I'm actually working on a project like this (feel free to contact me directly for more details) and here are some sources I know above and beyond OpenStreetMap: Coastal distance: https://oceancolor....
Barry Carter's user avatar
1 vote

Extracting data from OpenFDA using python to save it locally

It appears your best option would be to use the downloadable JSON files: https://open.fda.gov/data/downloads/
Denis Krylov's user avatar
1 vote
Accepted

How to Format API Requests to Loop through All Tracts in a County

This is the code that ended up working for me. Also, see https://api.census.gov/data/2017/acs/acs5/examples.html for a large list of formatting examples. import requests, pandas as pd year='2018' ...
ANimator120's user avatar
1 vote

How to Format API Requests to Loop through All Tracts in a County

To get the geography you want, you have to specify each level of the geographic hierarchy in which the tracts fit. state='37' county='187' &for=tracts:*&in=county:{county}&in=state:{...
fdonnelly's user avatar
  • 1,130
1 vote

Looking for Databases with gender of names and Ethnicity information

I think you can start with general source of knowledge nowadays, wikipedia, namely the article on List of popular given names . This will give you enough information to extrapolate from country to ...
chewpakabra's user avatar
1 vote

Is it possible to link drugs, with protein targets, using OpenFDA?

I'm Jack with the openFDA team. From my understanding, you have a list of target proteins and want to link it with drugs in one of the openFDA endpoints. As I see it, the problem you'll run into is ...
Violet Wren's user avatar
1 vote

Not able to view private datasets in CKAN using Nginx

Well done on this issue / question. It's more succinct than before and focuses more closely on 1 problem. I'll focus on your 3 issues together as they seem to be interrelated. You're right, I think ...
user3366016's user avatar
1 vote

Cannot get data from FPDS atom feed using pyfpds

I was actually using the wrong format for date. It should be something like this: records = c.get(agency_name=o['name'], last_modified_date="["+str(next_date)+","+str(next_date)+"]") or records = c....
libregeek's user avatar
  • 111
1 vote

KEEPA API Experience

I’m assuming you’re looking for something to make this api work easier, rather than resorting to hand coding. I would suggest Talend’s Data Services Platform. I think Talend is the best tool around; ...
Christopher Klaus's user avatar
1 vote

Dict not able to return data from college scorecard API

I am afraid I am not familiar with python, however, I notice that the variables in the API are formatted differently than what the API is expecting - for example, you have "city" defined in your dict, ...
brownpl's user avatar
  • 108
1 vote

I get 'certificate verify failed' URLError when trying to download data from openFDA

I would try to do a request of the data first. import requests json_df = pd.read_json(requests.get(url).json())
Hans Nelsen's user avatar
1 vote

Looking for open dataset containing data for disease and symptoms

There is an international coding system that lists and codes an enormous range of diseases/symptoms called ICD10. This is how Wikipedia describes it: ICD-10 is the 10th revision of the ...
matt_black's user avatar
1 vote

Querying CKAN in Python using ckanapi

For some reason, the above solution has not worked for me. I tried data.gov catalog and used the same code as below: import ckanapi ckan = ckanapi.RemoteCKAN('https://catalog.data.gov') search_params ...
soms's user avatar
  • 11

Only top scored, non community-wiki answers of a minimum length are eligible