8
votes
List of United States cities
The US Census Bureau also has a national gazeteer file with state and city info, including incorporation information.
For metadata/excel file column please have a look at HERE.
- 201
6
votes
Accepted
List of United States cities
I have a CSV file you can download that lists all US cities by state. The data was compiled from the US Census 2013 Gazetteer.
http://www.opengeocode.org/download.php#statecity
In case you must ...
- 8,647
5
votes
List of United States cities
You might try using data from the Geonames.org database. You can download gazateer data by country from this list.
Another potential source is the the MaxMind GeoLite2 dataset.
- 169
5
votes
Accepted
Average Monthly temperatures for cities around the world
If there is no well documented API for weatherbase.com, it might be interesting to scrape the information. Here is the list of cities the site contains with their URL. You can select some cities and ...
- 558
5
votes
Accepted
What does “lower status” mean in “Boston house prices dataset”?
From dataset documentation in Table IV of Harrison & Rubin (1978), LSTAT is defined as:
Proportion of population that is lower status = 1/2
(proportion of adults without, some high school ...
- 1,214
4
votes
Accepted
I get 'certificate verify failed' URLError when trying to download data from openFDA
I'm not sure what underlying HTTP packages pandas uses, but I found that the default settings of the requests package in python does not work with SSL and this site:
import requests
url = 'https://...
- 17.5k
4
votes
Historical Twitter Data
Unfortunately, the search index for searching tweets only goes back 7 days. Link to the documentation here, it can be found under 'until'.
You might be able to collect tweets from individual users' ...
- 301
4
votes
Datasets based on casual conversations for chatterbots
tl;dr - find and use AIML files
There is an open-source chat-box project called A.L.I.C.E.
Link to Demo
A.L.I.C.E. uses the AIML format
AIML (Artificial Intelligence Markup Language) is an XML-...
- 17.5k
3
votes
Accepted
to which extend we can use the data of healthsite.io - can we use maps etc. too?
Great question!
The data license is the same as the ODbL of OpenStreetMap.
## ODC Open Database License (ODbL)
Preamble
The Open Database License (ODbL) is a license agreement intended to
allow ...
- 46
2
votes
Python crashing when trying to read zipped json files
For those who might get to this question and look for an answer, here is the link to my other post with the answer.
https://stackoverflow.com/questions/40824807/reading-zipped-json-files
- 41
2
votes
Accepted
Access ECMWF Data via python script
I know this topic is six months old, but for reference:
the ECMWF API is now supported on Windows. Please see here for details
The OP created a file '.ecmwfapirc.txt'. This is wrong, it has to be ...
- 36
2
votes
Access ECMWF Data via python script
You can create a UNIX environment from Windows by several ways.
Cygwin
is a Unix-like environment and command-line interface for Microsoft Windows. Cygwin provides native integration of Windows-...
- 17.5k
2
votes
Load NSF Research Award Abstracts in Python or R
This is one way of working with the dataset in Python 3.5. The code and document are available here: https://github.com/HamidehIraj/ReadNSF
Import Libraries
import re
import os
Loading Data
indir ...
- 261
2
votes
Accepted
Lobby meetings of European Commission - Integrity Watch
With a hint from a person from Transparency International and some further browsing through the source code this link eventually made it work:
http://static.tttp.eu/doi/data/meeting.csv
- 153
2
votes
CKAN - ckanext-scheming - Add dataset button
You can override the template snippets/add_dataset.html if you just want to have multiple add buttons.
Here is what you can do (tested on CKAN 2.8.3):
{# Adds 'Add Dataset' button #}
{% set ...
2
votes
Scraping vehicle reporting data from regulator's website
Selenium is a good option to interact with the site and eventually get to the page where you can download/scrape the data you need. I've used the python (https://selenium-python.readthedocs.org/) ...
- 171
2
votes
How do I get historical data from coinmarketcap.com?
Here's a quick python3 script to get the table from each html page as a local csv file.
basically, you have to create a loop over all dates and then make a web requests. the python library pandas has ...
- 17.5k
1
vote
Accepted
How to Format API Requests to Loop through All Tracts in a County
This is the code that ended up working for me. Also, see https://api.census.gov/data/2017/acs/acs5/examples.html for a large list of formatting examples.
import requests, pandas as pd
year='2018'
...
- 143
1
vote
How to Format API Requests to Loop through All Tracts in a County
To get the geography you want, you have to specify each level of the geographic hierarchy in which the tracts fit.
state='37'
county='187'
&for=tracts:*&in=county:{county}&in=state:{...
- 1,120
1
vote
Is it possible to link drugs, with protein targets, using OpenFDA?
I'm Jack with the openFDA team. From my understanding, you have a list of target proteins and want to link it with drugs in one of the openFDA endpoints. As I see it, the problem you'll run into is ...
- 171
1
vote
Not able to view private datasets in CKAN using Nginx
Well done on this issue / question. It's more succinct than before and focuses more closely on 1 problem. I'll focus on your 3 issues together as they seem to be interrelated.
You're right, I think ...
- 111
1
vote
Cannot get data from FPDS atom feed using pyfpds
I was actually using the wrong format for date. It should be something like this:
records = c.get(agency_name=o['name'], last_modified_date="["+str(next_date)+","+str(next_date)+"]")
or
records = c....
- 111
1
vote
KEEPA API Experience
I’m assuming you’re looking for something to make this api work easier, rather than resorting to hand coding. I would suggest Talend’s Data Services Platform.
I think Talend is the best tool around; ...
1
vote
Dict not able to return data from college scorecard API
I am afraid I am not familiar with python, however, I notice that the variables in the API are formatted differently than what the API is expecting - for example, you have "city" defined in your dict, ...
- 108
1
vote
Looking for Databases with gender of names and Ethnicity information
I think you can start with general source of knowledge nowadays, wikipedia, namely the article on List of popular given names . This will give you enough information to extrapolate from country to ...
- 111
1
vote
I get 'certificate verify failed' URLError when trying to download data from openFDA
I would try to do a request of the data first.
import requests
json_df = pd.read_json(requests.get(url).json())
- 619
1
vote
Querying CKAN in Python using ckanapi
For some reason, the above solution has not worked for me. I tried data.gov catalog and used the same code as below:
import ckanapi
ckan = ckanapi.RemoteCKAN('https://catalog.data.gov')
search_params ...
- 11
1
vote
Looking for open dataset containing data for disease and symptoms
There is an international coding system that lists and codes an enormous range of diseases/symptoms called ICD10. This is how Wikipedia describes it:
ICD-10 is the 10th revision of the ...
- 400
Only top scored, non community-wiki answers of a minimum length are eligible