Questions tagged [programming]

For open data related questions about computer programming, programming languages (such as Python, R, or Java), and application development.

Filter by
Sorted by
Tagged with
49
votes
6answers
17k views

A Python guide for open data file formats

If you are an open data researcher you will need to handle a lot of different file formats from datasets. Sadly, most of the time, you don’t have the opportunity to choose which file format is the ...
11
votes
4answers
6k views

A web API user's guide for free and open data

There are many web-based Application Programming Interfaces (API) that allow data-hungry people to get their hands on all sorts of data. It's a great way to collect data as-needed, instead of looking ...
5
votes
4answers
7k views

Looking for open dataset containing data for disease and symptoms

I am doing a data mining project on "health prediction system". So, Is there any open dataset containing data for disease and symptoms.
87
votes
20answers
157k views

How can I work with a 4GB csv file?

What's the best way to access a 4GB csv file? I would like get a 'cut' of this open data set: Full Replacement Monthly NPI File, available here http://nppes.viva-it.com/NPI_Files.html Specifically, ...
36
votes
11answers
30k views

Good tools to parse repetitive unstructured data

I'm looking to parse a large number of lines of repetitive but unstructured data. This is a task that happens at least once every project, in my experience, so I'm looking for a tool to transform ...
10
votes
2answers
2k views

Catalog.data.gov using CKAN API with python requests package

I'm not sure if this is a requests issue, a CKAN API issue, or a catalog.data.gov issue. I can do this GET query: import requests import json r = requests.get('http://catalog.data.gov/api/search/...
6
votes
1answer
4k views

ASCII Character Frequency Analysis

I've been looking for a table of the frequencies of all 128 ASCII characters, not just letters. The best table I've been able to find is this one, but that one only includes printable ASCII characters,...
8
votes
2answers
1k views

Scraping columns from a PDF

We are trying to capture rows from PDF tables & output them as lines of JSON - can anyone suggest a good technique for separating columns? Ideally using the tools linked below. Specifically this ...
16
votes
4answers
2k views

List of data sources at the state, county and zip / zcta level

I am trying to compile a list data sources - excluding the US Census - that cover the continental US at the state, county and ZIP/ZCTA level. Any help would be appreciated. Additional details: I ...
12
votes
3answers
2k views

Where can I download photoperiod (daylength) data?

I'm looking to download photoperiod (day length) data for a variety of locations in Europe on a variety of dates. For each date and locations, I need to the number of hours of daylight. Ideally, the ...
6
votes
3answers
469 views

Coding homework dataset

I would like to compare 25+ different coding (same programming language, if possible Java but other languages are fine too) implementations of the same homework. Where can I find such homework ...
7
votes
4answers
190 views

R packages with open data in them

I love and play a lot with the Baseball data package for R (Lahman), and I was wonder if there is anything like it but for more oriented to social sciences. Either surveys or admin data (PSID, HRS, ...
5
votes
1answer
105 views

Machine readable list of monetary currencies, including symbol

Does someone know a machine readable currency list, that includes the symbol? For example Aruba Guilder,AWG,ƒ,ƒ Australia Dollar,AUD,$,$ I've found various sources, but they either lack the symbol (...
3
votes
2answers
1k views

Public web API to get list of apps in App Store?

I want to make an app, where user can find or mark apps that are similar. To do that first client need to able to browse app store content. If user set a keyword, i.e. "face", then I need list of app ...