Questions tagged [programming]

For open data related questions about computer programming, programming languages (such as Python, R, or Java), and application development.

Filter by
Sorted by
Tagged with
1
vote
0answers
36 views

average ingredients for each drug in each year for a specific manufacturer

I want to count the average number of ingredients in each drug produced by a specific manufacturer in each year. The results I want should be like this: year | drug_names | avg_number_of_ingredients ...
1
vote
1answer
13 views

Which is the best way to work with NCBI data obtaining online partial information from the whole

I was trying to create a database from NCBI Nucleotide bank. I did a query which gave me 1124 results. From each single result I was wanting to obtain only the items realted to Accesion Country and ...
0
votes
1answer
17 views

Where can I find grid file of the Netherlands for R

I'm looking for a grid file (ideally 5x5 km) of the Netherlands, because I want to do kriging interpolation in R. Where can I find that?
4
votes
1answer
57 views

Site that provides up to date list of programming languages/frameworks to open source repositories using it?

When you are learning how to program in a certain language or with a particular framework, it is very useful to have an actual real-world example of that project being used somewhere in the open ...
1
vote
0answers
30 views

Historical Walmart Stores Data set

I'm trying to capture a historical list of Wal-mart stores. I need store ID, store name, longitude, latitutde, address, city, state, zip, services, store opening date, and store closing date (if the ...
0
votes
3answers
53 views

How to link postcode to broader geographical area in the United Kingdom

I have a dataset of companies, where one of the variables is its postcode. I want to link this postcode to a broader geographical unit. I have shapes file that enables me to map such broader ...
1
vote
0answers
41 views

Download clean coordinates from Wikipedia Map Module: … detailed map

I would like to know if there is a way to either download/scrape a clean CSV with coordinates and controlling group from Wikipedia conflict maps, or how to generate an ESRI shapefile from the Lua ...
1
vote
3answers
56 views

How to get all U.S. census blocks within a state

Is there an easy way to download the set of census blocks (12-digit FIPS codes) for a given state? I've tried using R packages tigris and acs to no avail. (Well, tigris works but it gives me the ...
6
votes
1answer
128 views

Does this violate copyright of music/lyrics/sound?

So, we are beginning to create a Karaoke app. And we have few queries in the copyrights aspect. We would like to have these cleared before we get any further with our app's development. The decided ...
3
votes
1answer
172 views

College scorecard only has 40 states?

So I just downloaded the college scorecard datasets and import into R, I used a unique() function on "STABBR" and it only returned 40 unique values for states, what happened here?
4
votes
0answers
37 views

Images with symmetry parameters

I wrote a program that searches for aesthetic pictures. One of my parameters is how much a picture is symmetrical. This picture is taken from 33Pol (from Iran-Isfahan). As can be seen, the water ...
1
vote
1answer
161 views

Mapping PUMA Codes to TIGER/line shapefiles

I downloaded PUMA mapping shapefiles for California from TIGER/line and am able to use R packages maptools, mapproj, and ggplot2 to plot maps of California with each PUMA outline as a border. My goal ...
3
votes
2answers
2k views

Get Historic Temperature Data by GPS and Timestamp Using R

I have a dataset: ID Time Lat Long a 2016-06-01 10:35:26 41.79925 -71.33052 a 2016-06-01 10:35:57 41.80174 -71.33307 a 2016-06-01 10:37:30 41....
2
votes
2answers
3k views

Seasonal Sales Data for time Series Analysis

I am looking for a typical sales data set, which I can use for a time series prediction. I especially want to show how to decompose the seasonal component. A good example would be a fictional company,...
1
vote
0answers
9 views

Dbscan time duration gauge

I'm running a Dbscan. On a matrix that's 10333 by 10333, using an epsilon value of 50. Is there any way to gauge how long this will take? It's been running for the past 8 hours now. Also does it ...
3
votes
1answer
74 views

How to Geocode coordinates?

I need a way to obtain the coordinates for all of one type of store/restaurant in a country. For example, all the McDonald's in South Africa. I'd like to use R or any tool that is more appropriate. ...
3
votes
2answers
103 views

Introduction to Statistical Thought - med.1000 dataset

Does anyone know where the med.1000 dataset used in the Introduction to Statistical Thought book (by Lavine, PDF) comes from? I just can't seem to find it with Google! It contains measurements of ...
5
votes
2answers
64 views

Popularity of programming libraries

There are so many libraries, for instance for C# networking or Java encryption. I am looking for data about the "popularity" of published libraries. Any measure of "popularity" is fine, for instance ...
2
votes
1answer
124 views

Looking for specific Sales Dataset

I am relatively new to programming and therefore don't really know where to find specified datasets. What I am basically looking for is Sales Data from any Company (can be made up). The data needs ...
3
votes
1answer
34 views

Matching 1980s address data to 1990 census geoid10?

I am hoping to match a list a addresses gathered in the mid 1980s with block group codes from the 1990 census. The geocoder on the census website processes this for 2010 block group designations only. ...
2
votes
1answer
191 views

Can anyone HELP provide codes to import 'CHARTEVENTS' and 'NOTEEVENTS' in sas or R?

I tried R and SAS to import these two datasets, but the programming runs forever. I could not open in excel either. Can anyone provide codes to import these two table: 'CHARTEVENTS' and 'NOTEEVENTS' ?
3
votes
0answers
53 views

Solved Programming Challenges Dataset

I'm looking for a dataset of solved programming challenges, like the ones on http://codeeval.com. The dataset should have the natural language description of the problem and N solutions for each ...
4
votes
1answer
130 views

Load NSF Research Award Abstracts in Python or R

I want to work on NSF Research Award Abstracts 1990-2003 Data Set in R. Every record of the data is stored in a text file and text files are grouped in folders (See data files here) Is there any easy ...
4
votes
1answer
71 views

Where is the real beginner's guide

I am trying to learn something about how APIs work. I was told that DOL has the best API and supporting documentation in the federal government. So here I am, on page 1 of the beginner's guide, and ...
3
votes
0answers
56 views

Are there any examples or best practice for encapsulating large open data sets into R packages?

I've recently been experimenting with UK government open data with R, and it seems like I could usefully wrap up some of my work into an R package. I'd want the package to download the data either ...
1
vote
0answers
533 views

Using Google's Custom Search api [closed]

I am currently working for a social media site. We would like to use Google Custom Search Engine API and derive analytical insights from the results. My choice of development platform is R or Python. ...
7
votes
2answers
118 views

Data on hurricanes?

As a programmer and meteorology enthusiast, I'd love to be able to get latitude/longitude of tropical storms/hurricanes (specifically in the Atlantic). Does anyone know of websites that can provide ...
4
votes
1answer
80 views

Lobby meetings of European Commission - Integrity Watch

The staff of the European Commission is obliged to keep a register of their meetings with lobbyists. The site Integrity Watch administered by Transparency International keeps track of these meetings ...
1
vote
0answers
82 views

nhamcs design on survey package (R)

I am trying to analyze nhamcs http://www.nber.org/data/national-hospital-ambulatory-medical-care-survey.html using Lumley's survey package but getting the wrong standard errors when comparing them ...
2
votes
1answer
1k views

Corruption Perception Index (CPI) by Transparency International

I need the indeces in analyzable format, i.e. csv, xls, from the year 2005 to 2015. The results are in HTML table/PDF format on the TI website. Can anyone link a source or write a script to scrape the ...
5
votes
1answer
92 views

Machine readable list of monetary currencies, including symbol

Does someone know a machine readable currency list, that includes the symbol? For example Aruba Guilder,AWG,ƒ,ƒ Australia Dollar,AUD,$,$ I've found various sources, but they either lack the symbol (...
2
votes
0answers
43 views

ASIC designs for high-efficiency Bitcoin miners

I'm looking for available open-source ASIC code designs which can be used to produce high-efficiency Bitcoin miners (similar to Butterfly Labs, etc.) Either HDL or VHDL, or any other kind of ...
7
votes
2answers
424 views

Historical Twitter Data

I'm trying to get historical twitter data starting from 2010 with specific keywords related to S&P500 companies. I will probably end up using their tickers as keywords once I finalize my list of ...
2
votes
0answers
33 views

Wikidata item add form template

Is it possible in wikidata to make a template form from which wikidata item is created? If this is not yet supported, what would be simplest way to make (program) such implementation integrated into ...
4
votes
1answer
2k views

ASCII Character Frequency Analysis

I've been looking for a table of the frequencies of all 128 ASCII characters, not just letters. The best table I've been able to find is this one, but that one only includes printable ASCII characters,...
3
votes
2answers
412 views

How to scrape rugby union data from espn.co.uk

This is the site I want to gather data from but I'm really not sure where to start. http://www.espn.co.uk/rugby/playerstats?gameId=271423&league=271937
4
votes
1answer
506 views

Global Precipitation Measurement (GPM) data download in R

I would like to know if resources exist for downloading GPM data in R. I'm aware of the Hydrological Data Discovery Tools ("hddtools") package, which can be used for accessing Tropical Rainfall ...
3
votes
1answer
748 views

Where can I get a sample dataset for A/B split testing?

I'm working on A/B split testing now. Where can I get a sample dataset for A/B split testing?
3
votes
1answer
58 views

Russian Ruble exchange rate

I am looking for a currency exchange data, specifically USDRUB and EURRUB quotes. I managed to find tick-by-tick data on the official site of Moscow Exchange (MoEx). But I search data at 15-30-minute ...
1
vote
0answers
16 views

Windows kernel or user mode crash dumps

I am looking for a set of Windows crash dumps (.dmp files) that I could use during trainings. This may be user mode crash dumps (application crashes, "Send information to Microsoft") or kernel mode ...
4
votes
2answers
115 views

Sierra Leone Ethnic Groups - Shapefile

I am looking for open data on the Sierra Leone Ethnic groups. Preferably in Shapefile format or any other format that can be used on a map. So far I created a map with the districts and their ...
1
vote
0answers
122 views

offline bar code databases [duplicate]

I'am building an application that reads the bar code and give you information based on the bar code is there free database i can download and use it offline if not what are the available ...
5
votes
4answers
5k views

Looking for open dataset containing data for disease and symptoms

I am doing a data mining project on "health prediction system". So, Is there any open dataset containing data for disease and symptoms.
2
votes
1answer
70 views

A “proper” Data Set

I am preparing 2/3 neural networks models (I have chosen "neuralnet", "nnet", "AMORE" randomly among the R packages) for a certain problem. At the moment I do not have the Data Set, but I would like ...
4
votes
1answer
86 views

geolocalization of tweets

Do you know a technique to find spatial indicators using the package TwitteR in R? For instance if I have to find the word "dog" using the package twitteR, but I miss the coordinates, there is the ...
3
votes
1answer
76 views

where can I find geocoded sentiments?

I am a student of economics and I am conducting my master thesis on cultural industries. Trying to understand what is the feeling of the people about different themes, I'am using TwitteR package in R ...
3
votes
0answers
60 views

Database of programming terms

I want to find a terminology database with programming terms , for example: Front-end UI/UX ruby RoR HTML 5 HTML Any idea ?
2
votes
1answer
209 views

Context-aware dataset of movies or music

Looking for access to context aware dataset(s) of movies or music. Context aware dataset should contain user related information, such as user gender, mood, time, social, location, weather, emotions ...
4
votes
0answers
62 views

Reference data set for benchmarking string comparison algorithms

Recently, I have implemented an extension to the classical Levenshtein-Damerau and Gotoh (aka "affine gaps") string matching algorithms. To evaluate this modification, however, I need a large (in ...