# Questions tagged [programming]

For open data related questions about computer programming, programming languages (such as Python, R, or Java), and application development.

110 questions
Filter by
Sorted by
Tagged with
15 views

I am looking for historical weather data (min and max temp, humidity, wind speed, wind direction, precipitation) for specific GPS coordinates. The data must be preferably hourly, but if only daily ...
7 views

### How to simulate data for a Bivariate Integer-Valued Auto Regressive process of order 1 time series in R?

I want to simulate data (Monte Carlo simulation) to assess the small sample properties of the Maximum Likelihood Estimators (MLE) for the BINAR(1) model: \begin{aligned} & Y_{1, t}=\rho_1 \cdot Y_{...
1 vote
20 views

### how to add scaled variable to original dataset in R

all I am trying to add scaled raw soil data element based on IQR, could you please help, how I can add this new scaled variable to original dataset, could you confirm the below if it is correct? > ...
• 111
9 views

### ould anyone help me to locate error and run this R code to simulate for balanced pleiotropic effects in Mendelian Randomization study?

The parameters are taking value of NA [Kindly refer the image]. Did I missed any part of the code related to the information "temp = as.integer(commandArgs(trailingOnly = TRUE))" Summary-...
1 vote
19 views

### Koeppen-Geiger Climatic Zones as netcdf file

Is there a way to obtain a netcdf file of the Koeppen-Geiger Climatic Zones?
• 133
125 views

### Alluvial Plot / Sankey Diagram in R - Use Percents Instead of Frequencies

I am trying to create an alluvial plot using ggplot and the ggalluvial. I am less interested in the frequency change per position, but instead, I'm more interested in the percent change per position. ...
40 views

### Is there way to get a consistent output from optFederov()?

In R, when I create a full factorial plan with the fac.design() function from the DoE.base package to reduce the number of necessary runs, the optFederov() function from the AlgDesign package gives a ...
• 1
156 views

### Structure of Results Appear to Change Based on Query

If I run this query: https://api.data.gov/ed/collegescorecard/v1/schools?latest.school.city=Los Angeles&api_key=XXXXXXXXXXX, then the results look something like this: However, if I run this ...
30 views

### Is there a way to retrieve navigation data from Google Maps e.g. to R?

How would an HTTP request or API request retrieve navigation data from Google Maps? Are there some simple lines of code for that? Let's say I want to give an input of origin and destination address, ...
18 views

### R: sampling using dbinom(y-0:200)

In R: I have a sample (y) of length 1e4. y = sample(0:200, 1e4, replace = TRUE) I have plugged this sample into: dbinom(y-x,100,0.3) However, I would like to gather samples from this function but ...
38 views

### R or Excel: Calculate difference between dates

I have a list of course completion dates (person, start, end) in the following format (exemplary): Person X || Sept 21, 2021 06:30 PM || Sept 21, 2021 06:50 PM Now I'd like to calculate the overall ...
14 views

### R cannot allocate vector. Where is the object?

I misjudged how much memory would be required and my computer ran out of memory when R was 76% done with an lapply function. Is there a way to recover and saveRDS the object or do I have to start over ...
• 1
1 vote
249 views

### How can I get completion rate data from all colleges and cohorts in a longitudinal format from college scorecard? (with R)

What I want: To obtain a R dataframe with completion-rate data from all colleges in the US (or all the colleges that have available data in college scorecard datalake). What I expect: A data frame in ...
• 111
187 views

### Weekly temperature data for Europe on a regional level NUTS 1

I am currently writing my thesis on how temperature affects mortality in Europe. I obtained an excellent dataset from the Eurostat Database containing weekly Mortality numbers on NUTS1 level (regions)....
35 views

### List of software and versions for test data

Does anybody know where I can find some sample data to use as stub data for my application to test with I don't want it to be just random strings and numbers? I was originally going to user Microsoft &...
1 vote
12 views

### Is there a way to match ICD-10 Diagnosis Codes with available Rx treatments?

Ideally tabling both the generic and branded drug names.
• 11
275 views

### German nouns gender source

I want to create some sort of spell checking program for German language, for which i need a database with all the words and their gender description(only their gender description) to cross reference ...
• 9
1 vote
23 views

### Most frequently used programming language commands in Python

I am looking for a dataset which lists the most often used commands for Python in terms of their relative frequency. Sample result could look like: | Function name| Relative Frequency |:------------...
1 vote
123 views

### Where can I find task duration (estimate) data?

Scenario In an endeavour to compare a basic regression with a more advanced Ensemble Network of classifiers, I am looking for (a) data(set) that contains: Task description Measured task duration (...
• 141
1 vote
114 views

### Unzipping the openfda data in R

I've downloaded all the url's for the different drug-event pairs, but they all end in .zip. Does anyone know how to automate pulling the .json file out of these zip files without doing it manually for ...
• 11
1 vote
23 views

### Csv format easy colums characteristic - type dataset for beginner R analisys

I had a look on kaggle but I did not find what I was looking for. I need a very simple data set, like the one of "iris" default pre-sets of R where you have differents columns with some characteristic ...
1 vote
52 views

### Aggregate Willmott and Matsuura Temperature Climate Data on Country Level

I'm looking for monthly, mean temperature data on the country-level since 1900 (or at least 1950) for which the temperature is weighted according to population density. The common database for the ...
260 views

### Bounty Programs for Open Source Projects

I am interested in data that contains bounties or paid rewards for specific programming tasks in open source projects. Ideally, the data would contain a description of the task, the amount of the ...
• 1,214
502 views

### Searching for Directed acyclic graph data

I need some DAG graph for my research. The representation of the graphs is needed to be in edge-list representation.
• 101
1 vote
130 views

### average ingredients for each drug in each year for a specific manufacturer

I want to count the average number of ingredients in each drug produced by a specific manufacturer in each year. The results I want should be like this: year | drug_names | avg_number_of_ingredients ...
• 111
33 views

### Which is the best way to work with NCBI data obtaining online partial information from the whole

I was trying to create a database from NCBI Nucleotide bank. I did a query which gave me 1124 results. From each single result I was wanting to obtain only the items realted to Accesion Country and ...
37 views

### Where can I find grid file of the Netherlands for R

I'm looking for a grid file (ideally 5x5 km) of the Netherlands, because I want to do kriging interpolation in R. Where can I find that?
• 11
75 views

### Site that provides up to date list of programming languages/frameworks to open source repositories using it?

When you are learning how to program in a certain language or with a particular framework, it is very useful to have an actual real-world example of that project being used somewhere in the open ...
391 views

### Historical Walmart Stores Data set

I'm trying to capture a historical list of Wal-mart stores. I need store ID, store name, longitude, latitutde, address, city, state, zip, services, store opening date, and store closing date (if the ...
309 views

### How to link postcode to broader geographical area in the United Kingdom

I have a dataset of companies, where one of the variables is its postcode. I want to link this postcode to a broader geographical unit. I have shapes file that enables me to map such broader ...
• 178
1 vote
49 views

I would like to know if there is a way to either download/scrape a clean CSV with coordinates and controlling group from Wikipedia conflict maps, or how to generate an ESRI shapefile from the Lua ...
108 views

### How to get all U.S. census blocks within a state

Is there an easy way to download the set of census blocks (12-digit FIPS codes) for a given state? I've tried using R packages tigris and acs to no avail. (Well, tigris works but it gives me the ...
• 121
182 views

### Does this violate copyright of music/lyrics/sound?

So, we are beginning to create a Karaoke app. And we have few queries in the copyrights aspect. We would like to have these cleared before we get any further with our app's development. The decided ...
• 103
263 views

### College scorecard only has 40 states?

So I just downloaded the college scorecard datasets and import into R, I used a unique() function on "STABBR" and it only returned 40 unique values for states, what happened here?
41 views

### Images with symmetry parameters

I wrote a program that searches for aesthetic pictures. One of my parameters is how much a picture is symmetrical. This picture is taken from 33Pol (from Iran-Isfahan). As can be seen, the water ...
• 141
315 views

### Mapping PUMA Codes to TIGER/line shapefiles

I downloaded PUMA mapping shapefiles for California from TIGER/line and am able to use R packages maptools, mapproj, and ggplot2 to plot maps of California with each PUMA outline as a border. My goal ...
5k views

### Get Historic Temperature Data by GPS and Timestamp Using R

I have a dataset: ID Time Lat Long a 2016-06-01 10:35:26 41.79925 -71.33052 a 2016-06-01 10:35:57 41.80174 -71.33307 a 2016-06-01 10:37:30 41....
• 33
6k views

### Seasonal Sales Data for time Series Analysis

I am looking for a typical sales data set, which I can use for a time series prediction. I especially want to show how to decompose the seasonal component. A good example would be a fictional company, ...
1 vote
16 views

### Dbscan time duration gauge

I'm running a Dbscan. On a matrix that's 10333 by 10333, using an epsilon value of 50. Is there any way to gauge how long this will take? It's been running for the past 8 hours now. Also does it ...
99 views

### How to Geocode coordinates?

I need a way to obtain the coordinates for all of one type of store/restaurant in a country. For example, all the McDonald's in South Africa. I'd like to use R or any tool that is more appropriate. ...
161 views

### Introduction to Statistical Thought - med.1000 dataset

Does anyone know where the med.1000 dataset used in the Introduction to Statistical Thought book (by Lavine, PDF) comes from? I just can't seem to find it with Google! It contains measurements of ...
77 views

### Popularity of programming libraries

There are so many libraries, for instance for C# networking or Java encryption. I am looking for data about the "popularity" of published libraries. Any measure of "popularity" is fine, for instance ...
• 8,466
211 views

### Looking for specific Sales Dataset

I am relatively new to programming and therefore don't really know where to find specified datasets. What I am basically looking for is Sales Data from any Company (can be made up). The data needs ...
38 views

### Matching 1980s address data to 1990 census geoid10?

I am hoping to match a list a addresses gathered in the mid 1980s with block group codes from the 1990 census. The geocoder on the census website processes this for 2010 block group designations only. ...
• 161
341 views

### Can anyone HELP provide codes to import 'CHARTEVENTS' and 'NOTEEVENTS' in sas or R?

I tried R and SAS to import these two datasets, but the programming runs forever. I could not open in excel either. Can anyone provide codes to import these two table: 'CHARTEVENTS' and 'NOTEEVENTS' ?
• 21
159 views

### Solved Programming Challenges Dataset

I'm looking for a dataset of solved programming challenges, like the ones on http://codeeval.com. The dataset should have the natural language description of the problem and N solutions for each ...
• 171
243 views

### Load NSF Research Award Abstracts in Python or R

I want to work on NSF Research Award Abstracts 1990-2003 Data Set in R. Every record of the data is stored in a text file and text files are grouped in folders (See data files here) Is there any easy ...
• 261
91 views

### Where is the real beginner's guide

I am trying to learn something about how APIs work. I was told that DOL has the best API and supporting documentation in the federal government. So here I am, on page 1 of the beginner's guide, and ...