Questions tagged [programming]

For open data related questions about computer programming, programming languages (such as Python, R, or Java), and application development.

Filter by
Sorted by
Tagged with
0 votes
0 answers
7 views

GLM; the function 'prediction' contains NA

I want to validate my glm and make a ROC curve. I get some errors which I can't resolve. My validation of the model: glm.pred <- predict(m.glm, newdata = df.vld, type="response") Now I ...
user avatar
0 votes
0 answers
5 views

error message when knitting r markdown

When I'm knitting my r markdown document it all runs smoothly until 1 chunk near the end where I get the error in the render tab (near where the console is): Ill write down what the code says just in ...
user avatar
0 votes
0 answers
12 views

Creating new column which values are function of other columns' values - R

i am unsuccesfully trying to write a simple code to create a new column which values are function of other columns' values. My dataframe is composed by 4 columns and several raws. The first three ...
user avatar
  • 1
0 votes
0 answers
10 views

How do I add a square root curve to my data into my regression model?

I want to add a square root term into my regression model, but I'm not exactly sure how to do it. from scipy.optimize import curve_fit import statsmodels.formula.api as smf def square_root(x,a,b,c): ...
user avatar
0 votes
0 answers
14 views

Do you have an API that gets the up to date minimum wage data by state?

Table here is great for consolidated minimum wages: https://www.dol.gov/agencies/whd/mw-consolidated Is there anyway to get that data in the API? And as a bonus does Department of Labor keep records ...
user avatar
0 votes
0 answers
32 views

Error message using marmap (old R code) and plotting bathymetry with ggplot2

Q1 When I use getNOAA.bathy from the marmap package I get a error message as follows Querying NOAA database ... This may take seconds to minutes, depending on grid size Error in .local(.Object, ...) : ...
user avatar
0 votes
0 answers
13 views

Questions and answers datasets

I am looking for a dataset similar to XQuAD. I would need it in German, but it is not tragic if it is in another language since it can be translated. It would also be okay if the format is not the ...
user avatar
0 votes
0 answers
43 views

Finding clinical trial datasets in R

I am working on a project and looking for R packages which contain free datasets from clinical trials. A good example is the AIDS Clinical Trials Group Study 175 (ACTG 175), whose R package can be ...
user avatar
  • 101
0 votes
0 answers
9 views

Are there panel cointegration tests in R?

This question was previously asked at Stack Exchange but the moderator recommended me to try posting it here instead. I'm looking for panel cointegration tests in R, such as Pedroni, Kao, and ...
user avatar
0 votes
0 answers
12 views

R cannot allocate vector. Where is the object?

I misjudged how much memory would be required and my computer ran out of memory when R was 76% done with an lapply function. Is there a way to recover and saveRDS the object or do I have to start over ...
user avatar
  • 1
1 vote
1 answer
112 views

How can I get completion rate data from all colleges and cohorts in a longitudinal format from college scorecard? (with R)

What I want: To obtain a R dataframe with completion-rate data from all colleges in the US (or all the colleges that have available data in college scorecard datalake). What I expect: A data frame in ...
user avatar
  • 111
0 votes
2 answers
57 views

Weekly temperature data for Europe on a regional level NUTS 1

I am currently writing my thesis on how temperature affects mortality in Europe. I obtained an excellent dataset from the Eurostat Database containing weekly Mortality numbers on NUTS1 level (regions)....
user avatar
0 votes
1 answer
29 views

List of software and versions for test data

Does anybody know where I can find some sample data to use as stub data for my application to test with I don't want it to be just random strings and numbers? I was originally going to user Microsoft &...
user avatar
1 vote
0 answers
7 views

Is there a way to match ICD-10 Diagnosis Codes with available Rx treatments?

Ideally tabling both the generic and branded drug names.
user avatar
  • 11
0 votes
2 answers
123 views

German nouns gender source

I want to create some sort of spell checking program for German language, for which i need a database with all the words and their gender description(only their gender description) to cross reference ...
user avatar
  • 9
1 vote
0 answers
22 views

Most frequently used programming language commands in Python

I am looking for a dataset which lists the most often used commands for Python in terms of their relative frequency. Sample result could look like: | Function name| Relative Frequency |:------------...
user avatar
1 vote
0 answers
38 views

Where can I find task duration (estimate) data?

Scenario In an endeavour to compare a basic regression with a more advanced Ensemble Network of classifiers, I am looking for (a) data(set) that contains: Task description Measured task duration (...
user avatar
  • 141
1 vote
1 answer
84 views

Unzipping the openfda data in R

I've downloaded all the url's for the different drug-event pairs, but they all end in .zip. Does anyone know how to automate pulling the .json file out of these zip files without doing it manually for ...
user avatar
  • 11
1 vote
0 answers
20 views

Csv format easy colums characteristic - type dataset for beginner R analisys

I had a look on kaggle but I did not find what I was looking for. I need a very simple data set, like the one of "iris" default pre-sets of R where you have differents columns with some characteristic ...
user avatar
1 vote
0 answers
35 views

Aggregate Willmott and Matsuura Temperature Climate Data on Country Level

I'm looking for monthly, mean temperature data on the country-level since 1900 (or at least 1950) for which the temperature is weighted according to population density. The common database for the ...
user avatar
3 votes
2 answers
99 views

Bounty Programs for Open Source Projects

I am interested in data that contains bounties or paid rewards for specific programming tasks in open source projects. Ideally, the data would contain a description of the task, the amount of the ...
user avatar
  • 1,214
0 votes
2 answers
278 views

Searching for Directed acyclic graph data

I need some DAG graph for my research. The representation of the graphs is needed to be in edge-list representation.
user avatar
1 vote
0 answers
121 views

average ingredients for each drug in each year for a specific manufacturer

I want to count the average number of ingredients in each drug produced by a specific manufacturer in each year. The results I want should be like this: year | drug_names | avg_number_of_ingredients ...
user avatar
  • 111
2 votes
1 answer
24 views

Which is the best way to work with NCBI data obtaining online partial information from the whole

I was trying to create a database from NCBI Nucleotide bank. I did a query which gave me 1124 results. From each single result I was wanting to obtain only the items realted to Accesion Country and ...
user avatar
0 votes
1 answer
26 views

Where can I find grid file of the Netherlands for R

I'm looking for a grid file (ideally 5x5 km) of the Netherlands, because I want to do kriging interpolation in R. Where can I find that?
user avatar
  • 11
4 votes
1 answer
73 views

Site that provides up to date list of programming languages/frameworks to open source repositories using it?

When you are learning how to program in a certain language or with a particular framework, it is very useful to have an actual real-world example of that project being used somewhere in the open ...
user avatar
3 votes
2 answers
239 views

Historical Walmart Stores Data set

I'm trying to capture a historical list of Wal-mart stores. I need store ID, store name, longitude, latitutde, address, city, state, zip, services, store opening date, and store closing date (if the ...
user avatar
0 votes
3 answers
127 views

How to link postcode to broader geographical area in the United Kingdom

I have a dataset of companies, where one of the variables is its postcode. I want to link this postcode to a broader geographical unit. I have shapes file that enables me to map such broader ...
user avatar
1 vote
0 answers
44 views

Download clean coordinates from Wikipedia Map Module: … detailed map

I would like to know if there is a way to either download/scrape a clean CSV with coordinates and controlling group from Wikipedia conflict maps, or how to generate an ESRI shapefile from the Lua ...
user avatar
2 votes
3 answers
86 views

How to get all U.S. census blocks within a state

Is there an easy way to download the set of census blocks (12-digit FIPS codes) for a given state? I've tried using R packages tigris and acs to no avail. (Well, tigris works but it gives me the ...
user avatar
  • 121
5 votes
1 answer
149 views

Does this violate copyright of music/lyrics/sound?

So, we are beginning to create a Karaoke app. And we have few queries in the copyrights aspect. We would like to have these cleared before we get any further with our app's development. The decided ...
user avatar
  • 103
3 votes
1 answer
240 views

College scorecard only has 40 states?

So I just downloaded the college scorecard datasets and import into R, I used a unique() function on "STABBR" and it only returned 40 unique values for states, what happened here?
user avatar
4 votes
0 answers
39 views

Images with symmetry parameters

I wrote a program that searches for aesthetic pictures. One of my parameters is how much a picture is symmetrical. This picture is taken from 33Pol (from Iran-Isfahan). As can be seen, the water ...
user avatar
2 votes
1 answer
240 views

Mapping PUMA Codes to TIGER/line shapefiles

I downloaded PUMA mapping shapefiles for California from TIGER/line and am able to use R packages maptools, mapproj, and ggplot2 to plot maps of California with each PUMA outline as a border. My goal ...
user avatar
3 votes
2 answers
4k views

Get Historic Temperature Data by GPS and Timestamp Using R

I have a dataset: ID Time Lat Long a 2016-06-01 10:35:26 41.79925 -71.33052 a 2016-06-01 10:35:57 41.80174 -71.33307 a 2016-06-01 10:37:30 41....
user avatar
  • 33
3 votes
3 answers
5k views

Seasonal Sales Data for time Series Analysis

I am looking for a typical sales data set, which I can use for a time series prediction. I especially want to show how to decompose the seasonal component. A good example would be a fictional company, ...
user avatar
1 vote
0 answers
14 views

Dbscan time duration gauge

I'm running a Dbscan. On a matrix that's 10333 by 10333, using an epsilon value of 50. Is there any way to gauge how long this will take? It's been running for the past 8 hours now. Also does it ...
user avatar
3 votes
1 answer
82 views

How to Geocode coordinates?

I need a way to obtain the coordinates for all of one type of store/restaurant in a country. For example, all the McDonald's in South Africa. I'd like to use R or any tool that is more appropriate. ...
user avatar
3 votes
3 answers
152 views

Introduction to Statistical Thought - med.1000 dataset

Does anyone know where the med.1000 dataset used in the Introduction to Statistical Thought book (by Lavine, PDF) comes from? I just can't seem to find it with Google! It contains measurements of ...
user avatar
6 votes
2 answers
72 views

Popularity of programming libraries

There are so many libraries, for instance for C# networking or Java encryption. I am looking for data about the "popularity" of published libraries. Any measure of "popularity" is fine, for instance ...
user avatar
2 votes
2 answers
179 views

Looking for specific Sales Dataset

I am relatively new to programming and therefore don't really know where to find specified datasets. What I am basically looking for is Sales Data from any Company (can be made up). The data needs ...
user avatar
3 votes
1 answer
37 views

Matching 1980s address data to 1990 census geoid10?

I am hoping to match a list a addresses gathered in the mid 1980s with block group codes from the 1990 census. The geocoder on the census website processes this for 2010 block group designations only. ...
user avatar
  • 61
2 votes
1 answer
276 views

Can anyone HELP provide codes to import 'CHARTEVENTS' and 'NOTEEVENTS' in sas or R?

I tried R and SAS to import these two datasets, but the programming runs forever. I could not open in excel either. Can anyone provide codes to import these two table: 'CHARTEVENTS' and 'NOTEEVENTS' ?
user avatar
  • 21
5 votes
1 answer
98 views

Solved Programming Challenges Dataset

I'm looking for a dataset of solved programming challenges, like the ones on http://codeeval.com. The dataset should have the natural language description of the problem and N solutions for each ...
user avatar
  • 171
4 votes
1 answer
205 views

Load NSF Research Award Abstracts in Python or R

I want to work on NSF Research Award Abstracts 1990-2003 Data Set in R. Every record of the data is stored in a text file and text files are grouped in folders (See data files here) Is there any easy ...
user avatar
  • 261
4 votes
1 answer
81 views

Where is the real beginner's guide

I am trying to learn something about how APIs work. I was told that DOL has the best API and supporting documentation in the federal government. So here I am, on page 1 of the beginner's guide, and ...
user avatar
3 votes
0 answers
56 views

Are there any examples or best practice for encapsulating large open data sets into R packages?

I've recently been experimenting with UK government open data with R, and it seems like I could usefully wrap up some of my work into an R package. I'd want the package to download the data either ...
user avatar
1 vote
0 answers
628 views

Using Google's Custom Search api [closed]

I am currently working for a social media site. We would like to use Google Custom Search Engine API and derive analytical insights from the results. My choice of development platform is R or Python. ...
user avatar
  • 11
7 votes
2 answers
207 views

Data on hurricanes?

As a programmer and meteorology enthusiast, I'd love to be able to get latitude/longitude of tropical storms/hurricanes (specifically in the Atlantic). Does anyone know of websites that can provide ...
user avatar
4 votes
1 answer
84 views

Lobby meetings of European Commission - Integrity Watch

The staff of the European Commission is obliged to keep a register of their meetings with lobbyists. The site Integrity Watch administered by Transparency International keeps track of these meetings ...
user avatar
  • 153