Questions tagged [programming]
For open data related questions about computer programming, programming languages (such as Python, R, or Java), and application development.
109
questions
0
votes
0
answers
8
views
Alluvial Plot / Sankey Diagram in R - Use Percents Instead of Frequencies
I am trying to create an alluvial plot using ggplot and the ggalluvial. I am less interested in the frequency change per position, but instead, I'm more interested in the percent change per position. ...
0
votes
0
answers
8
views
Interesting Datasets to show the felibility with SVMs in R
I hope this is the right place for this question. I am working on a lecture for SMVs. The audience will mostly be beginners. Next to a very graphical theroy presentation I am looking to give two ...
- 1
0
votes
0
answers
13
views
Block randomization with blockrand
I would like to do stratified randomization on three variables: gender, age (2 categories) and center (4 categories). So the number of strata is 2X2X4. This makes 16 strata. I would like 50 people per ...
- 111
0
votes
0
answers
17
views
Is there way to get a consistent output from optFederov()?
In R, when I create a full factorial plan with the fac.design() function from the DoE.base package to reduce the number of necessary runs, the optFederov() function from the AlgDesign package gives a ...
- 1
0
votes
0
answers
25
views
Create a Transition/Mobility Matrix for a Panel Data
I am seriously stuck and need some help. If you can help me, I am open to any help or any solutions in Python, R, Stata, or Excel. I have panel data containing different waves of a survey, and this ...
0
votes
2
answers
121
views
Structure of Results Appear to Change Based on Query
If I run this query: https://api.data.gov/ed/collegescorecard/v1/schools?latest.school.city=Los Angeles&api_key=XXXXXXXXXXX, then the results look something like this:
However, if I run this ...
0
votes
0
answers
8
views
Compile-able Dataset for static analysis framework
I am searching for an open dataset of compile-able source code (meaning all code files are present to be fully compiled and linked) and their vulnerability CVE as a label.
most datasets I find either ...
0
votes
1
answer
27
views
Is there a way to retrieve navigation data from Google Maps e.g. to R?
How would an HTTP request or API request retrieve navigation data from Google Maps? Are there some simple lines of code for that? Let's say I want to give an input of origin and destination address, ...
0
votes
1
answer
12
views
R: sampling using dbinom(y-0:200)
In R:
I have a sample (y) of length 1e4.
y = sample(0:200, 1e4, replace = TRUE)
I have plugged this sample into:
dbinom(y-x,100,0.3)
However, I would like to gather samples from this function but ...
- 1
-1
votes
1
answer
36
views
R or Excel: Calculate difference between dates
I have a list of course completion dates (person, start, end) in the following format (exemplary):
Person X || Sept 21, 2021 06:30 PM || Sept 21, 2021 06:50 PM
Now I'd like to calculate the overall ...
- 1
0
votes
0
answers
14
views
R cannot allocate vector. Where is the object?
I misjudged how much memory would be required and my computer ran out of memory when R was 76% done with an lapply function. Is there a way to recover and saveRDS the object or do I have to start over ...
- 1
1
vote
1
answer
207
views
How can I get completion rate data from all colleges and cohorts in a longitudinal format from college scorecard? (with R)
What I want:
To obtain a R dataframe with completion-rate data from all colleges in the US (or all the colleges that have available data in college scorecard datalake).
What I expect:
A data frame in ...
- 111
0
votes
2
answers
137
views
Weekly temperature data for Europe on a regional level NUTS 1
I am currently writing my thesis on how temperature affects mortality in Europe.
I obtained an excellent dataset from the Eurostat Database containing weekly Mortality numbers on NUTS1 level (regions)....
0
votes
1
answer
31
views
List of software and versions for test data
Does anybody know where I can find some sample data to use as stub data for my application to test with I don't want it to be just random strings and numbers?
I was originally going to user Microsoft &...
1
vote
0
answers
12
views
Is there a way to match ICD-10 Diagnosis Codes with available Rx treatments?
Ideally tabling both the generic and branded drug names.
- 11
0
votes
2
answers
209
views
German nouns gender source
I want to create some sort of spell checking program for German language, for which i need a database with all the words and their gender description(only their gender description) to cross reference ...
- 9
1
vote
0
answers
23
views
Most frequently used programming language commands in Python
I am looking for a dataset which lists the most often used commands for Python in terms of their relative frequency.
Sample result could look like:
| Function name| Relative Frequency
|:------------...
- 121
1
vote
0
answers
80
views
Where can I find task duration (estimate) data?
Scenario
In an endeavour to compare a basic regression with a more advanced Ensemble Network of classifiers, I am looking for (a) data(set) that contains:
Task description
Measured task duration
(...
- 141
1
vote
1
answer
107
views
Unzipping the openfda data in R
I've downloaded all the url's for the different drug-event pairs, but they all end in .zip.
Does anyone know how to automate pulling the .json file out of these zip files without doing it manually for ...
- 11
1
vote
0
answers
22
views
Csv format easy colums characteristic - type dataset for beginner R analisys
I had a look on kaggle but I did not find what I was looking for. I need a very simple data set, like the one of "iris" default pre-sets of R where you have differents columns with some characteristic ...
- 111
1
vote
0
answers
47
views
Aggregate Willmott and Matsuura Temperature Climate Data on Country Level
I'm looking for monthly, mean temperature data on the country-level since 1900 (or at least 1950) for which the temperature is weighted according to population density.
The common database for the ...
- 11
3
votes
2
answers
138
views
Bounty Programs for Open Source Projects
I am interested in data that contains bounties or paid rewards for specific programming tasks in open source projects. Ideally, the data would contain a description of the task, the amount of the ...
- 1,214
0
votes
2
answers
396
views
Searching for Directed acyclic graph data
I need some DAG graph for my research. The representation of the graphs is needed to be in edge-list representation.
- 101
1
vote
0
answers
126
views
average ingredients for each drug in each year for a specific manufacturer
I want to count the average number of ingredients in each drug produced by a specific manufacturer in each year.
The results I want should be like this:
year | drug_names | avg_number_of_ingredients
...
- 111
2
votes
1
answer
32
views
Which is the best way to work with NCBI data obtaining online partial information from the whole
I was trying to create a database from NCBI Nucleotide bank. I did a query which gave me 1124 results.
From each single result I was wanting to obtain only the items realted to Accesion Country and ...
Paulo Cecco
0
votes
1
answer
36
views
Where can I find grid file of the Netherlands for R
I'm looking for a grid file (ideally 5x5 km) of the Netherlands, because I want to do kriging interpolation in R.
Where can I find that?
- 11
4
votes
1
answer
73
views
Site that provides up to date list of programming languages/frameworks to open source repositories using it?
When you are learning how to program in a certain language or with a particular framework, it is very useful to have an actual real-world example of that project being used somewhere in the open ...
3
votes
2
answers
326
views
Historical Walmart Stores Data set
I'm trying to capture a historical list of Wal-mart stores. I need store ID, store name, longitude, latitutde, address, city, state, zip, services, store opening date, and store closing date (if the ...
- 31
0
votes
3
answers
227
views
How to link postcode to broader geographical area in the United Kingdom
I have a dataset of companies, where one of the variables is its postcode. I want to link this postcode to a broader geographical unit. I have shapes file that enables me to map such broader ...
- 178
1
vote
0
answers
45
views
Download clean coordinates from Wikipedia Map Module: … detailed map
I would like to know if there is a way to either download/scrape a clean CSV with coordinates and controlling group from Wikipedia conflict maps, or how to generate an ESRI shapefile from the Lua ...
- 31
2
votes
3
answers
98
views
How to get all U.S. census blocks within a state
Is there an easy way to download the set of census blocks (12-digit FIPS codes) for a given state? I've tried using R packages tigris and acs to no avail. (Well, tigris works but it gives me the ...
- 121
5
votes
1
answer
172
views
Does this violate copyright of music/lyrics/sound?
So, we are beginning to create a Karaoke app. And we have few queries in the copyrights aspect. We would like to have these cleared before we get any further with our app's development.
The decided ...
- 103
3
votes
1
answer
259
views
College scorecard only has 40 states?
So I just downloaded the college scorecard datasets and import into R, I used a unique() function on "STABBR" and it only returned 40 unique values for states, what happened here?
- 31
4
votes
0
answers
40
views
Images with symmetry parameters
I wrote a program that searches for aesthetic pictures.
One of my parameters is how much a picture is symmetrical.
This picture is taken from 33Pol (from Iran-Isfahan). As can be seen, the water ...
- 141
2
votes
1
answer
279
views
Mapping PUMA Codes to TIGER/line shapefiles
I downloaded PUMA mapping shapefiles for California from TIGER/line and am able to use R packages maptools, mapproj, and ggplot2 to plot maps of California with each PUMA outline as a border. My goal ...
- 23
3
votes
2
answers
5k
views
Get Historic Temperature Data by GPS and Timestamp Using R
I have a dataset:
ID Time Lat Long
a 2016-06-01 10:35:26 41.79925 -71.33052
a 2016-06-01 10:35:57 41.80174 -71.33307
a 2016-06-01 10:37:30 41....
- 33
3
votes
3
answers
5k
views
Seasonal Sales Data for time Series Analysis
I am looking for a typical sales data set, which I can use for a time series prediction. I especially want to show how to decompose the seasonal component.
A good example would be a fictional company, ...
1
vote
0
answers
16
views
Dbscan time duration gauge
I'm running a Dbscan. On a matrix that's 10333 by 10333, using an epsilon value of 50. Is there any way to gauge how long this will take? It's been running for the past 8 hours now. Also does it ...
- 41
3
votes
1
answer
92
views
How to Geocode coordinates?
I need a way to obtain the coordinates for all of one type of store/restaurant in a country. For example, all the McDonald's in South Africa.
I'd like to use R or any tool that is more appropriate. ...
- 41
3
votes
3
answers
159
views
Introduction to Statistical Thought - med.1000 dataset
Does anyone know where the med.1000 dataset used in the Introduction to Statistical Thought book (by Lavine, PDF) comes from?
I just can't seem to find it with Google!
It contains measurements of ...
- 51
6
votes
2
answers
77
views
Popularity of programming libraries
There are so many libraries, for instance for C# networking or Java encryption.
I am looking for data about the "popularity" of published libraries.
Any measure of "popularity" is fine, for instance ...
- 8,366
2
votes
2
answers
203
views
Looking for specific Sales Dataset
I am relatively new to programming and therefore don't really know where to find specified datasets. What I am basically looking for is Sales Data from any Company (can be made up).
The data needs ...
3
votes
1
answer
38
views
Matching 1980s address data to 1990 census geoid10?
I am hoping to match a list a addresses gathered in the mid 1980s with block group codes from the 1990 census. The geocoder on the census website processes this for 2010 block group designations only. ...
- 161
2
votes
1
answer
321
views
Can anyone HELP provide codes to import 'CHARTEVENTS' and 'NOTEEVENTS' in sas or R?
I tried R and SAS to import these two datasets, but the programming runs forever. I could not open in excel either. Can anyone provide codes to import these two table: 'CHARTEVENTS' and 'NOTEEVENTS' ?
- 21
5
votes
1
answer
127
views
Solved Programming Challenges Dataset
I'm looking for a dataset of solved programming challenges, like the ones on http://codeeval.com. The dataset should have the natural language description of the problem and N solutions for each ...
- 171
4
votes
1
answer
226
views
Load NSF Research Award Abstracts in Python or R
I want to work on NSF Research Award Abstracts 1990-2003 Data Set in R. Every record of the data is stored in a text file and text files are grouped in folders (See data files here)
Is there any easy ...
- 261
4
votes
1
answer
87
views
Where is the real beginner's guide
I am trying to learn something about how APIs work. I was told that DOL has the best API and supporting documentation in the federal government.
So here I am, on page 1 of the beginner's guide, and ...
- 41
3
votes
0
answers
59
views
Are there any examples or best practice for encapsulating large open data sets into R packages?
I've recently been experimenting with UK government open data with R, and it seems like I could usefully wrap up some of my work into an R package.
I'd want the package to download the data either ...
1
vote
0
answers
636
views
Using Google's Custom Search api [closed]
I am currently working for a social media site. We would like to use Google Custom Search Engine API and derive analytical insights from the results. My choice of development platform is R or Python. ...
- 11
7
votes
2
answers
210
views
Data on hurricanes?
As a programmer and meteorology enthusiast, I'd love to be able to get latitude/longitude of tropical storms/hurricanes (specifically in the Atlantic). Does anyone know of websites that can provide ...
- 173