Questions tagged [python]

For all questions and requests concerning or related to Python, a highly readable and dynamic, general purpose programming language.

26 questions with no upvoted or accepted answers
Filter by
Sorted by
Tagged with
3 votes
0 answers
372 views

Scraping data from a PDF in HTML - table recognition

I have a simple looking table in a pdf file: one column containing company names. I don't know how many there are in each group but groups are separated by a bold line (the lower border of a table). ...
  • 153
2 votes
1 answer
30 views

Which is the best way to work with NCBI data obtaining online partial information from the whole

I was trying to create a database from NCBI Nucleotide bank. I did a query which gave me 1124 results. From each single result I was wanting to obtain only the items realted to Accesion Country and ...
user avatar
2 votes
0 answers
62 views

data.gov CKAN API ignores row parameter, returns duplicate results for different search terms

Using the data.gov CKAN api, this search via the web GUI returns 566 results: children However, post requests via the CKAN API returns 10 results despite the row parameter being set and, incidentally,...
  • 121
1 vote
0 answers
21 views

GIS Data on US College Dormitories

I am trying to find spatial data on all (or as many as possible) US college dormitories. Specifically, I want to find the location as a polygon or centroid. I have tried a few methods to acquire this ...
  • 111
1 vote
0 answers
32 views

Accessing DOL State Unemployment Insurance Weekly Claims Data

I would like to access weekly data for unemployment claims through the DOL API (Department of Labor), listed here: https://oui.doleta.gov/unemploy/claims.asp I'm able to get national data by using ...
1 vote
0 answers
40 views

Getting partial data from department of labor API

In trying get data from this API (I have a token..): https://devtools.dol.gov/APISampler/Home/Index1?datasetName=OUI%20Initial%20Claims It seems that I'm not getting all the data, the latest year I ...
1 vote
1 answer
263 views

Wind forecast over land accessible through python API

I would like to automatically fetch wind speed forecast data over my town with a python script. I am looking for an available dataset and API to do so. It is for a small personal project, so it is ...
  • 111
1 vote
1 answer
88 views

State Area for 2010 Census AREALAND variable not found

I was following this tutorial for requesting from the 2010 Decennial Census. It specifies the following code for printing a list of state names ("NAME"), state areas ("AREALAND"), and state total ...
1 vote
0 answers
22 views

data with video to text transcription

I search data and script (java, python) where from video, text is transcripted into documents.I.E recognize speech from video to text i found this https://github.com/Naki21/google-speech-to-text but ...
  • 31
1 vote
0 answers
32 views

Where can I find data to create small sample drug database?

For my diploma thesis I want to build an application to control medicine dosage and to do this I think about making sample database with like 1000 medicines with info most importantly about a dosage (...
1 vote
0 answers
21 views

Is there any API, tool, websites that i can find how many German people moved to United States in recent 10 years?

I need to do geographical population analysis on how many German people recently moved to US and started to living there, especially to the California. I know US government has open data policy but so ...
1 vote
0 answers
61 views

Open source weather database for predict crop disease?

I have started to work on forecasting models for precision agriculture. My goal is to train a model which uses temperature, relative humidity, and rainfall to predict when late blight (Phytophthora ...
  • 111
1 vote
0 answers
124 views

average ingredients for each drug in each year for a specific manufacturer

I want to count the average number of ingredients in each drug produced by a specific manufacturer in each year. The results I want should be like this: year | drug_names | avg_number_of_ingredients ...
  • 111
1 vote
0 answers
108 views

CKAN : ValueError: VDM only works with SQLAlchemy versions 0.4 through 0.9, not: 1.1.2

Do I need to upgrade the package vdm to make it compatible with sqlalchemy version greater then 0.9? This is a CKAN question.
  • 31
1 vote
2 answers
88 views

Dataset of lines at n miles from the coast

I'm using Folium to generate some interactive maps with ocean data. One of the restrictions I am facing is that the objects, I plot has to be at-least at 5, 6, .., n miles from the coast, hence I am ...
1 vote
0 answers
23 views

Are there any available lexical databases for English, containing predicate-argument (relation-role) information?

I am looking for a database (something like WordNet) containing predicate-arguments information (also known as relations-roles). I.e. what are the arguments of a given predicate? For example, loves(...
1 vote
1 answer
221 views

Dict not able to return data from college scorecard API

So I've been working on a page which displays a school's name, url, city, state, zip, and student size via College Scorecard API but I'm getting tons of errors instead. However, the program is able to ...
  • 21
1 vote
0 answers
77 views

To fetch bigger dataset from twitter

I need twitter data for my project, but with streaming api I am able to get only 15 min window frame.Hence a very smaller sample space. I have a written code in python as follows import tweep from ...
1 vote
0 answers
53 views

How can I deploy a sci-kit learn model when the data in use are .csv files?

I am dealing with accelerometer data (csv) as well as audio data stored in FTP server coming from an android app. Data is loaded from FTP in my notebook for exploratory analysis to extract features ...
0 votes
0 answers
4 views

ETS model in statsmodels library

I have several questions regarding the ETS model in statsmodels library. The description of the model can be found here. The default initialization_method is estimated. In the description, it says ‘...
0 votes
0 answers
10 views

data.dol.gov/get 'invalid API key' (python)

I keep getting an 'Invalid API key' response when trying to make a call to the data.dol.gov v2 API. Here is what my call looks like, please help! base_endpoint = 'https://data.dol.gov/get/' ...
  • 1
0 votes
0 answers
8 views

Extreme hyperparameter tuning for XGBoost

One important skill is to know how to build models that would produce good results, and not take a whole day to run at the same time. That said, I have time, and I want to try lots of hyperparameter ...
  • 1
0 votes
1 answer
55 views

Wikidata dump in another language

I am aware that you can download a Wikidata dump file from here But is it possible to only include results for a specific language?I have in the past worked with a json dump file and used python to ...
0 votes
0 answers
12 views

2020 FBI Hate Crime Tables?

I'm sure most of us are familiar with the data the FBI provides. A while back the FBI "released" the 2020 data, but it's missing from their website. If you go to the link https://ucr.fbi.gov/...
0 votes
1 answer
121 views

how I can read the content of the dataset in pkl file and return 67 sparse matrix of type '<class 'numpy.int64'>'in python?

I have a dataset in pkl file, and I write the following code to unpkl the file and read the data import pickle f=open("data_cdg.pkl","rb") a = pickle.load(f) f.close() print(a) ...
0 votes
1 answer
482 views

Scraping sec filings

I'm trying to scrap all the historical filings of a particular Central Index Key (CIK) using python but I get http error codes. First, I got 403 error, I resolved by using requests session and timing ...