Questions tagged [scraping]
The scraping tag has no usage guidance.
12
questions
0
votes
0
answers
51
views
Is there a way to scrap AirBnB listings using R?
I would like to construct a dataset of airbnb listing locations (coordinates) for a specific area. I have tried using the R script at this link, but unfortunately does not work: https://gist.github....
- 237
0
votes
0
answers
15
views
What are some good web scraping services in 2023?
I'm trying to find a webscraper which allows me to comply with Canada's anti-spam laws (CASL) for emailing. My goal is to build connections with other companies. I want to bulk upload company websites ...
0
votes
1
answer
27
views
Is there a way to retrieve navigation data from Google Maps e.g. to R?
How would an HTTP request or API request retrieve navigation data from Google Maps? Are there some simple lines of code for that? Let's say I want to give an input of origin and destination address, ...
1
vote
1
answer
56
views
Programmatically retrieving VFR/IFR Charts from FAA
I am trying do the following:
Subscribe and be alerted when a new version of the VFR and IFR charts are available from the following websites:
https://www.faa.gov/air_traffic/flight_info/aeronav/...
- 11
0
votes
1
answer
33
views
Identifying parameters accepted by API request
I'm playing around with the data.gov API and was trying to reconstruct a API request from the websearch.
ex: COVID-19 datasets filtered by Texas
my url looks like
https://catalog.data.gov/dataset?q=...
1
vote
0
answers
83
views
Shapefile for Petrol Fueling stations across Europe
I'm looking for petrol stations across Europe either in a shapefile format, coordinate data as .csv or addresses from a webpage which I can scrape.
I have had a look and couldn't find anything that ...
- 111
1
vote
0
answers
28
views
GIS Data on US College Dormitories
I am trying to find spatial data on all (or as many as possible) US college dormitories. Specifically, I want to find the location as a polygon or centroid. I have tried a few methods to acquire this ...
- 111
0
votes
1
answer
565
views
Scraping sec filings
I'm trying to scrap all the historical filings of a particular Central Index Key (CIK) using python but I get http error codes.
First, I got 403 error, I resolved by using requests session and timing ...
- 101
1
vote
0
answers
29
views
Seeking live bar/ restauarant UK data API for ML application
Looking for an API I can use to create a bar/restaurant recommendation app in the UK, with the possibility of commercial use.
Will need to train a model on this data which may necessitate the "...
- 111
1
vote
3
answers
73
views
Wikipedia referenced articles in computer readable format?
A huge number of news related wiki pages contain article references (for example this article on the 2017 Equifax data breach) and I would like to obtain the following data from the references section ...
- 111
1
vote
0
answers
15
views
Options for analyzing twitter hashtag use by various factors - date of account creation, location, username strings and even defined user lists
I am not sure if this question is better suited for data science but I'm mostly looking for an outline of what currently is or is not possible and a direction for where I should learn more.
My first ...
- 11
1
vote
1
answer
505
views
How do I get historical data from coinmarketcap.com?
If you scroll down on this page:
https://coinmarketcap.com/historical/20150503/
There is something that says: Total Market Cap: $3,863,780,096
Notice the date is given in the URL. How can I loop ...
- 11