Skip to main content
Share Your Experience: Take the 2024 Developer Survey

Questions tagged [internet]

For questions specifically related to the Internet or the World Wide Web.

Filter by
Sorted by
Tagged with
1 vote
0 answers
8 views

Global VPN Datasets

I am looking for data sets related to VPNs on a global scale, with an incredibly broad set of guidelines. Sets of IP addresses associated with known VPNs, overall traffic analysis with focus on VPN ...
shea's user avatar
  • 11
0 votes
0 answers
15 views

Daily Internet usage datasets

I am looking for data that measures the density of internet usage (packet exchanges) throughout a day. Could be from anywhere in the world, from any time period, reflecting any range of devices, and ...
shea's user avatar
  • 11
0 votes
1 answer
43 views

Need dataset online returns

Hi i am looking for online sales return dataset for canada or US for my client project. Anything similar to online return maybe ups or fedex returns will also work. Please help onnthis
Gurjinderpal Singh's user avatar
0 votes
2 answers
93 views

Dataset for Swiss (.ch) domain names with basic traffic stats

Where can I find Swiss website domains with .ch and with some basic stats about popularity?
philshem's user avatar
  • 17.6k
0 votes
1 answer
187 views

Catalog of all websites on the entire internet

Needs For a project, I am trying to run analysis on a representative sample of all websites on the entire internet. I'm trying to do things like measure market penetration of certain web technologies,...
John's user avatar
  • 3
1 vote
0 answers
22 views

What is the next step in the decentralization of education about data analytics?

Recently, ArXiv partnered with Github to host links to repos implementing theory contained in papers (possibly eliminating the need for universities and formal education). What is the next step in ...
tdMJN6B2JtUe's user avatar
1 vote
0 answers
44 views

Where can I find statistics for Facebook and YouTube total views worldwide like those of Wikipedia?

I am working on a research program about social media traffic and my mission is to find official usage data for major platforms like YouTube, Facebook, Twitter, Wikipedia etc. Wikipedia provides ...
thanasis's user avatar
1 vote
0 answers
19 views

Is there a good (free) way to see site and/or search traffic? [duplicate]

Several years back, if memory serves, I was able to access on Google, the site traffic or search traffic for a wide number of large corporations. This was through a portal (I think Google Analytics, ...
Crowdpleasr's user avatar
0 votes
2 answers
188 views

Dataset for German domain names (.de)

I'm looking for a new DNS domain in Germany (.de) for a new service. It would be very helpful to search .de domains using wildcards (regular expressions), e.g. mysuperservice[0-9]+.de mysuper-[a-z]+-...
WeSee's user avatar
  • 459
3 votes
1 answer
4k views

List of all http sites in the world

I've tried inurl:http but it takes forever to get even a bunch of sites right and I have to think of new keywords everytime to get the sites. Is there kind of a directory I could use to get the ...
Ayush gangwar's user avatar
2 votes
3 answers
85 views

Looking for suggestions of sources for data science project

I'm currently taking a first step into Data Science, and studying a specific computational method, I'm a math student, but I'm looking for reliable data sources, and if related to biology (e.g public ...
Daniel Moraes's user avatar
1 vote
1 answer
47 views

HTTP Response Codes

For a data visualization, I'm looking for http response codes. There are many sources of this dataset, but I'm looking for machine readable (JSON preferred) reliably updated (so that my dataviz is ...
philshem's user avatar
  • 17.6k
3 votes
0 answers
26 views

Internet speed in the united states

I am trying to find geolocated internet speed data. What data sources are available? I've found: FCC data: problematic because it's provided by ISPs. Measurement Lab: Open source testing by ...
user12346's user avatar
1 vote
3 answers
73 views

Where can I find website analytics logs for research?

I am doing some research into some machine learning algorithms that can be used to analyze website logs. A friend gave me access to his Google Analytics, but all I see are reports and I am not able ...
jason's user avatar
  • 119
0 votes
2 answers
519 views

List of socks4/5 proxies in a plain text

I'm looking for list of public socks proxies in the plain text or another format which can be imported via curl. I have tried extract it using script such as: $ pup -f <(curl -sL https://www....
kenorb's user avatar
  • 431
1 vote
1 answer
62 views

DNS request sample traffic

I am trying to find a dataset about DNS request, which is created by any group of users during a period (a week or a month...). For example: employers in a selected company used the internet and ...
Truong Nguyen's user avatar
1 vote
0 answers
639 views

Looking for customer service chat dataset [duplicate]

I am looking for specific customer support chat dataset or question answers dataset, for example network support, hardware, software support, ticket remedy chats etc. I need to mine the data for ...
Aakash Gupta's user avatar
2 votes
1 answer
47 views

Internet Peering Locations

Is there any dataset about worldwide Internet Interconnection locations? Some information about the average or maximum switching capacity would be nice. I found a map (and raw data) about seacables (...
Quanten's user avatar
  • 23
2 votes
0 answers
132 views

Available datasets for HTTP headers

I would like to know if there are any publicly available datasets with HTTP header data, such as URI, user-agent, referer, content-length, etc-- I've tried searching with the usual keywords to no ...
tunawolf's user avatar
2 votes
0 answers
148 views

Looking for historical weather forecasts

I am looking to write a report about the accuracy of weather forecasts. I have already found several source that provides data for actual weather in different locations, but I am having difficulty ...
Null_Error's user avatar
1 vote
1 answer
252 views

Opengeocode.org account has been suspended?

Does anyone know what has happened to opengeocode.org The well used website is showing that the account has been suspended
Martin Hügi's user avatar
1 vote
3 answers
320 views

List of symbols with corresponding names

I am searching for wording for symbols icons and what they are. For example, if you have a symbol such as flag, or types of cars. I want to look it up online and search for the name of that symbol. I ...
PROBERT's user avatar
  • 1,295
3 votes
1 answer
130 views

Are there any public agencies which are currently streaming real-time video data?

I'm engaged in a discussion with the network security department at a public agency with the goal of making their live video data publicly available on the Internet; currently the data never leaves ...
igal's user avatar
  • 133
3 votes
1 answer
69 views

What is the percentage of internet users in the USA? Discrepancy between Google result and World bank data

The Google default results for "internet user United States" is 84 % of the population. The source is the World Bank, but when I go to the World Bank website, it shows only 74% internet users in the ...
Paul Rougieux's user avatar
3 votes
0 answers
39 views

Cellular data subscription costs

The US Census July 2013 Computer and Internet Use Supplement surveys US households and asks "How much does your Internet service provider charge you per month?" From this, I can get an empirical ...
ff524's user avatar
  • 131
1 vote
0 answers
69 views

Can I get dataset of google queries asked by people in a particular time period?

I am doing a research on how queries have evolved over time(focusing on google mainly). I want to compare what queries people searched on google last year and compare it to what they are searching ...
user avatar
3 votes
1 answer
225 views

Ookla/NetIndex data dump

A wonderful resource that earlier used to exist for researching global Internet speed and quality was Ookla's NetIndex. Ookla has discontinued public download, I believe since 2015. Does anyone have a ...
user3671's user avatar
  • 131
7 votes
1 answer
692 views

Anti-infringment IP list

I am looking for an up-to-date, gratis anti-infringment IP list, i.e., a list of IPs of organizations searching for copyright infringement through peer-to-peer networks. https://www.iblocklist.com/...
Franck Dernoncourt's user avatar
3 votes
1 answer
71 views

Data about what kind of entities appear on public web pages

Schema.org is a vocabulary "for describing the kind of entities the most common web applications need" (source). But which entities would that be? Intuitively I’d say the most common entities are ...
unor's user avatar
  • 374
3 votes
3 answers
2k views

Dataset for Device fingerprints?

For research purposes, I'm looking for Device Fingerprint datasets. A device might be a browser, a headless browser or even a network library capable of HTTP traffic. A device fingerprint might ...
mork's user avatar
  • 133
1 vote
0 answers
47 views

Getting metadata of all databases available on the Internet [closed]

I would like to get metadata for all (or as many as possible) databases that are available online. It does not have to be an open database. It is only the metadata that is important for me. The data I ...
Sayid's user avatar
  • 173
2 votes
0 answers
164 views

Cyber-attacks with demand dataset

I am looking for a dataset containing a list of cyber-attacks were attackers made a demand (e.g., a ransom), with as many following fields as possible: date of attack duration of attack date of ...
Franck Dernoncourt's user avatar
2 votes
1 answer
65 views

Average Internet Download Speeds for All Countries

I've already explored Akamai's State of the Internet Reports and the ITU's ICT Indicators Database, and tried to access Ookla's old data which is not offline. Is there anyone who can recommend where I ...
EnglishTeacherEric's user avatar
2 votes
1 answer
56 views

Wireshark capture files

I am looking for Ethereal / Wireshark / tcpdump captures (.pcap or .pcapng files) for training purposes. They should cover a wide range of protocols on all OSI layers. Those files would be analyzed by ...
Thomas Weller's user avatar
5 votes
1 answer
207 views

database of email domain aliases?

I'm working on a problem merging some internal customer data on email address. However, I know that different email address can resolve to the same person. Some examples are: mapping a vanity domain ...
Kevin Hakanson's user avatar
4 votes
0 answers
104 views

The graph of the web: the dataset of links between web pages

I was looking for the dataset of links between web pages and found these options: Common Crawl: Public web crawling data. It includes "the HTTP headers returned and the links (including the type of ...
Anton Tarasenko's user avatar
6 votes
1 answer
103 views

Website visitors statistics

Alexa and Quantcast (and their alternatives) offer limited web statistics for free. For example, Alexa shows one-year data on a website's rank in Alexa's top. You can also download their million of ...
Anton Tarasenko's user avatar
4 votes
1 answer
332 views

Find a missing dataset: "A Week in the life of a browser - Version 2" from Mozilla Labs

It's come up as an answer for two questions: Open, big time-series dataset (ideally web traffic) Where I can find a repository of software usage/execution logs (traces)? Here is the main page: A ...
philshem's user avatar
  • 17.6k
7 votes
2 answers
268 views

Does there exist a set of data that measures internet traffic that is specific to image downloading and uploading?

I am currently writing a report, I would like to make a claim which I am struggling to back up: The volume of image data transferred digitally has increased as the internet has become more ...
HBeel's user avatar
  • 203
3 votes
1 answer
190 views

Open Data about the internet

Does anyone know where one can find (if any is available) open data about the internet, and generally any data about tier1 infrastructure, i.e internet backbone nodes with capacity, coordinates Also ...
Lars Anundskås's user avatar
6 votes
2 answers
4k views

Database of free WiFi hotspots

I want to create an app that shows free WiFi hotspots around you, even if you have no Internet connection yet. So, I need a re-distributable database of free WiFi hotspots for the whole world. For ...
Nicolas Raoul's user avatar
  • 8,436
7 votes
1 answer
706 views

Where can I find publicly available data about internet usage?

I'm searching for a data set in the public domain that quantifies degree of internet usage on a global basis for small geographic areas. For example is there a data set that shows total traffic (e.g. ...
hughesdan's user avatar
  • 213
5 votes
2 answers
1k views

Open, big time-series dataset (ideally web traffic)

I'm working on a project for automatically identifying and sorting web analytics incidents. As part of testing of the software, I'm looking for time-series dataset (ideally >100K rows) with daily ...
Stergios's user avatar
  • 131
2 votes
0 answers
120 views

Is there any publicly available dataset of the student behaviors in massive online courses like Coursera?

I need dataset of the student behavior in the massive online courses. By searching the internet, most of data I find about online courses is just the course information. But what I want is the student ...
apogne's user avatar
  • 121
2 votes
1 answer
40 views

Data showing what JavaScript operations are usable in what browser

I am looking for compatibility data about browsers: Does browser Firefox 32 support createDocumentFragment()? Does browser Internet Explorer 5.5 support querySelectorAll()? etc Data should be easily ...
Nicolas Raoul's user avatar
  • 8,436
3 votes
1 answer
140 views

Fiber (dark or lit) maps and data

I'm looking for any publicly available data on where optical fiber (for Internet connectivity) is physically laid across the US. While there are commercial services that sell some of this data, and ...
user2565476's user avatar
3 votes
4 answers
221 views

Resolve company name / TLD to industry?

Where can I find a comprehensive data set of U.S. companies with their respective industries and internet top level domains (TLDs), if any? Such as the Fortune 500 list... Company Name Website ...
Max's user avatar
  • 131
6 votes
1 answer
202 views

Domain Name System Record A database

Searching for a IP to TLD database lookup that is from an source that provides updates & archives. Possible this might require a number of sources, since I'm looking for all TLDs.
blunders's user avatar
  • 317
2 votes
2 answers
718 views

IP addresses of backbone routers

How would I go about finding a dataset of IP addresses of backbone routers? Looking around on Google didn't seem to help. Is this information available somewhere?
lynvie's user avatar
  • 123
13 votes
7 answers
5k views

Dataset of domain names

There are many web resources to find domain names (whois.com), and using the WHOIS protocol there are some APIs. Some examples are the unix command line tool jwhois and the python library pywhois. ...
philshem's user avatar
  • 17.6k