Questions tagged [internet]
For questions specifically related to the Internet or the World Wide Web.
56
questions
0
votes
1
answer
19
views
Need dataset online returns
Hi i am looking for online sales return dataset for canada or US for my client project. Anything similar to online return maybe ups or fedex returns will also work. Please help onnthis
0
votes
2
answers
91
views
Dataset for Swiss (.ch) domain names with basic traffic stats
Where can I find Swiss website domains with .ch and with some basic stats about popularity?
- 17.6k
0
votes
1
answer
166
views
Catalog of all websites on the entire internet
Needs
For a project, I am trying to run analysis on a representative sample of all websites on the entire internet. I'm trying to do things like measure market penetration of certain web technologies,...
- 3
1
vote
0
answers
22
views
What is the next step in the decentralization of education about data analytics?
Recently, ArXiv partnered with Github to host links to repos implementing theory contained in papers (possibly eliminating the need for universities and formal education). What is the next step in ...
- 111
1
vote
0
answers
44
views
Where can I find statistics for Facebook and YouTube total views worldwide like those of Wikipedia?
I am working on a research program about social media traffic and my mission is to find official usage data for major platforms like YouTube, Facebook, Twitter, Wikipedia etc.
Wikipedia provides ...
- 11
1
vote
0
answers
19
views
Is there a good (free) way to see site and/or search traffic? [duplicate]
Several years back, if memory serves, I was able to access on Google, the site traffic or search traffic for a wide number of large corporations. This was through a portal (I think Google Analytics, ...
- 111
0
votes
2
answers
174
views
Dataset for German domain names (.de)
I'm looking for a new DNS domain in Germany (.de) for a new service.
It would be very helpful to search .de domains using wildcards (regular expressions), e.g.
mysuperservice[0-9]+.de
mysuper-[a-z]+-...
- 459
3
votes
1
answer
3k
views
List of all http sites in the world
I've tried inurl:http but it takes forever to get even a bunch of sites right and I have to think of new keywords everytime to get the sites.
Is there kind of a directory I could use to get the ...
2
votes
3
answers
85
views
Looking for suggestions of sources for data science project
I'm currently taking a first step into Data Science, and studying a specific computational method, I'm a math student, but I'm looking for reliable data sources, and if related to biology (e.g public ...
- 123
1
vote
1
answer
47
views
HTTP Response Codes
For a data visualization, I'm looking for http response codes. There are many sources of this dataset, but I'm looking for
machine readable (JSON preferred)
reliably updated (so that my dataviz is ...
- 17.6k
3
votes
0
answers
26
views
Internet speed in the united states
I am trying to find geolocated internet speed data. What data sources are available?
I've found:
FCC data: problematic because it's provided by ISPs.
Measurement Lab: Open source testing by ...
- 31
1
vote
3
answers
69
views
Where can I find website analytics logs for research?
I am doing some research into some machine learning algorithms that can be used to analyze website logs.
A friend gave me access to his Google Analytics, but all I see are reports and I am not able ...
- 119
0
votes
2
answers
504
views
List of socks4/5 proxies in a plain text
I'm looking for list of public socks proxies in the plain text or another format which can be imported via curl.
I have tried extract it using script such as:
$ pup -f <(curl -sL https://www....
- 431
1
vote
1
answer
61
views
DNS request sample traffic
I am trying to find a dataset about DNS request, which is created by any group of users during a period (a week or a month...).
For example: employers in a selected company used the internet and ...
1
vote
0
answers
638
views
Looking for customer service chat dataset [duplicate]
I am looking for specific customer support chat dataset or question answers dataset, for example network support, hardware, software support, ticket remedy chats etc. I need to mine the data for ...
- 11
2
votes
1
answer
47
views
Internet Peering Locations
Is there any dataset about worldwide Internet Interconnection locations?
Some information about the average or maximum switching capacity would be nice.
I found a map (and raw data) about seacables (...
- 23
2
votes
0
answers
118
views
Available datasets for HTTP headers
I would like to know if there are any publicly available datasets with HTTP header data, such as URI, user-agent, referer, content-length, etc--
I've tried searching with the usual keywords to no ...
- 21
2
votes
0
answers
136
views
Looking for historical weather forecasts
I am looking to write a report about the accuracy of weather forecasts. I have already found several source that provides data for actual weather in different locations, but I am having difficulty ...
- 41
1
vote
1
answer
251
views
Opengeocode.org account has been suspended?
Does anyone know what has happened to
opengeocode.org
The well used website is showing that the account has been suspended
- 169
1
vote
3
answers
315
views
List of symbols with corresponding names
I am searching for wording for symbols icons and what they are. For example, if you have a symbol such as flag, or types of cars. I want to look it up online and search for the name of that symbol. I ...
- 1,295
3
votes
1
answer
129
views
Are there any public agencies which are currently streaming real-time video data?
I'm engaged in a discussion with the network security department at a public agency with the goal of making their live video data publicly available on the Internet; currently the data never leaves ...
- 133
3
votes
1
answer
68
views
What is the percentage of internet users in the USA? Discrepancy between Google result and World bank data
The Google default results for "internet user United States" is 84 % of the population.
The source is the World Bank, but when I go to the World Bank website, it shows only 74% internet users in the ...
- 173
3
votes
0
answers
39
views
Cellular data subscription costs
The US Census July 2013 Computer and Internet Use Supplement surveys US households and asks "How much does your Internet service provider charge you per month?" From this, I can get an empirical ...
- 131
1
vote
0
answers
69
views
Can I get dataset of google queries asked by people in a particular time period?
I am doing a research on how queries have evolved over time(focusing on google mainly). I want to compare what queries people searched on google last year and compare it to what they are searching ...
kapil kumar
3
votes
1
answer
223
views
Ookla/NetIndex data dump
A wonderful resource that earlier used to exist for researching global Internet speed and quality was Ookla's NetIndex. Ookla has discontinued public download, I believe since 2015. Does anyone have a ...
- 131
7
votes
1
answer
652
views
Anti-infringment IP list
I am looking for an up-to-date, gratis anti-infringment IP list, i.e., a list of IPs of organizations searching for copyright infringement through peer-to-peer networks.
https://www.iblocklist.com/...
- 7,740
3
votes
1
answer
71
views
Data about what kind of entities appear on public web pages
Schema.org is a vocabulary "for describing the kind of entities the most common web applications need" (source). But which entities would that be? Intuitively I’d say the most common entities are ...
- 374
2
votes
2
answers
2k
views
Dataset for Device fingerprints?
For research purposes, I'm looking for Device Fingerprint datasets.
A device might be a browser, a headless browser or even a network library capable of HTTP traffic.
A device fingerprint might ...
- 123
1
vote
0
answers
47
views
Getting metadata of all databases available on the Internet [closed]
I would like to get metadata for all (or as many as possible) databases that are available online. It does not have to be an open database. It is only the metadata that is important for me. The data I ...
- 173
2
votes
0
answers
164
views
Cyber-attacks with demand dataset
I am looking for a dataset containing a list of cyber-attacks were attackers made a demand (e.g., a ransom), with as many following fields as possible:
date of attack
duration of attack
date of ...
- 7,740
2
votes
1
answer
64
views
Average Internet Download Speeds for All Countries
I've already explored Akamai's State of the Internet Reports and the ITU's ICT Indicators Database, and tried to access Ookla's old data which is not offline. Is there anyone who can recommend where I ...
2
votes
1
answer
55
views
Wireshark capture files
I am looking for Ethereal / Wireshark / tcpdump captures (.pcap or .pcapng files) for training purposes. They should cover a wide range of protocols on all OSI layers. Those files would be analyzed by ...
- 151
5
votes
1
answer
206
views
database of email domain aliases?
I'm working on a problem merging some internal customer data on email address. However, I know that different email address can resolve to the same person. Some examples are:
mapping a vanity domain ...
- 151
4
votes
0
answers
102
views
The graph of the web: the dataset of links between web pages
I was looking for the dataset of links between web pages and found these options:
Common Crawl: Public web crawling data. It includes "the HTTP headers returned and the links (including the type of ...
- 3,641
6
votes
1
answer
103
views
Website visitors statistics
Alexa and Quantcast (and their alternatives) offer limited web statistics for free. For example, Alexa shows one-year data on a website's rank in Alexa's top. You can also download their million of ...
- 3,641
4
votes
1
answer
330
views
Find a missing dataset: "A Week in the life of a browser - Version 2" from Mozilla Labs
It's come up as an answer for two questions:
Open, big time-series dataset (ideally web traffic)
Where I can find a repository of software usage/execution logs (traces)?
Here is the main page: A ...
- 17.6k
7
votes
2
answers
268
views
Does there exist a set of data that measures internet traffic that is specific to image downloading and uploading?
I am currently writing a report, I would like to make a claim which I am struggling to back up:
The volume of image data transferred digitally has increased as the
internet has become more ...
- 203
3
votes
1
answer
183
views
Open Data about the internet
Does anyone know where one can find (if any is available)
open data about the internet, and generally any data about tier1 infrastructure, i.e internet backbone nodes with capacity, coordinates
Also ...
- 131
6
votes
2
answers
4k
views
Database of free WiFi hotspots
I want to create an app that shows free WiFi hotspots around you, even if you have no Internet connection yet.
So, I need a re-distributable database of free WiFi hotspots for the whole world.
For ...
- 8,386
7
votes
1
answer
697
views
Where can I find publicly available data about internet usage?
I'm searching for a data set in the public domain that quantifies degree of internet usage on a global basis for small geographic areas. For example is there a data set that shows total traffic (e.g. ...
- 213
5
votes
2
answers
1k
views
Open, big time-series dataset (ideally web traffic)
I'm working on a project for automatically identifying and sorting web analytics incidents.
As part of testing of the software, I'm looking for time-series dataset (ideally >100K rows) with daily ...
- 131
2
votes
0
answers
115
views
Is there any publicly available dataset of the student behaviors in massive online courses like Coursera?
I need dataset of the student behavior in the massive online courses. By searching the internet, most of data I find about online courses is just the course information. But what I want is the student ...
- 121
2
votes
1
answer
39
views
Data showing what JavaScript operations are usable in what browser
I am looking for compatibility data about browsers:
Does browser Firefox 32 support createDocumentFragment()?
Does browser Internet Explorer 5.5 support querySelectorAll()?
etc
Data should be easily ...
- 8,386
3
votes
1
answer
139
views
Fiber (dark or lit) maps and data
I'm looking for any publicly available data on where optical fiber (for Internet connectivity) is physically laid across the US. While there are commercial services that sell some of this data, and ...
- 31
3
votes
4
answers
221
views
Resolve company name / TLD to industry?
Where can I find a comprehensive data set of U.S. companies with their respective industries and internet top level domains (TLDs), if any?
Such as the Fortune 500 list...
Company Name Website ...
- 131
6
votes
1
answer
192
views
Domain Name System Record A database
Searching for a IP to TLD database lookup that is from an source that provides updates & archives. Possible this might require a number of sources, since I'm looking for all TLDs.
- 317
2
votes
2
answers
682
views
IP addresses of backbone routers
How would I go about finding a dataset of IP addresses of backbone routers? Looking around on Google didn't seem to help. Is this information available somewhere?
- 123
13
votes
7
answers
5k
views
Dataset of domain names
There are many web resources to find domain names (whois.com), and using the WHOIS protocol there are some APIs. Some examples are the unix command line tool jwhois and the python library pywhois. ...
- 17.6k
1
vote
1
answer
422
views
How much data is available on the Internet?
I saw these sentences on Wikipedia:
Nearly all of the roughly 50 petabytes (a petabyte is 1,024 terabytes) of data available on the Internet were first captured and created by human beings—by ...
- 111
13
votes
2
answers
19k
views
Clickstream sample dataset
I am looking for some web traffic or clickstream dataset, ideally from an ecommerce website. I like to do some analysis on purchasing pattern if possible.
For example: visit duration, conversion, ...
- 131