Questions tagged [internet]

For questions specifically related to the Internet or the World Wide Web.

Filter by
Sorted by
Tagged with
1
vote
0answers
12 views

Anyone contributed code via ArXiv's new feature?

Recently, ArXiv partnered with Github to host links to repos implementing theory contained in papers (who needs universities anymore?) How could we convince them to also provide links to the data ...
1
vote
0answers
32 views

Where can I find statistics for Facebook and YouTube total views worldwide like those of Wikipedia?

I am working on a research program about social media traffic and my mission is to find official usage data for major platforms like YouTube, Facebook, Twitter, Wikipedia etc. Wikipedia provides ...
0
votes
0answers
17 views

Is there a good (free) way to see site and/or search traffic? [duplicate]

Several years back, if memory serves, I was able to access on Google, the site traffic or search traffic for a wide number of large corporations. This was through a portal (I think Google Analytics, ...
0
votes
2answers
80 views

Dataset for German domain names (.de)

I'm looking for a new DNS domain in Germany (.de) for a new service. It would be very helpful to search .de domains using wildcards (regular expressions), e.g. mysuperservice[0-9]+.de mysuper-[a-z]+-...
3
votes
1answer
75 views

List of all http sites in the world

I've tried inurl:http but it takes forever to get even a bunch of sites right and I have to think of new keywords everytime to get the sites. Is there kind of a directory I could use to get the ...
2
votes
3answers
71 views

Looking for suggestions of sources for data science project

I'm currently taking a first step into Data Science, and studying a specific computational method, I'm a math student, but I'm looking for reliable data sources, and if related to biology (e.g public ...
0
votes
1answer
36 views

HTTP Response Codes

For a data visualization, I'm looking for http response codes. There are many sources of this dataset, but I'm looking for machine readable (JSON preferred) reliably updated (so that my dataviz is ...
3
votes
0answers
25 views

Internet speed in the united states

I am trying to find geolocated internet speed data. What data sources are available? I've found: FCC data: problematic because it's provided by ISPs. Measurement Lab: Open source testing by ...
1
vote
3answers
46 views

Where can I find website analytics logs for research?

I am doing some research into some machine learning algorithms that can be used to analyze website logs. A friend gave me access to his Google Analytics, but all I see are reports and I am not able ...
0
votes
2answers
208 views

List of socks4/5 proxies in a plain text

I'm looking for list of public socks proxies in the plain text or another format which can be imported via curl. I have tried extract it using script such as: $ pup -f <(curl -sL https://www....
1
vote
1answer
43 views

DNS request sample traffic

I am trying to find a dataset about DNS request, which is created by any group of users during a period (a week or a month...). For example: employers in a selected company used the internet and ...
1
vote
0answers
630 views

Looking for customer service chat dataset [duplicate]

I am looking for specific customer support chat dataset or question answers dataset, for example network support, hardware, software support, ticket remedy chats etc. I need to mine the data for ...
2
votes
1answer
40 views

Internet Peering Locations

Is there any dataset about worldwide Internet Interconnection locations? Some information about the average or maximum switching capacity would be nice. I found a map (and raw data) about seacables (...
2
votes
0answers
56 views

Available datasets for HTTP headers

I would like to know if there are any publicly available datasets with HTTP header data, such as URI, user-agent, referer, content-length, etc-- I've tried searching with the usual keywords to no ...
2
votes
0answers
105 views

Looking for historical weather forecasts

I am looking to write a report about the accuracy of weather forecasts. I have already found several source that provides data for actual weather in different locations, but I am having difficulty ...
1
vote
1answer
190 views

Opengeocode.org account has been suspended?

Does anyone know what has happened to opengeocode.org The well used website is showing that the account has been suspended
1
vote
3answers
204 views

List of symbols with corresponding names

I am searching for wording for symbols icons and what they are. For example, if you have a symbol such as flag, or types of cars. I want to look it up online and search for the name of that symbol. I ...
3
votes
1answer
118 views

Are there any public agencies which are currently streaming real-time video data?

I'm engaged in a discussion with the network security department at a public agency with the goal of making their live video data publicly available on the Internet; currently the data never leaves ...
3
votes
1answer
56 views

What is the percentage of internet users in the USA? Discrepancy between Google result and World bank data

The Google default results for "internet user United States" is 84 % of the population. The source is the World Bank, but when I go to the World Bank website, it shows only 74% internet users in the ...
3
votes
0answers
30 views

Cellular data subscription costs

The US Census July 2013 Computer and Internet Use Supplement surveys US households and asks "How much does your Internet service provider charge you per month?" From this, I can get an empirical ...
1
vote
0answers
66 views

Can I get dataset of google queries asked by people in a particular time period?

I am doing a research on how queries have evolved over time(focusing on google mainly). I want to compare what queries people searched on google last year and compare it to what they are searching ...
3
votes
1answer
206 views

Ookla/NetIndex data dump

A wonderful resource that earlier used to exist for researching global Internet speed and quality was Ookla's NetIndex. Ookla has discontinued public download, I believe since 2015. Does anyone have a ...
7
votes
1answer
321 views

Anti-infringment IP list

I am looking for an up-to-date, gratis anti-infringment IP list, i.e., a list of IPs of organizations searching for copyright infringement through peer-to-peer networks. https://www.iblocklist.com/...
3
votes
1answer
64 views

Data about what kind of entities appear on public web pages

Schema.org is a vocabulary "for describing the kind of entities the most common web applications need" (source). But which entities would that be? Intuitively I’d say the most common entities are ...
2
votes
1answer
828 views

Dataset for Device fingerprints?

For research purposes, I'm looking for Device Fingerprint datasets. A device might be a browser, a headless browser or even a network library capable of HTTP traffic. A device fingerprint might ...
1
vote
0answers
40 views

Getting metadata of all databases available on the Internet [closed]

I would like to get metadata for all (or as many as possible) databases that are available online. It does not have to be an open database. It is only the metadata that is important for me. The data I ...
2
votes
0answers
160 views

Cyber-attacks with demand dataset

I am looking for a dataset containing a list of cyber-attacks were attackers made a demand (e.g., a ransom), with as many following fields as possible: date of attack duration of attack date of ...
2
votes
1answer
58 views

Average Internet Download Speeds for All Countries

I've already explored Akamai's State of the Internet Reports and the ITU's ICT Indicators Database, and tried to access Ookla's old data which is not offline. Is there anyone who can recommend where I ...
2
votes
1answer
48 views

Wireshark capture files

I am looking for Ethereal / Wireshark / tcpdump captures (.pcap or .pcapng files) for training purposes. They should cover a wide range of protocols on all OSI layers. Those files would be analyzed by ...
5
votes
1answer
175 views

database of email domain aliases?

I'm working on a problem merging some internal customer data on email address. However, I know that different email address can resolve to the same person. Some examples are: mapping a vanity domain ...
4
votes
0answers
94 views

The graph of the web: the dataset of links between web pages

I was looking for the dataset of links between web pages and found these options: Common Crawl: Public web crawling data. It includes "the HTTP headers returned and the links (including the type of ...
6
votes
1answer
94 views

Website visitors statistics

Alexa and Quantcast (and their alternatives) offer limited web statistics for free. For example, Alexa shows one-year data on a website's rank in Alexa's top. You can also download their million of ...
4
votes
1answer
304 views

Find a missing dataset: “A Week in the life of a browser - Version 2” from Mozilla Labs

It's come up as an answer for two questions: Open, big time-series dataset (ideally web traffic) Where I can find a repository of software usage/execution logs (traces)? Here is the main page: A ...
7
votes
2answers
266 views

Does there exist a set of data that measures internet traffic that is specific to image downloading and uploading?

I am currently writing a report, I would like to make a claim which I am struggling to back up: The volume of image data transferred digitally has increased as the internet has become more ...
3
votes
1answer
168 views

Open Data about the internet

Does anyone know where one can find (if any is available) open data about the internet, and generally any data about tier1 infrastructure, i.e internet backbone nodes with capacity, coordinates Also ...
6
votes
3answers
3k views

Database of free WiFi hotspots

I want to create an app that shows free WiFi hotspots around you, even if you have no Internet connection yet. So, I need a re-distributable database of free WiFi hotspots for the whole world. For ...
7
votes
1answer
660 views

Where can I find publicly available data about internet usage?

I'm searching for a data set in the public domain that quantifies degree of internet usage on a global basis for small geographic areas. For example is there a data set that shows total traffic (e.g. ...
5
votes
2answers
1k views

Open, big time-series dataset (ideally web traffic)

I'm working on a project for automatically identifying and sorting web analytics incidents. As part of testing of the software, I'm looking for time-series dataset (ideally >100K rows) with daily ...
2
votes
0answers
102 views

Is there any publicly available dataset of the student behaviors in massive online courses like Coursera?

I need dataset of the student behavior in the massive online courses. By searching the internet, most of data I find about online courses is just the course information. But what I want is the student ...
2
votes
1answer
37 views

Data showing what JavaScript operations are usable in what browser

I am looking for compatibility data about browsers: Does browser Firefox 32 support createDocumentFragment()? Does browser Internet Explorer 5.5 support querySelectorAll()? etc Data should be easily ...
3
votes
1answer
129 views

Fiber (dark or lit) maps and data

I'm looking for any publicly available data on where optical fiber (for Internet connectivity) is physically laid across the US. While there are commercial services that sell some of this data, and ...
3
votes
4answers
198 views

Resolve company name / TLD to industry?

Where can I find a comprehensive data set of U.S. companies with their respective industries and internet top level domains (TLDs), if any? Such as the Fortune 500 list... Company Name Website ...
5
votes
1answer
152 views

Domain Name System Record A database

Searching for a IP to TLD database lookup that is from an source that provides updates & archives. Possible this might require a number of sources, since I'm looking for all TLDs.
2
votes
2answers
415 views

IP addresses of backbone routers

How would I go about finding a dataset of IP addresses of backbone routers? Looking around on Google didn't seem to help. Is this information available somewhere?
11
votes
6answers
3k views

Dataset of domain names

There are many web resources to find domain names (whois.com), and using the WHOIS protocol there are some APIs. Some examples are the unix command line tool jwhois and the python library pywhois. ...
1
vote
1answer
412 views

How much data is available on the Internet?

I saw these sentences on Wikipedia: Nearly all of the roughly 50 petabytes (a petabyte is 1,024 terabytes) of data available on the Internet were first captured and created by human beings—by ...
13
votes
2answers
14k views

Clickstream sample dataset

I am looking for some web traffic or clickstream dataset, ideally from an ecommerce website. I like to do some analysis on purchasing pattern if possible. For example: visit duration, conversion, ...
0
votes
1answer
153 views

Intelligence, Internet usage and Ip addresses [closed]

I was looking for information about - If intelligence predicts internet usage. A relation between IP addresses per capita versus GDP per capita. I'd greatly appreciate any sources or just raw data ...
2
votes
2answers
134 views

What is the amount of open data that is currently available over the web?

I'd like to know an estimated amount of open data over the web. This is required for a research proposal that I'm working on.
4
votes
1answer
115 views

Estimate how many linux operated computers are currently online

I'm curious as to figuring out an estimated number of online linux computers. This is required for a case study that I'm working on. Since most online linuxes connect to some sort of NTP service to ...