Questions tagged [wikipedia]

Wikipedia is a collaboratively edited, multilingual, free Internet encyclopedia supported by the non-profit Wikimedia Foundation.

Filter by
Sorted by
Tagged with
2 votes
1 answer
26 views

How to get "Author" field for Wikimedia Commons audio file

I'm going to ask this by example. Take a look at this media file's page https://commons.wikimedia.org/wiki/File:Sheerness.ogg It has a table showing "Author" with a value of "Speaker: ...
joseph_morris's user avatar
1 vote
2 answers
128 views

Wikidata COUNT(*) query times out

I have a straightforward query that counts how many humans have an English Wikipedia page. prefix schema: <http://schema.org/> PREFIX wikibase: <http://wikiba.se/ontology#> PREFIX wd: <...
abhinavkulkarni's user avatar
1 vote
3 answers
58 views

Why some items on Wikidata have no corresponding Wikipedia entry?

I get stuck by this Wikidata item: 9., and wonder why there is no corresponding Wikipedia entry?
Lerner Zhang's user avatar
2 votes
1 answer
43 views

Why are some entries so long and strange on Wikidata?

I wonder why Wikidata includes/filters in this kind of entries: Foundations of Astrophysics Barbara Ryden Bradley M. Peterson. 596 pp. Addison-Wesley, San Francisco, 2009. Price: $137.33 (hardcover). ...
Lerner Zhang's user avatar
1 vote
0 answers
25 views

What is the difference between sameAs and alias in Wikidata?

From the descriptions of sameAs and alias I don't know how the two relate to each other, and it also provides the redirects. And aliases also appear in properties.
Lerner Zhang's user avatar
2 votes
2 answers
309 views

Where can I find the source code of Wikipedia / Wiktionary templates?

Wikipedia and its sister sites make heavy use of templates. I want to find the source code behind those templates, i.e. the code that renders the HTML from a given template reference. Looking here, I ...
Jonas Sourlier's user avatar
0 votes
2 answers
71 views

What is the best way to convert a taxonomy from wikipedia into a JSON-like object?

I'm trying to use the Wikipedia academic fields as a JSON object in one of my projects. I couldn't find it in a useable or convertible format so I am looking into the best approach to obtain it. I ...
Billybobbonnet's user avatar
4 votes
1 answer
80 views

Geotagged wiki data

For a research purpose how can I extract geotagged wiki data (containing page id or titles for articles that refer to particular geolocation) for a city in England.
naw16's user avatar
  • 41
3 votes
0 answers
30 views

How are Wikipedia subcategories meant, semantically?

Let's have a look at the category https://en.wikipedia.org/wiki/Category:British_politicians Theresa May is not in it. So let's see: Theresa May is in Category:20th-century_British_women_politicians ...
Jonas Sourlier's user avatar
1 vote
3 answers
73 views

Wikipedia referenced articles in computer readable format?

A huge number of news related wiki pages contain article references (for example this article on the 2017 Equifax data breach) and I would like to obtain the following data from the references section ...
TheMightyLlama's user avatar
1 vote
2 answers
1k views

Converting Wikipedia URL to Wikipedia Page ID

I've linked phrases in texts to entities in Wikipedia: Going over the bridge, coming from Aliante Casino, you cant miss the nice view of the href="http://en.wikipedia.org/wiki/Waterfall">...
dzieciou's user avatar
  • 233
2 votes
1 answer
80 views

Known datasets for long document analysis

Are there good baselines datasets or benchmarks for similarities/retrieval of long texts (extremely long documents, books, etc.)? Although significant both academically and applicational, I cannot get ...
DsCpp's user avatar
  • 121
5 votes
1 answer
554 views

Torrent for Wikidata dump

I'm looking for Wikipedia (enwiki-latest-pages-articles-multistream.xml.bz2) and a Wikidata (latest-all.json.bz2 ) dumps. The files are quite large (the latter has ~47GB) and my internet connection ...
dzieciou's user avatar
  • 233
1 vote
1 answer
181 views

How do I extract certain articles from Arabic Wiki Dumps?

I need to collect all articles that are about countries and continents in Arabic from Wikipedia. I was wondering how do I find these articles if I downloaded the latest wiki dump? New to the field. ...
user3432543's user avatar
0 votes
1 answer
185 views

Query wikipedia links

I'm using the following query to receive label and description of all Wikidata-entries with geo-location in a geo-bounding box: SELECT DISTINCT ?place ?placeLabel ?placeDescription ?location WHERE { ...
Tom's user avatar
  • 103
1 vote
0 answers
42 views

How come there are missing entities in this SPARQL query?

I was interested in listing all books, so I wrote: SELECT ?book ?url WHERE { ?book wdt:P31 wd:Q571 . OPTIONAL { ?url schema:about ?book . ?url schema:inLanguage "en" . ?url schema:...
JammingThebBits's user avatar
1 vote
1 answer
61 views

Non commercial use of nfl team logos from Wikipedia

I am about to publish some use cases for an open source visualization I did for hierarchical data. One use case is sports data, e.g. visualizing the super bowl play by play. I would like to use the ...
ee2Dev's user avatar
  • 235
1 vote
1 answer
72 views

What are Outlink categories of Wikipedia

I am wondering if it is possible to view outlink categories of a given article in Wikipedia? For example, consider the Wikipedia article about 'Data Mining'. What are the outlink categories of "Data ...
EmJ's user avatar
  • 245
2 votes
1 answer
331 views

Limiting a SPARQL Query to Lastest Point in Time

I'm trying to get information on Prefectures in Japan out of Wikidata. I succeeded to read the population statement, however there are occasionally several values with different point in time fields. ...
mwil.me's user avatar
  • 123
3 votes
2 answers
215 views

How to get specific wikipedia data?

I only want to use the link structure and articles’ content of Wikipedia. Therefore, I want to downlaod the dump that contains only the following details. articles content link structure (i.e. re-...
EmJ's user avatar
  • 245
3 votes
1 answer
1k views

Wikimedia Commons API image by category

I'm trying to retrieve a list of urls of images in Wikimedia Commons from a particular article. I want to either search article by category and retrieve images from them, or filter images by category. ...
Joseph Coco's user avatar
3 votes
0 answers
59 views

Is it fair use to use figures from ArXiv preprints on Wikipedia?

Apologies if this isn't the right exchange. I'm not sure where this question should live. There are some science figures from Arxiv papers that I think would greatly enhance a Wikipedia page on the ...
pirt's user avatar
  • 131
3 votes
1 answer
56 views

2 category intersection with PetScan not working?

I'm trying to create an intersection between two categories on Wiktionary using PetScan (http://tools.wmflabs.org/catscan2/catscan2.php), but I can't get it to work. What I've read says it should be ...
tjoli's user avatar
  • 31
4 votes
1 answer
67 views

Crosswalk between FIPS codes and Wikipedia articles about U.S. Census Places

The English Wikipedia includes an article for nearly every U.S. Census Place. Has anyone published a crosswalk from FIPS codes of these places to Wikipedia urls? Is this something that would be ...
fgregg's user avatar
  • 5,098
1 vote
1 answer
63 views

How can I get data about Wikipedians (e.g. language proficiency), by username?

Is there an open dataset containing information such as username, language proficiency levels (https://en.m.wikipedia.org/wiki/Wikipedia:Babel/Levels) and (possibly) academic degrees and nationality ...
Davide Fiocco's user avatar
2 votes
1 answer
139 views

Search in wikidata with specific Q code

I've this query but I can't understand why doesn't return any result. I try different versions (with link, with only code, with wd:code) but nothing seems to work. What I need is this query but ...
Leandro Bardelli's user avatar
2 votes
1 answer
233 views

Wikidata - Search of human instance that doesn't break

Is this possible, like the wikidata autocomplete combo works, in a speedy way, with a filter of "itemlabel strings start with..." ? PREFIX xsd: <http://www.w3.org/2001/XMLSchema#> SELECT ?item ...
Leandro Bardelli's user avatar
4 votes
1 answer
587 views

Is there any open dataset for named entity linking?

Entity linking is the task of detecting mentions of entities from a knowledge base in a document. Are there any openly available datasets to train and evaluate such systems? The datasets I came ...
pintoch's user avatar
  • 296
4 votes
1 answer
238 views

Wikidata differs from Wikipedia

I am trying to retrieve data for a company programmatically using the Wikidata API. However, the data retrieved from Wikidata is different from en.wikipedia.org. Is this expected? Example: Nissan ...
varadark's user avatar
2 votes
2 answers
127 views

Various Country Statistics

In Wikipedia articles of countries a lot of statistics are given about the country at hand. For example in the Venezuela article, demographics are described in terms of ethnic groups (e.g. 51.6% are ...
Eff's user avatar
  • 123
1 vote
0 answers
45 views

Download clean coordinates from Wikipedia Map Module: … detailed map

I would like to know if there is a way to either download/scrape a clean CSV with coordinates and controlling group from Wikipedia conflict maps, or how to generate an ESRI shapefile from the Lua ...
arabiccode's user avatar
4 votes
1 answer
74 views

Wikipedia Article Category

The wikipedia Page View API provides information about the number of page views for a given article, including an option to view top-N articles in a given day or month: https://wikimedia.org/api/...
Sergei Rodionov's user avatar
1 vote
0 answers
49 views

wikipedia user data for a recommendation engine

So I pulled the Wikipedia Page Traffic Statistics into an AWS instance and then downloaded a file which represents one hour from several months of usage data to look at locally, but it didn't really ...
cardamom's user avatar
  • 111
3 votes
2 answers
118 views

Info based on page title?

I'm looking for a way to get info from wikipedia based on the page title. example: If i have a page called "Britney Spears" i want to be able to get a simple bio extracted from wikipedia onto the ...
davlo's user avatar
  • 31
3 votes
1 answer
148 views

Wikipedia: How to activate email notification from watchlist?

I may have a blackout on this, so please help. I have a wikipedia account with a confirmed email. I have checked the box "Email me when a page or file on my watchlist is changed". I have two pages ...
cvr's user avatar
  • 133
9 votes
2 answers
381 views

Is Wikidata up to date with Wikipedia?

I think that DBpedia links to Wikipedia by Wikipedia database dump, making it not up to date with on-line Wikipedia contents. I was wondering if Wikidata uses on-line Wikipedia content or if it also ...
vedar's user avatar
  • 93
2 votes
2 answers
1k views

Get section and page title from a list of articles in Wikipedia via API

I want to get the different sections with their pages from the Wikipedia:Featured articles. By following this answer, I know I can get page titles of links as follows: https://en.wikipedia.org/w/...
atineoSE's user avatar
  • 215
6 votes
2 answers
750 views

How to get urls of entries in wikipedia list articles?

I am trying to retrieve the URL of all articles listed inside wikipedia list articles. For concreteness lets consider the wikimedia list article List_of_American_scientists I know how to use the wiki ...
Pushpendre's user avatar
1 vote
1 answer
78 views

Downloading wikipedia data from specific url

I want to download data from Wikipedia page I am a rookie at this and can'T find any relevant articles. Most of them are on downloading full Wikipedia. I need just one specific URL data.
asaini's user avatar
  • 53
3 votes
2 answers
2k views

Download wikipedia dump and save in raw text form

I have been trying to use Wikipedia text data for my personal research. I know that crawling is not good for the Wikipedia server so I downloaded a big XML file from https://dumps.wikimedia.org/jawiki/...
Jin Sakuma's user avatar
8 votes
1 answer
610 views

wikidata: (when) will it be possible to query for wikipedia page links?

(When) will the following be possible: For a wikipedia page: get the list of all wikipedia links on that page with their respective wikidata IDs in a single query/API call. Receive additional ...
G. L. Merebet's user avatar
4 votes
2 answers
586 views

wikipedia page: get the list of all links with their wikidata ids

For a Wikipedia page: is it possible to get the list of all Wikipedia links on that page with their respective wikidata IDs in a single query/API call? Optional: can additional information of the ...
G. L. Merebet's user avatar
4 votes
2 answers
453 views

ISO 3166-1 country codes in DBpedia

How can I get a two-letter ISO 3166-1 country code in DBpedia? More specifically, I'm querying the SPARQL endpoint like this: SELECT DISTINCT ?iata ?country where { ?airport a dbo:Airport. ?...
Bolo's user avatar
  • 238
2 votes
1 answer
91 views

Wikipedia database: categories and category mapping across languages

I've imported the wikipedia database in four languages with the goal of running some machine learning algorithms on it for text classification. The import doesn't populate the "category" table though. ...
podzway's user avatar
  • 23
5 votes
1 answer
135 views

Getting influences / influencedBy data from DBpedia

I am struggling with DBpedia. The description is unclear (to the point that for me it is hard to tell which data can be obtain, which - cannot), and (what is worst) it does not have many examples (...
Piotr Migdal's user avatar
25 votes
2 answers
7k views

Get Wikipedia URLs (sitelinks) in Wikidata SPARQL query

I can use the following query to list all sovereign states via the Wikidata query interface: PREFIX wikibase: <http://wikiba.se/ontology#> PREFIX wd: <http://www.wikidata.org/entity/> ...
ramiro's user avatar
  • 1,046
7 votes
4 answers
4k views

Get season statistics for NFL players

So as the title suggests I'm trying to retrieve NFL stats for players. I've found that Wikipedia has a quite extensive statistics panel for a lot of players (i.e Tom Brady https://en.wikipedia.org/...
Jamie's user avatar
  • 71
1 vote
1 answer
93 views

How to use multiple wikipedia categories for Quick Intersection?

I'm using http://tools.wmflabs.org/quick-intersection/index.php to get a list of articles within categories but I have a list of over 35 categories and I'd like to use Quick Intersection to get the ...
Bart's user avatar
  • 13
15 votes
6 answers
5k views

Mapping all Wikipedia URLs to Wikidata entity ids

Is there a Wikidata dump that maps all Wikipedia URLs to their corresponding Wikidata entity ids, e.g. the Wikipedia URL https://en.wikipedia.org/wiki/Tom_Hanks to the Wikidata entity id Q2263?
Alok Shankar's user avatar
12 votes
4 answers
1k views

How to get soccer players Wikipedia URL?

I'd like to grab as many soccer players names and their Wikipedia URL. For example: "David Beckham": 'David_Beckham', "Wayne Rooney": 'Wayne_Rooney' The first portion is their name and the second is ...
Lara's user avatar
  • 123