Questions tagged [wikipedia]
Wikipedia is a collaboratively edited, multilingual, free Internet encyclopedia supported by the non-profit Wikimedia Foundation.
54
questions
1
vote
2
answers
5
views
Where can I find the source code of Wikipedia / Wiktionary templates?
Wikipedia and its sister sites make heavy use of templates. I want to find the source code behind those templates, i.e. the code that renders the HTML from a given template reference.
Looking here, I ...
- 171
0
votes
1
answer
21
views
What is the best way to convert a taxonomy from wikipedia into a JSON-like object?
I'm trying to use the Wikipedia academic fields as a JSON object in one of my projects. I couldn't find it in a useable or convertible format so I am looking into the best approach to obtain it.
I ...
- 133
4
votes
1
answer
45
views
Geotagged wiki data
For a research purpose how can I extract geotagged wiki data (containing page id or titles for articles that refer to particular geolocation) for a city in England.
- 41
3
votes
0
answers
27
views
How are Wikipedia subcategories meant, semantically?
Let's have a look at the category
https://en.wikipedia.org/wiki/Category:British_politicians
Theresa May is not in it. So let's see:
Theresa May is in Category:20th-century_British_women_politicians
...
- 171
1
vote
3
answers
54
views
Wikipedia referenced articles in computer readable format?
A huge number of news related wiki pages contain article references (for example this article on the 2017 Equifax data breach) and I would like to obtain the following data from the references section ...
- 111
1
vote
2
answers
403
views
Converting Wikipedia URL to Wikipedia Page ID
I've linked phrases in texts to entities in Wikipedia:
Going over the bridge, coming from Aliante Casino, you cant miss the nice
view of the href="http://en.wikipedia.org/wiki/Waterfall">...
- 211
1
vote
1
answer
44
views
Known datasets for long document analysis
Are there good baselines datasets or benchmarks for similarities/retrieval of long texts (extremely long documents, books, etc.)? Although significant both academically and applicational, I cannot get ...
- 111
5
votes
0
answers
257
views
Torrent for Wikidata dump
I'm looking for Wikipedia (enwiki-latest-pages-articles-multistream.xml.bz2) and a Wikidata (latest-all.json.bz2 ) dumps. The files are quite large (the latter has ~47GB) and my internet connection ...
- 211
1
vote
1
answer
93
views
How do I extract certain articles from Arabic Wiki Dumps?
I need to collect all articles that are about countries and continents in Arabic from Wikipedia. I was wondering how do I find these articles if I downloaded the latest wiki dump?
New to the field. ...
- 13
0
votes
1
answer
82
views
Query wikipedia links
I'm using the following query to receive label and description of all Wikidata-entries with geo-location in a geo-bounding box:
SELECT DISTINCT ?place ?placeLabel ?placeDescription ?location WHERE
{
...
- 103
1
vote
0
answers
32
views
How come there are missing entities in this SPARQL query?
I was interested in listing all books,
so I wrote:
SELECT ?book ?url WHERE {
?book wdt:P31 wd:Q571 .
OPTIONAL {
?url schema:about ?book .
?url schema:inLanguage "en" .
?url schema:...
- 111
1
vote
1
answer
46
views
Non commercial use of nfl team logos from Wikipedia
I am about to publish some use cases for an open source visualization I did for hierarchical data.
One use case is sports data, e.g. visualizing the super bowl play by play. I would like to use the ...
- 235
1
vote
1
answer
66
views
What are Outlink categories of Wikipedia
I am wondering if it is possible to view outlink categories of a given article in Wikipedia? For example, consider the Wikipedia article about 'Data Mining'. What are the outlink categories of "Data ...
- 235
2
votes
1
answer
157
views
Limiting a SPARQL Query to Lastest Point in Time
I'm trying to get information on Prefectures in Japan out of Wikidata. I succeeded to read the population statement, however there are occasionally several values with different point in time fields.
...
- 123
2
votes
2
answers
117
views
How to get specific wikipedia data?
I only want to use the link structure and articles’ content of Wikipedia. Therefore, I want to downlaod the dump that contains only the following details.
articles content
link structure (i.e. re-...
- 235
3
votes
1
answer
676
views
Wikimedia Commons API image by category
I'm trying to retrieve a list of urls of images in Wikimedia Commons from a particular article. I want to either search article by category and retrieve images from them, or filter images by category. ...
- 133
3
votes
0
answers
49
views
Is it fair use to use figures from ArXiv preprints on Wikipedia?
Apologies if this isn't the right exchange. I'm not sure where this question should live.
There are some science figures from Arxiv papers that I think would greatly enhance a Wikipedia page on the ...
- 131
3
votes
1
answer
50
views
2 category intersection with PetScan not working?
I'm trying to create an intersection between two categories on Wiktionary using PetScan (http://tools.wmflabs.org/catscan2/catscan2.php), but I can't get it to work. What I've read says it should be ...
- 31
4
votes
1
answer
63
views
Crosswalk between FIPS codes and Wikipedia articles about U.S. Census Places
The English Wikipedia includes an article for nearly every U.S. Census Place. Has anyone published a crosswalk from FIPS codes of these places to Wikipedia urls?
Is this something that would be ...
- 5,097
1
vote
1
answer
61
views
How can I get data about Wikipedians (e.g. language proficiency), by username?
Is there an open dataset containing information such as username, language proficiency levels (https://en.m.wikipedia.org/wiki/Wikipedia:Babel/Levels) and (possibly) academic degrees and nationality ...
- 113
1
vote
1
answer
76
views
Search in wikidata with specific Q code
I've this query but I can't understand why doesn't return any result. I try different versions (with link, with only code, with wd:code) but nothing seems to work. What I need is this query but ...
- 161
2
votes
1
answer
196
views
Wikidata - Search of human instance that doesn't break
Is this possible, like the wikidata autocomplete combo works, in a speedy way, with a filter of "itemlabel strings start with..." ?
PREFIX xsd: <http://www.w3.org/2001/XMLSchema#>
SELECT ?item ...
- 161
4
votes
1
answer
578
views
Is there any open dataset for named entity linking?
Entity linking is the task of detecting mentions of entities from a knowledge base in a document.
Are there any openly available datasets to train and evaluate such systems? The datasets I came ...
- 296
4
votes
1
answer
168
views
Wikidata differs from Wikipedia
I am trying to retrieve data for a company programmatically using the Wikidata API. However, the data retrieved from Wikidata is different from en.wikipedia.org. Is this expected?
Example: Nissan ...
- 41
2
votes
2
answers
117
views
Various Country Statistics
In Wikipedia articles of countries a lot of statistics are given about the country at hand. For example in the Venezuela article, demographics are described in terms of ethnic groups (e.g. 51.6% are ...
- 123
1
vote
0
answers
44
views
Download clean coordinates from Wikipedia Map Module: … detailed map
I would like to know if there is a way to either download/scrape a clean CSV with coordinates and controlling group from Wikipedia conflict maps, or how to generate an ESRI shapefile from the Lua ...
- 31
4
votes
1
answer
70
views
Wikipedia Article Category
The wikipedia Page View API provides information about the number of page views for a given article, including an option to view top-N articles in a given day or month:
https://wikimedia.org/api/...
- 225
1
vote
0
answers
48
views
wikipedia user data for a recommendation engine
So I pulled the Wikipedia Page Traffic Statistics into an AWS instance and then downloaded a file which represents one hour from several months of usage data to look at locally, but it didn't really ...
- 111
3
votes
2
answers
113
views
Info based on page title?
I'm looking for a way to get info from wikipedia based on the page title.
example: If i have a page called "Britney Spears" i want to be able to get a simple bio extracted from wikipedia onto the ...
- 31
3
votes
1
answer
107
views
Wikipedia: How to activate email notification from watchlist?
I may have a blackout on this, so please help.
I have a wikipedia account with a confirmed email. I have checked the box "Email me when a page or file on my watchlist is changed".
I have two pages ...
- 133
9
votes
2
answers
356
views
Is Wikidata up to date with Wikipedia?
I think that DBpedia links to Wikipedia by Wikipedia database dump, making it not up to date with on-line Wikipedia contents.
I was wondering if Wikidata uses on-line Wikipedia content or if it also ...
- 93
2
votes
2
answers
883
views
Get section and page title from a list of articles in Wikipedia via API
I want to get the different sections with their pages from the Wikipedia:Featured articles.
By following this answer, I know I can get page titles of links as follows:
https://en.wikipedia.org/w/...
- 205
6
votes
2
answers
478
views
How to get urls of entries in wikipedia list articles?
I am trying to retrieve the URL of all articles listed inside wikipedia list articles. For concreteness lets consider the wikimedia list article List_of_American_scientists
I know how to use the wiki ...
- 163
1
vote
1
answer
64
views
Downloading wikipedia data from specific url
I want to download data from Wikipedia page
I am a rookie at this and can'T find any relevant articles. Most of them are on downloading full Wikipedia. I need just one specific URL data.
- 53
3
votes
2
answers
2k
views
Download wikipedia dump and save in raw text form
I have been trying to use Wikipedia text data for my personal research.
I know that crawling is not good for the Wikipedia server so I downloaded a big XML file from https://dumps.wikimedia.org/jawiki/...
- 31
8
votes
1
answer
409
views
wikidata: (when) will it be possible to query for wikipedia page links?
(When) will the following be possible:
For a wikipedia page: get the list of all wikipedia links on that page with their respective wikidata IDs in a single query/API call.
Receive additional ...
- 131
4
votes
2
answers
280
views
wikipedia page: get the list of all links with their wikidata ids
For a Wikipedia page: is it possible to get the list of all Wikipedia links on that page with their respective wikidata IDs in a single query/API call?
Optional: can additional information of the ...
- 131
4
votes
2
answers
407
views
ISO 3166-1 country codes in DBpedia
How can I get a two-letter ISO 3166-1 country code in DBpedia? More specifically, I'm querying the SPARQL endpoint like this:
SELECT DISTINCT ?iata ?country where {
?airport a dbo:Airport.
?...
- 238
2
votes
1
answer
85
views
Wikipedia database: categories and category mapping across languages
I've imported the wikipedia database in four languages with the goal of running some machine learning algorithms on it for text classification. The import doesn't populate the "category" table though. ...
- 23
5
votes
1
answer
129
views
Getting influences / influencedBy data from DBpedia
I am struggling with DBpedia. The description is unclear (to the point that for me it is hard to tell which data can be obtain, which - cannot), and (what is worst) it does not have many examples (...
- 824
23
votes
2
answers
5k
views
Get Wikipedia URLs (sitelinks) in Wikidata SPARQL query
I can use the following query to list all sovereign states via the Wikidata query interface:
PREFIX wikibase: <http://wikiba.se/ontology#>
PREFIX wd: <http://www.wikidata.org/entity/>
...
- 1,036
7
votes
4
answers
4k
views
Get season statistics for NFL players
So as the title suggests I'm trying to retrieve NFL stats for players. I've found that Wikipedia has a quite extensive statistics panel for a lot of players (i.e Tom Brady https://en.wikipedia.org/...
- 71
1
vote
1
answer
73
views
How to use multiple wikipedia categories for Quick Intersection?
I'm using http://tools.wmflabs.org/quick-intersection/index.php to get a list of articles within categories but I have a list of over 35 categories and I'd like to use Quick Intersection to get the ...
- 13
14
votes
6
answers
4k
views
Mapping all Wikipedia URLs to Wikidata entity ids
Is there a Wikidata dump that maps all Wikipedia URLs to their corresponding Wikidata entity ids, e.g. the Wikipedia URL https://en.wikipedia.org/wiki/Tom_Hanks to the Wikidata entity id Q2263?
- 251
12
votes
4
answers
1k
views
How to get soccer players Wikipedia URL?
I'd like to grab as many soccer players names and their Wikipedia URL. For example:
"David Beckham": 'David_Beckham',
"Wayne Rooney": 'Wayne_Rooney'
The first portion is their name and the second is ...
- 123
5
votes
3
answers
536
views
How can I add Wikidata properties of item a on the Wikipedia page of item b?
How would I get the eccentricity (Property:P1096) of Venus (Q313) in the article en:Mars?
I have figured out that I have to write {{#property:P1096}} if I want to get a property of the page on that ...
- 487
5
votes
1
answer
225
views
"DBpedia as Tables" not having all the properties
I browsed a sample for available data at http://dbpedia.org/page/Sachin_Tendulkar. I wanted these properties as columns, so I downloaded the CSV files from http://wiki.dbpedia.org/DBpediaAsTables.
...
3
votes
1
answer
82
views
Where should I host/contribute a mapping from Stack Overflow tags to Wikipedia articles?
I had asked for a mapping from Stack Overflow tags to Wikipedia articles over at meta.stackoverflow, but no one seemed to find one, so I started building my own.
Where is the "right" place for me to ...
- 133
9
votes
1
answer
5k
views
Download Wikipedia articles from a specific category
I know that I can download English Wikipedia Dump, but I was wondering if I can download only articles for a specific category-subject.
For instance, can I download articles related to Mathematics or ...
- 195
5
votes
1
answer
87
views
Suspected dirty data in Wikipedia articles indirectly belonging to a category
I'm trying to get a list of all articles (just the names, not the contents) that are indirectly within the category Japanese people in Wikipedia.
I've tried using a tool called Quick intersection. ...
- 283