Structured Data Across Wikimedia/Section Topics

This page describes the work underway to design and build features to identify section topics in a Wikipedia article, currently in development by the Structured Data Across Wikimedia team.

Background

For more information about the current tool architecture, see: Structured Data Across Wikimedia/Section Topics/Data Pipeline.

The Section Topics project will identify sections in an article and create topics accordingly for those sections, drawing on several elements, such as:

• an algorithm that detects Wikidata items based on the section’s blue links (which will be developed in partnership with the Structured Data, Research, and Data Platform teams);
• the ability to automatically identify sections in an article (which will be developed in partnership with the Structured Data and Data Platform teams).

One of the first use cases we envisioned for section topics will be section-level image suggestions, which will use the blue-links algorithm and section identification infrastructure above, and be delivered both via the newcomer experience and via notifications for experienced contributors. This will build upon the work done on image suggestions and will be developed in partnership with the Structured Data, Data Platform, Research, Search, Android, and Growth teams.

These elements will not change, nor impact the current editing experience for users. All these activities will be automatic and will not depend on any action from editors. Currently, this project is in its development phase, and there are still aspects that may require further investigation and/or feedback from users.

Examples of potential section topics

Tracked in Phabricator
Task T316925

The following are some examples of section topics extracted from Wikipedia articles, during a test run on English and Russian Wikipedias. Currently, we are working on a way to determine the most relevant topics for any given section, through a custom TF-IDF weight function.

Example 1 (English Wikipedia)

Article: Campbell Island, New Zealand

Section: History

Example of section topics: “World War II”, “Pinniped”, “Brig”, “Great Depression”, “Perseverance Harbour”

Example 2 (English Wikipedia)

Article: Dorothy E. Smith

Section: Biography

Example of section topics: “Toronto”, “University of British Columbia”, “London School of Economics”, “Vancouver”, “University of California, Berkeley”

Example 3 (English Wikipedia)

Article: Battle of Surabaya

Section: Background

Example of section topics: “Sukarno”, “Mohammad Hatta”, “Jakarta”, “Proclamation of Indonesian Independence”, “East Java”

Example 4 (English Wikipedia)

Article: Tour of Greece

Section: Past winners (note: the whole section is a table)

Example of section topics: Names of tour’s winners, ordered by relevance score: “Ioannis Tamouridis”, “Valeriy Dmitriyev”, “Henri Manders”, “Thomas Liese”, “Assan Bazayev”, etc.

Example 5 (Russian Wikipedia)

Article: Адлон (отель)

Section: История

Example of section topics: “Дитрих, Марлен”, “Вторая мировая война”, “Чаплин, Чарльз”, “Вильгельм II (император Германии)”, “Шинкель, Карл Фридрих”, “Первая мировая война”

Example 6 (Russian Wikipedia)

Article: Военная стратегия

Section: История

Example of section topics: “Сунь-цзы”, “Наполеон I”, “Первая мировая война”, “Искусство войны”, “Блицкриг”, “Александр Македонский”, “Вторая мировая война”

Further planned development

Based on the viability of those options, the project also aims at using section topics to improve our SEO reach with outside search engines, as a follow up to the experiment conducted in T302735.