Maniphest T298902

Add robots.txt to wbcloud mediawiki deployment
Open, Needs TriagePublic
Actions

Assigned To

Authored By

	Addshore
	Jan 10 2022, 6:23 PM

Tags

Referenced Files

None

Subscribers

Description

It was recently pointed out that the wbstack mediawiki doesn't currently have a robots.txt
It probably should.

We should add a robots.txt file to thee wiki service, probably using sensible mediawiki / wikibase defaults)

ACs:

<wiki>.wikibase.cloud/robots.txt returns a valid robot.txt
on staging/wikibase.dev, the robots.txt declines indexing (examples)

Patches

wbaas-deploy/pull/1915 | nginx: add robots.txt for Wikibase sites

Related Objects
Search...

		Status	Subtype	Assigned	Task
		Open	Feature	None	T16720 robots.txt (tracking)
		Open		Andrew-WMDE	T298902 Add robots.txt to wbcloud mediawiki deployment

Event Timeline

Addshore created this task.Jan 10 2022, 6:23 PM

Restricted Application added a subscriber: Aklapper. · View Herald TranscriptJan 10 2022, 6:23 PM

GreenReaper subscribed.Jan 10 2022, 6:25 PM

• Samantha_Alipio_WMDE moved this task from Ready to Pick Up to Backlog (incoming) on the Wikibase Cloud board.Jan 25 2022, 3:26 PM

Deniz_WMDE mentioned this in T306704: Add robots.txt for staging.May 2 2022, 12:36 PM

Deniz_WMDE updated the task description. (Show Details)May 2 2022, 12:43 PM

Deniz_WMDE merged a task: T306704: Add robots.txt for staging.May 2 2022, 12:45 PM

Deniz_WMDE subscribed.

Shizhao added a parent task: T16720: robots.txt (tracking).Oct 8 2022, 11:40 AM

Addshore added a subscriber: Tarrow.Nov 12 2024, 8:44 AM

Tarrow moved this task from Backlog (incoming) to Engineering prioritised backlog on the Wikibase Cloud board.Tue, Dec 10, 2:59 PM

Tarrow moved this task from Engineering prioritised backlog to Kanban Board Q4 2024 on the Wikibase Cloud board.Wed, Dec 11, 8:10 AM

Tarrow edited projects, added Wikibase Cloud (Kanban Board Q4 2024); removed Wikibase Cloud.

Andrew-WMDE claimed this task.Wed, Dec 11, 8:53 AM

Andrew-WMDE moved this task from To do to Doing on the Wikibase Cloud (Kanban Board Q4 2024) board.

Andrew-WMDE updated the task description. (Show Details)Wed, Dec 18, 9:03 AM

Andrew-WMDE moved this task from Doing to In Review on the Wikibase Cloud (Kanban Board Q4 2024) board.

Andrew-WMDE moved this task from In Review to Done on the Wikibase Cloud (Kanban Board Q4 2024) board.Thu, Dec 19, 1:03 PM

NODES