Page MenuHomePhabricator

Migrate Event Platform Schema Respositories to Gitlab
Open, HighPublic5 Estimated Story Points

Description

Schema Repositories

Since these repositories are used by many teams, this move will require communication and coordination.

Documentation will need to be updated.

These repositories are 'dependencies' but they are not npm packages. They are used as deployed git repositories. We will need to change where they are git pulled from.

Need to change git URL:

Event Timeline

Ottomata set the point value for this task to 5.Jun 6 2024, 6:40 PM

Change #1071891 had a related patch set uploaded (by Snwachukwu; author: Snwachukwu):

[operations/puppet@production] Change New Eventschemas Git URLs

https://gerrit.wikimedia.org/r/1071891

@Snwachukwu nice! I've asked @gmodena to help review.

BTW, before we make these changes, we should announce this. Relevant WMF engineering email lists and slack channels. We should also give some time for folks to adjust, with a cutover date.

We mirror repos (read-only) from Gerrit to GitHub, is there a way we can do the same to Gitlab? That could help soft landing this roll out.

A question was raised regarding keeping permissions of current gerrit secondary schema repository as it is when migrated to gitlab. see slack thread. We are currently discussing with developer-experience on slack. how to replicate the groups (ldap wmf and wmde) in gitlab

Thanks for the material to contributing policy @gmodena. It's helpful

@gmodena , We have the mediawiki group and wmde group (recently added by developer-experience) available in gitlab. So I have added them to the members of the Secondary event schema repo in Gitlab and given them the developer role.

So everyone in that group should be able to clone the repo and create an MR directly and merge once approved. No need to fork + MR.

Let me know if this is okay.

I have MRs for contribution policy drafts. Please help review @gmodena

  1. primary
  2. secondary

@gmodena , We have the mediawiki group and wmde group (recently added by developer-experience) available in gitlab. So I have added them to the members of the Secondary event schema repo in Gitlab and given them the developer role.

So everyone in that group should be able to clone the repo and create an MR directly and merge once approved. No need to fork + MR.

Let me know if this is okay.

Sounds good. As discussed on Slack, we'll still need to account for non-staff contributors with +2 rights. In those cases, we should be able to add individual accounts to the developers' repo group when needed.

@gmodena, any pointers to how I can get the list of non-staff contributors? From my understanding I thought only those in this list had access to the previous gerrit repo

Plan for EventPlatform Schema Migration.

  1. Schema repositories
    • Get permissions sorted for secondary schema (Done)
    • Set up Gitlab CI
    • Add a contributing policy file
  1. Update Documentations
  1. Change git URL in the following repositories:
    • schema.wikimedia.org service see patch waiting to be approved and merged.
    • eventgate-wikimedia docker image build pipeline - patch has been merged
    • Mediawiki-event-enrichment .gitmodules - MR has been merged
    • Custom-data-monitor - MR has been merged

Next steps to finalize migration:

  • Notify everyone of the change and planned date for migration

    These will be done on the day of switchover:
  • Trigger release eventgate-wikimedia MR
  • Archive gerrit repositories
  • Merge puppet patch (We would need SRE support to manage merging this patch and changing the origin URLs by recloning.)

We plan to do the switch in 1 week time i.e 8th October, 2024.
Data-Platform-SRE We would need your support to manage merging this patch next Tuesday, on 8th October. We need to make sure the existent checkout have its git origin changed. Please help confirm availability so I can proceed with notifying everyone of this date.

Change #1071891 merged by Btullis:

[operations/puppet@production] Change New Eventschemas Git URLs

https://gerrit.wikimedia.org/r/1071891

The switchover has been done. The gerrit repositories are deprecated(set to read-only) and the schema servers have all been updated with the gitlab urls with @BTullis support.

Change #1087573 had a related patch set uploaded (by Jdlrobson; author: Jdlrobson):

[schemas/event/secondary@master] Clear repository to make it clearer it has moved

https://gerrit.wikimedia.org/r/1087573

Change #1087611 had a related patch set uploaded (by Jdlrobson; author: Jdlrobson):

[schemas/event/primary@master] Mark repo as archived

https://gerrit.wikimedia.org/r/1087611

Change #1087573 merged by jenkins-bot:

[schemas/event/secondary@master] Clear repository to make it clearer it has moved

https://gerrit.wikimedia.org/r/1087573

Change #1087611 merged by jenkins-bot:

[schemas/event/primary@master] Mark repo as archived

https://gerrit.wikimedia.org/r/1087611

Change #1103447 had a related patch set uploaded (by Jforrester; author: Jforrester):

[integration/config@master] Zuul: Mark schemas/event/{primary,secondary} as archived

https://gerrit.wikimedia.org/r/1103447

Change #1103447 merged by jenkins-bot:

[integration/config@master] Zuul: Mark schemas/event/{primary,secondary} as archived

https://gerrit.wikimedia.org/r/1103447

Mentioned in SAL (#wikimedia-releng) [2024-12-13T19:53:40Z] <James_F> Zuul: Mark schemas/event/{primary,secondary} as archived, for T366836

  NODES
inspiration 1
Note 1
Project 19