Kanban style board for work scheduled for Q1 FY24-25
Details
Details
Description
Nov 26 2024
Nov 26 2024
gmodena added a comment to T363587: [Event Platform] Instrument EventBus with prometheus MW Statslib.
hashar reopened T363587: [Event Platform] Instrument EventBus with prometheus MW Statslib as "Open".
Maintenance_bot removed a project from T363587: [Event Platform] Instrument EventBus with prometheus MW Statslib: Patch-For-Review.
gerritbot added a comment to T363587: [Event Platform] Instrument EventBus with prometheus MW Statslib.
Change #1062430 merged by jenkins-bot:
[operations/mediawiki-config@master] config: remove eventbus instrumentation setting
Nov 4 2024
Nov 4 2024
Ottomata added a comment to T367403: Validate CI integration so that Ci can release Maven artifacts on user's demand.
There was never an answer to some questions there.
Oct 31 2024
Oct 31 2024
EBernhardson added a comment to T367403: Validate CI integration so that Ci can release Maven artifacts on user's demand.
I'm looking at this in reference to releasing some projects, initially search/extra, search/extra-analysis, and search/highlighter, from gerrit. I see we didn't test releasing from gerrit yet. I suppose my main question is where should gerrit repos publish in gitlab? It seems either we create a project per repo, or we use a shared repo. I'm not fully versed in gitlab, but the access tokens i've used so far are per-repo. Shared repo would mean shared secret instead of per-project. Also i believe access tokens are max 1 year, so they will need rotation.
Oct 23 2024
Oct 23 2024
Ahoelzl edited projects for T373633: Allow maxLength changes for json schema compatibility, added: Data-Engineering (Q1 2024 July 1st - September 30th); removed Data-Engineering.
Oct 11 2024
Oct 11 2024
Antoine_Quhen updated subscribers of T369900: Develop Airflow ExternalTaskSensor to orchestrate DAG dependencies.
gmodena updated the task description for T363587: [Event Platform] Instrument EventBus with prometheus MW Statslib.
Oct 9 2024
Oct 9 2024
Maintenance_bot removed a project from T372768: [BUG] MediawikiPageContentChangeEnrichAvailability is firing : Patch-For-Review.
Ahoelzl closed T370428: PHP Warning: Invalid argument supplied for foreach() in EventBus.php as Resolved.
Ahoelzl closed T369900: Develop Airflow ExternalTaskSensor to orchestrate DAG dependencies as Resolved.
Ahoelzl closed T372014: Problem deploying - missing airflow_client dependency, a subtask of T369900: Develop Airflow ExternalTaskSensor to orchestrate DAG dependencies, as Resolved.
Ahoelzl closed T363587: [Event Platform] Instrument EventBus with prometheus MW Statslib as Resolved.
Ahoelzl closed T342911: Data Quality Issue: Wikitext History Job fail / rerun in Airflow as Resolved.
CodeReviewBot added a comment to T369845: [Refine Refactoring] Refine jobs should be scheduled by Airflow: deployment.
CodeReviewBot added a comment to T368787: Flink job to enrich reconciliation events.
gerritbot added a comment to T368787: Flink job to enrich reconciliation events.
Change #1078923 had a related patch set uploaded (by Gmodena; author: Gmodena):
[operations/deployment-charts@master] dse-k8s-services: content_history: version bump image.
CodeReviewBot added a project to T369845: [Refine Refactoring] Refine jobs should be scheduled by Airflow: deployment: Patch-For-Review.
Oct 8 2024
Oct 8 2024
Ottomata added a comment to T366836: Migrate Event Platform Schema Respositories to Gitlab.
!!! amazing!
Ottomata added a comment to T376144: Some Gobblin folders don't have `_IMPORTED` flags.
It isn't yet, but I think it will be? There are others that are ingested. mediawiki.page_change.v1, but it only has one partition.
Snwachukwu updated subscribers of T366836: Migrate Event Platform Schema Respositories to Gitlab.
The switchover has been done. The gerrit repositories are deprecated(set to read-only) and the schema servers have all been updated with the gitlab urls with @BTullis support.
JAllemandou added a comment to T376144: Some Gobblin folders don't have `_IMPORTED` flags.
Ah! I had forgotten :) But this st4ream is not ingested in hadoop.
Anyhow, if you agree with the approach, I can implement it.
Ottomata added a comment to T376144: Some Gobblin folders don't have `_IMPORTED` flags.
keyed-topics is theoretical for us as we don't use them
FWIW, we do use them:
Maintenance_bot removed a project from T366836: Migrate Event Platform Schema Respositories to Gitlab: Patch-For-Review.
JAllemandou added a comment to T376144: Some Gobblin folders don't have `_IMPORTED` flags.
Our algorithm about flagging folders is working at topic-partition-level for high-volume topics, and at topic-level for low-volume topics. It doesn't really make sense to mix them.
My suggested solution would be to discard low-volume topic-partitions from high-volume topics. I think this would cover the issue.