Page MenuHomePhabricator

Finish Edit Check measurement plan proposal
Closed, ResolvedPublic

Description

This task involves the work with finalizing a proposal for the measurement plan that will guide the experiments and analyses the Editing Team will run and complete to evaluate the impact of the Edit Check project.

NOTE: we will consult with volunteers about this measurement plan as part of T333709.

Draft

Edit Check/Measurement Plan

Process

StepDescriptionPeople ResponsibleStatus
1.Draft measurement plan (e.g. project goals, hypotheses, research questions, experiment plan, etc.)@ppelberg✅ done
2.Review measurement plan draft + propose methods/metrics for evaluating hypotheses and answering research questions@MNeisler + @nayoub✅ done
3.Review measurement plan as a teamEditing-team✅ done
4.Finalize measurement plan@MNeisler + @ppelberg✅ done
5.Publish measurement plan on mediawiki.org@ppelbergPublication and consultation will happen in T333709

Done

  • Each step in the ===Process outlined above is completed

Related Objects

StatusSubtypeAssignedTask
OpenNone
OpenTrizek-WMF
OpenNone
ResolvedReleaseppelberg
Resolvedppelberg
ResolvedNone
Resolvedppelberg
ResolvedRyasmeen
Resolvedppelberg
OpenNone
OpenNone
ResolvedEsanders
Resolveddchan
DuplicateNone
ResolvedEsanders
OpenNone
Resolvedppelberg
Resolvedppelberg
ResolvedEsanders
ResolvedDLynch
OpenNone
OpenNone
OpenNone
OpenNone
ResolvedEsanders
OpenNone
OpenNone
OpenNone
ResolvedEsanders
OpenNone
ResolvedEsanders
OpenNone
Resolvedppelberg
InvalidNone
Resolvedppelberg
OpenNone

Event Timeline

ppelberg moved this task from Incoming to Doing on the Editing-team (Kanban Board) board.
ppelberg moved this task from To Triage to Triaged on the VisualEditor board.
MNeisler triaged this task as Medium priority.Jan 17 2023, 5:08 PM
MNeisler edited projects, added Product-Analytics (Kanban); removed Product-Analytics.

@ppelberg
I've completed my review of the Edit Check Measurement Plan and proposed some quantitive metrics and evaluation methods.

Currently reassigning this task to you for review.

@ppelberg
I've completed my review of the Edit Check Measurement Plan and proposed some quantitive metrics and evaluation methods.

Currently reassigning this task to you for review.

Alright! @MNeisler: I've gone in and responded to the open comments within the measurement plan draft.

By the time you and I finish meeting on Wednesday (22 Feb), I think we'll be in a good position to share this with the team for review.

ppelberg renamed this task from Publish Edit Check measurement plan to Finish Edit Check measurement plan proposal.Mar 31 2023, 5:15 PM
ppelberg updated the task description. (Show Details)

The measurement plan has been reviewed and updated to ensure it reflects the leading indicators from the pre-mortem and was used as the basis for the proposed instrumentation documented in the instrumentation spec and mobile annotated UX mockup.

This and the instrumentation requirements have been shared with the Editing team via Slack.

Next step: Complete final review with @ppelberg

ppelberg added a project: Goal.

The measurement plan has been reviewed and updated to ensure it reflects the leading indicators from the pre-mortem and was used as the basis for the proposed instrumentation documented in the instrumentation spec and mobile annotated UX mockup.

This and the instrumentation requirements have been shared with the Editing team via Slack.

Next step: Complete final review with @ppelberg

With the measurement plan posted (see T333709#9111754) , we can consider this ask complete.

  NODES
Community 1
Experiments 1
HOME 1
Note 3
os 17
Users 1
visual 2