Jump to content

Wikimedia Futures Lab/Dashboard/Experiment Tracker/Centralised Experiments Log

From Meta, a Wikimedia project coordination wiki

Possible model for the log:

Experiment background

[edit]

Owners: Eugene233, Carla (Soylacarli), Risker, Mayur-WMF, Eva Martin (WMDE)

Hypothesis:

[edit]

We believe that if we create a central log of experiments with outcomes, lessons, etc then:

  • We reduce risks of duplication
  • Better sharing of lessons
  • Faster evolution.

Brief explanation:

[edit]

We propose a centralized experiment log where people can document their experiments so the community can track what worked, what didn’t, and access any supporting documentation they want to share. Entries will be organized by categories (e.g., education, community, technical, etc.)

What's in it for experimenters?

[edit]
  • Share your experiments with the wider community - wider profile for your work
  • Find new collaborators
  • Log your experiment so that others can carry it on
  • Star trek jokes

Next tasks

[edit]
  • Confirm definition of an experiment. We propose it to be inclusive (e.g., edit filters, software, policy modification, activities funded by grants, etc, etc). This will increase awareness of how many experiments we actually do and how they do not have to be "big" to count.
  • Identify existing repositories of information. Determine who will populate the archive with existing information. Is there a way to automate some of these processes?
  • Who will be responsible for ongoing maintenance? Discuss with wikidata community what information they would be willing to include in available fields. Also discuss the possibility to work with metabase (wikibase instance).
  • what to do with experiments that are not publicly viewable (e.g, we will soon have edit filters that are visible only to oversighters as they will flag certain information covered by the privacy policy (ANPDP). Some anti-vandalism experiments are not publicly visible in order to make them harder to "defeat". Possibly some kind of exclusion statement?