NOTE: We got marionette working with eideticker, but decided it would be more important to simplify the harness and make it easier to run for developers.

Community Involvement

Cross-team project, ensure and maintain feedback loops with teams Eideticker is being developed for - close customer integration

Depends on

Marionette

Mozbase/Talos

Marionette

Q4 Outcomes

[DONE] Create receiver for JSON protocol

[DONE] Implement enough action to support the Eideticker tests

[MISSED] Land in m-c by end of quarter

NOTES: We were gated on landing in m-c by the remote debugger code landing in m-c. We drove it hard, but in the end the remote debugger code was held up by reviews and there will be no way to land in m-c by the end of the quarter. However, we will be landing in the b2g repo by the end of the quarter

Community Involvement

Cross-team project, ensure and maintain feedback loops with teams Eideticker is being developed for - close customer integration.

Depends on

Developer Tools Remote Debugging Code

A11y interfaces

W3C Browser Test Protocol definition (soft dependency)

SpecialPowers API

Q4 Outcomes

[DROPPED] Remove all enablePrivilege calls in all test frameworks and land patches in m-c

NOTES: We decided with the de-prioritization of E10S to drop SpecialPowers work and double down on native fennec work

Community Involvement

Be public and visible, try to recruit JS hackers to aid with project, engage developers to help expand APIs as needed

Depends on

Developer aid (original test writers usually) when issues arise

GOAL: User Responsiveness Automation

Talos User Responsiveness

Q4 Outcomes

[DONE] Deploy into production for desktop and android

[DONE] Finalize equation for responsiveness metric

[DONE] Determine if test can be deployed as addition to Tp5

[DONE] Work with developers and Releng for deployment

NOTES: Still tracking down linux failure, mac and windows landed

Community Involvement

Ensure blogs, newsgroups updated with changes and notices surrounding this system

Depends on

Developers creating the metric

Release Engineering for deployment

Stable android automation

Peptest User Responsiveness

Q4 Outcomes

[DONE] Land test harness in m-c with full integration (make targets etc)

[MISSED] Deploy into production for desktop automation

NOTES: Aki and Ahal made heroic efforts to get peptest deployed by end of Quarter. We did everything - interoperability bugs filed, debugged, and fixed, buildbot code staged, peptest landed in m-c, etc. Everything is ready to turn on for deployment to try, we just ran out of time before christmas vacations hit us. Expect to deploy to try in first two weeks of Q1.

[DONE] Provide simple API for driving UI (post-landing, stretch)

Community Involvement

Ensure community is up to date on the new harness and expectations surrounding it.

Ensure log parsers ready to accept the log format and developers educated on how to run it and parse the data from it

Depends on

Mozbase/mozharness

Release Engineering for deployment

Developers creating the metric for Talos User Responsiveness

Mozmill E10s (for driving API)

Supporting Projects

Many of our projects are inter-related, and there are many supporting projects that we want to call out as they are important and cannot be entirely neglected in favor of these goals. This section calls these out.

Bughunter

Q4 Outcomes

[DONE] UI Deployed, UI taken through find/fix cycle

[MISSED] Conduct demo/training for QA, Dev, and Product Mgmt on tool

[DONE] Create plan for soccoro integration

NOTE: We concentrated on the UI and pushed the demo/training into early Q1.

Community Involvement

Targeted involvement with other areas of Mozilla (see training outcome)

Interconnections

Increasing quality and security for the gecko platform by providing good data on crashes.

Mozbase

Q4 Outcomes

[DONE] Work with Release Engineering MozHarness to deploy a MozHarness/MozBase Talos system

NOTE: It's not fully deployed yet due to a talos bug that we hit on the way. Decided it was more important to continue improving mozharness and peptest and talos for native fennec than to drive this the rest of the way to completion.