imranansari / testpilot

Test Pilot is a platform for performing controlled tests of new product concepts in Firefox

Test Pilot

Test Pilot is an opt-in platform that allows us to perform controlled tests of new high-visibility product concepts in the general release channel of Firefox.

Test Pilot is not intended to replace trains for most features, nor is it a test bed for concepts we do not believe have a strong chance of shipping in general release. Rather, it is reserved for features that require user feedback, testing, and tuning before they ship with the browser.

Table of Contents

• Developing Test Pilot
  • Quickstart - Get your development environment working.
  • Add-on - Working on the Test Pilot add-on.
  • Testing - Automated testing.
  • Variants - Creating variant tests on the Test Pilot website.
  • Deployment - Deploying Test Pilot to staging and production
  • Dev Deployment - Deploying Test Pilot to the dev environment
  • Verifying deployments - Verifying Test Pilot deployments.
  • Add-on environment - Configuring to which server the add-on connects.
• Developing experiments
  • Experiment metrics - The use of Google Analytics to track experiment data.
  • Variant testing - Creating variant (e.g. A/B) tests in experiments.
  • Example experiments
• Metrics
  • Telemetry - How we use Firefox telemetry.
  • Google Analytics - How we use Google Analytics.
  • New features - Everything needed to instrument something new.
• Experiment content - Management of experiment content.
• Process - How we create, triage, and assign work.
• FAQ
• Contributing to Test Pilot
• Code of conduct
• License

Localization

Test Pilot localization is managed via Pontoon, not direct pull requests to the repository. If you want to fix a typo, add a new language, or simply know more about localization, please get in touch with the existing localization team for your language, or Mozilla’s l10n-drivers for guidance.

More Information

• Wiki: https://wiki.mozilla.org/Test_Pilot
• IRC: #testpilot on irc.mozilla.org