cfrtesting.md

CFR-testing.md

CFR Testing instructions for Release Fx 65

General Setup

Start by creating a new profile with default settings.

Expected Behaviour

An add-on recommendation should show up when users have visisted targeted sites a sufficient number of times for the following add-ons:

• Youtube
• Google Translate
• Facebook Container

You should NOT see recommendations for:

• Amazon
• Wikipedia
• Reddit

An individual recommendation may be shown a maximum of three times per add-on, but only one recommendation of any kind should be shown per day.

Expected telemetry **IMPORTANT

Telemetry pings for CFR should NOT contain:

• message_id
• client_id

Appearance of a recommendation

When a recommendation appears, it will show up in the right-hand corner of the awesomebar:

How to trigger targeting conditions for a recommendation

Assuming you have completed the General Setup section above, follow these steps to trigger the appropriate targeting conditions. Replace facebook.com in these steps with whatever targeting URL you are testing.

Increase frecency of facebook.com

• Do the following steps 5 times:
  • open a new tab
  • copy and paste https://facebook.com into the awesome bar OR click on a facebook top site on the new tab page
    • IMPORTANT: just typing in the URL or clicking on a regular link will NOT accumulate enough frecency in 5 visits.
  • load the site

Verify frecency via the browser console

• Open the browser toolbox console and run the following code to see a list of organic top sites and their frecencies:

NewTabUtils.activityStreamProvider.getTopFrecentSites({numItems: 25}).then(r => console.log(r.map(s=>`${s.url} [${s.frecency}]`).join('\n')))

• You should see facebook.com listed as having a frecency of 10000. If it is not at least then thousand, visit https://facebook.com some more and re-run the code above to check.
• Restart the browser (this is needed to reset the frecency cache in Activity Stream)

Trigger the recommendation

• Visit https://facebook.com one more time

You should now see the recommendation.