Edit me

Overview

There can be multiple QA phases during testing of a campaigns.

Phase 1

Here’s how the Phase-1 process of QA testing at OptiPhoenix looks:

  1. Read the brief and understand the requirements
  2. Go through the website and relate with design
  3. Match “the briefing by dev” and “the instructions in actual brief”
  4. Copy the General Checklist from the QA sheet
  5. Add your own Use cases in the QA sheet ( Copy the requirements from the brief if mentioned + Create your own test cases )
  6. Perform the testing on the website according to the test cases
  7. Before providing the testing results to the dev, match if everything is done from the Checklist

Phase 2

Phase 2 of testing involves retesting, and goal verifications. Here’s how the Phase 2 might look:

  1. Verify the bugs fixed by the developer
  2. Update the status in the sheet
  3. Check on live by applying cookie (if applicable)
  4. Verify the Target, Audience, Integration, Goals in CRO tool
  5. Give Final Feedback to the dev (if any)

Ways of Testing

There are different ways to test a campaign. These methods are not mutually exclusive and may be used one after the other in different phases of testing. Here’s how one can test a campaign:

A preview link is provided by the dev in the trello card or can be obtained from the AB Testing tool. It consist of (the test url + a preview parameter). For example, https://www.xbox.com/en-US?at_preview_token=4FhxMZZq5RXQNNpOOuFqCCp&at_preview_index=1

The part of the URL before the question mark is the test url on which our campaign is running and the bold part starting from “?…” is our preview parameter generated by the CRO tool. The length of preview parameter may vary for different CRO tools.

All the tester needs to do is to just paste the preview link in the browser and open the page.

The campaign should be visible.

Campaigns may be pushed live for an audience that contains a customised cookie. This allows the tester to test the campaign in a real and more accurate environment compared to the previous method which used preview links. Hence, it is a beneficial and important way to test the campaign, but it is not always possible as it may require approval from client.

After the campaign has been pushed live on a customised cookie, for example cfQA cookie, all the tester needs to do is:

  1. Open the test page URL
  2. Open console in dev tools
  3. Add the cookie code provided by the devs
  4. Refresh the page

Here’s an example of the cookie code one might be given for a customized cookie ‘cfQA’ `document.cookie=”cfQA=true;path=/”;

A test remains part of the campaign as long as they have the cookie and still meet the targeting requirements.

3. By using JS and CSS

Sometimes we may not have the access to the CRO tool. In this case, we can’t generate a preview link or push the campaign live on a cookie in the initial phase. In this method, we may only have the Test page URL, and a combined or separate notepad links with the JS code and CSS. This is the primary method of unit testing by developers but is usually followed by the other ways of testing in later phases. This cannot be used to test on mobile devices without connecting your mobile to a laptop, or without the use of an emulator tool like Browserstack.

Here are steps to follow:

For chrome

  1. Download an extension for chrome - User JavaScript and CSS
  2. Open Test Page URL

  3. Click on the extension and add a new snippet

  4. Add the JS code in JS area and CSS ( if any ) into the CSS area

  5. Go back to the Test Page Tab

  6. Click on extension again to make sure the snippet is turned ON

  7. Refresh the page and changes should be visible

For other browsers

  1. Open dev tools
  2. Paste JS code in console
  3. Add a style tag inside the body tag of the HTML <style> ...css here... </style>

Goals Verification

These campaigns are built to test how a user might react to change, and how much they like this experience compared to the control. Goals or metrics provide us the analytical data from AB Testing that helps us figure out if a campaign was successful or not. Hence, they are the most crucial part of AB Testing and need special attention to verify before we deliver a campaign.

Click here to read more about goals and how we can test them.

Tags: getting_started