A/B Testing Test
About the test
The A/B Testing test assesses knowledge of designing and analyzing A/B tests in order to identify customer preferences and increase customer engagement and conversions.
The assessment includes work-sample tasks such as:
- Identifying which metric is directly affected by changes to a landing page.
- Choosing when multivariate testing should be performed.
- Using statistical significance to determine whether to continue an A/B test.
A good candidate for an A/B testing job will be competent in both test design and results analysis, and will understand how statistical significance impacts confidence levels.
Sample public questions
You have a new client, who operates an eCommerce business receiving traffic of 500 visitors per week. The client insists on presenting you with a list of ideas for improving their website and expects you to approve or reject each idea after careful consideration.
In the list below, enter “Y” if you would approve the idea and “N” if you would reject the idea.
_____ 1. Testing small changes to the landing page to increase the number of purchases by 1% per month.
_____ 2. Testing radically different redesigns of the landing page to increase conversions by 50%.
_____ 3. Test variations of the product page to increase Add to Cart clicks by 20%.
_____ 4. Test variations of the checkout process to increase completed purchases by 1%.
_____ 5. Use multivariate testing on your least-popular product pages to increase purchases.
_____ 6. Lower your statistical significance threshold to 75% to see the results of your tests more quickly.
For companies: premium questions
Buy TestDome to access premium questions that can't be practiced.
Get money back if you find any premium question answered online.
4 more premium A/B Testing questions
Skills and topics tested
- A/B Testing
- Multivariate Testing
- Results Analysis
- Statistical Significance
- Marketing Funnel
- Test Design
For job roles
- Data Analyst
- Digital Marketing Specialist
- Growth Hacker
Sample candidate report
What others say
Simple, straight-forward technical testing
TestDome is simple, provides a reasonable (though not extensive) battery of tests to choose from, and doesn't take the candidate an inordinate amount of time. It also simulates working pressure with the time limits.
Jan Opperman, Grindrod Bank
Solve all your skill testing needs
150+ Pre-made tests
From web development and database administration to project management and customer support. See all pre-made tests.
Mix questions for different skills or even custom questions in one test. See an example.
How TestDome works
Choose a pre-made test
or create a custom test
Invite candidates via
email, URL, or your ATS
a test remotely
Sort candidates and
get individual reports