A/B Testing Test
For jobseekers
Practice your skills and earn a certificate of achievement when you score in the top 25%.
Take a Practice TestFor companies
Test candidates with real-world problems and interview the best ones.
Sign Up to Offer this TestAbout the test
The A/B Testing test assesses knowledge of designing and analyzing A/B tests in order to identify customer preferences and increase customer engagement and conversions.
The assessment includes work-sample tasks such as:
- Identifying which metric is directly affected by changes to a landing page.
- Choosing when multivariate testing should be performed.
- Using statistical significance to determine whether to continue an A/B test.
A good candidate for an A/B testing job will be competent in both test design and results analysis, and will understand how statistical significance impacts confidence levels.
Sample public questions
You were testing two new title ideas for a pricing page with the following results:
| Views | Conversions | |
|---|---|---|
| Original | 4,300 | 436 |
| Proposal A | 4,000 | 440 |
| Proposal B | 3,700 | 415 |
You have a new client, who operates an eCommerce business that receives traffic of 500 visitors per week. The client insists on presenting a list of ideas for improving their website and expects you to approve or reject each idea from a statistical perspective.
In the list below, enter “Y” if you would approve the idea and “N” if you would reject the idea.
| _____ | 1. Testing changes throughout the entire landing page to increase purchases by up to 1% per month. |
| _____ | 2. Testing different redesigns of the landing page to increase conversions by 50%. |
| _____ | 3. Test variations of the product page to increase Add to Cart clicks by 20%. |
| _____ | 4. Test multiple variations of the entire checkout process to possibly increase completed purchases, the last funnel level, by up to 1%. |
| _____ | 5. Lower your statistical significance threshold to 75% to see the results of your tests more quickly. |
For jobseekers: get certified
Earn a free certificate by achieving top 25% on the A/B Testing test with public questions.
Take a Certification TestSample silver certificate
Sunshine Caprio
Java and SQL TestDomeCertificate
For companies: premium questions
Buy TestDome to access premium questions that can't be practiced.
Get money back if you find any premium question answered online.
4 more premium A/B Testing questions
AB or Multivariate, Subscribe Button, Budget Allocation, Optimize Landing.
Skills and topics tested
- A/B Testing
- Multivariate Testing
- Test Design
- Results Analysis
- Statistical Significance
- Marketing Funnel
- Metrics
For job roles
- Data Analyst
- Digital Marketing Specialist
- Growth Hacker
Sample candidate report
Need it fast? AI-crafted tests for your job role
TestDome generates custom tests tailored to the specific skills you need for your job role.
Sign up now to try it out and see how AI can streamline your hiring process!
What others say
Simple, straight-forward technical testing
TestDome is simple, provides a reasonable (though not extensive) battery of tests to choose from, and doesn't take the candidate an inordinate amount of time. It also simulates working pressure with the time limits.
Jan Opperman, Grindrod Bank
Product reviews
Used by
Solve all your skill testing needs
150+ Pre-made tests
130+ skills
Multi-skills Test
How TestDome works
Choose a pre-made test
or create a custom test
Invite candidates via
email, URL, or your ATS
Candidates take
a test remotely
Sort candidates and
get individual reports
