Having a solid hypothesis before you run a test is essential. Without it you don’t know what you are trying to prove or disprove, and you risk wasting valuable time and resource.

A hypothesis helps to clarify why you are running a test and aligns your team on a clear objective.

There are three questions you should ask yourself when developing a test idea:

  1. What is the problem you are trying to solve?
  2. What is your proposed solution?
  3. What is your predicted outcome?

If you can’t answer these questions then you don’t have a test worth running. If you can answer these questions then you have your hypothesis.

 

Problem
Most test ideas evolve off the back of data. For example, you might spot that step 2 in your sign up funnel has a significant drop off rate.

Solution
You can see what is happening but you might not necessarily know why. It’s time to get creative and come up with some assumptions about why the problem is occurring. Armed with these assumptions you can create some solutions that you think will fix the issue.

For example, I think users are dropping off from step 2 in the sign in funnel because we are asking for their date of birth and the request for personal data is putting them off from continuing. We should remove this mandatory field.

Outcome
What’s the expected outcome of the test? In this example, I predict by making the changes above we will increase the sign in rate.

I can now structure this thought process into a written hypothesis for everyone to see:

“60% of users are dropping out of step 2 of the sign in funnel. This is because we are asking for a date of birth, which is deterring people. By removing this mandatory field we will remove this barrier and increase sign in rate”

This hypothesis has even given me a success metric to measure the outcome of my test – sign in rate.

I spend alot of time preaching to my colleagues about this approach. I even have it on the wall above my desk for the whole office to see:

Early on in my testing days I made some epic mistakes. Running tests without a solid hypothesis was one of them, so I encourage you to take the right approach in order to maximise your ab testing efforts.

The featured image was Designed by Freepik

Growth Lead at Dailymotion, Richard has a passion for improving user experience and ROI through data and experimentation.

684 thoughts on “How To Form A Hypothesis for A/B Testing

  1. Pingback: viagra coupon
  2. Pingback: levitra vs cialis
  3. Pingback: prices of cialis
  4. Pingback: ed pills online
  5. Pingback: cialis 20 mg
  6. Pingback: canadian pharmacy
  7. Pingback: cialis visa
  8. Pingback: order vardenafil
  9. Pingback: buy viagra online
  10. Pingback: payday loans
  11. Pingback: cash loan
  12. Pingback: buy cialis
  13. Pingback: 5 mg cialis
  14. Pingback: generic for cialis
  15. Pingback: cialis 5 mg
  16. Pingback: cialis 20
  17. Pingback: gambling casino
  18. Pingback: viagra canada
  19. Pingback: viagra dosage
  20. Pingback: tadalafil 20 mg
  21. Pingback: viagra
  22. Pingback: generic sildenafil
  23. Pingback: viagra
  24. Pingback: buy sildenafil
  25. Pingback: buy Viagra 130 mg
  26. Pingback: free cialis coupon
  27. Pingback: Viagra 50 mg cheap
  28. Pingback: order Viagra 50 mg
  29. Pingback: Cialis 60 mg otc
  30. Pingback: Cialis 20mg uk
  31. Pingback: Cialis 10 mg usa
  32. Pingback: Cialis 20mg uk
  33. Pingback: canadian viagra
  34. Pingback: buy viagra online
  35. Pingback: Cialis 60 mg pills
  36. Pingback: lexapro 5 mg usa
  37. Pingback: viagra price
  38. Pingback: abilify 20 mg uk
  39. Pingback: actos 15mg tablet
  40. Pingback: order aricept 10mg
  41. Pingback: order cialis
  42. Pingback: atarax 25mg nz
  43. Pingback: benicar 40 mg nz
  44. Pingback: cialis 10mg
  45. Pingback: cardizem 90 mg nz
  46. Pingback: generic cialis
  47. Pingback: casodex nz
  48. Pingback: order ceclor
  49. Pingback: buy cheap viagra
  50. Pingback: celexa 20mg uk
  51. Pingback: best ed pills
  52. Pingback: buy claritin 10 mg
  53. Pingback: play casino
  54. Pingback: casino real money
  55. Pingback: slots real money
  56. Pingback: casino online
  57. Pingback: generic cialis
  58. Pingback: casino slot
  59. Pingback: buy tadalafil
  60. Pingback: buy cialis
  61. Pingback: buy cialis
  62. Pingback: usaa car insurance
  63. Pingback: cialis
  64. Pingback: quick loans online
  65. Pingback: 5mg cialis
  66. Pingback: payday loans pa
  67. Pingback: buy cialis online
  68. Pingback: how to use cbd oil
  69. Pingback: were to buy viagra
  70. Pingback: Buy online viagra
  71. Pingback: writer essay
  72. Pingback: clomid pills
  73. Pingback: clonidine purchase
  74. Pingback: buy viagra now
  75. Pingback: clozaril 25mg nz
  76. Pingback: cialis tubs
  77. Pingback: cialis ohne ed
  78. Pingback: coreg pills
  79. Pingback: cheap coumadin
  80. Pingback: buy viagra online
  81. Pingback: dapsone caps price
  82. Pingback: buy depakote
  83. Pingback: cheap diltiazem
  84. Pingback: Viagra mail order
  85. Pingback: viagra pills
  86. Pingback: etodolac australia
  87. Pingback: online pharmacy
  88. Pingback: buy viagra
  89. Pingback: cialis reviews
  90. Pingback: does cialis work
  91. Pingback: imodium coupon
  92. Pingback: cheap viagra
  93. Pingback: generic pills
  94. Pingback: lopid pills
  95. Pingback: generic sildenafil
  96. Pingback: lopressor cost
  97. Pingback: luvox australia
  98. Pingback: order macrobid
  99. Pingback: meclizine cheap
  100. Pingback: viagra copyright
  101. Pingback: mestinon tablet
  102. Pingback: Enalapril
  103. Pingback: canada pharmacy
  104. Pingback: sildenafil citrate
  105. Pingback: buy motrin
  106. Pingback: cheapest periactin
  107. Pingback: viagra
  108. Pingback: phenergan for sale
  109. Pingback: proscar tablets
  110. Pingback: generic viagra
  111. Pingback: pyridium usa
  112. Pingback: claritin-d
  113. Pingback: buy rogaine 5%
  114. Pingback: viagra
  115. Pingback: slipped viagra mom
  116. Pingback: tadora vs cialis
  117. Pingback: buy viagra online
  118. Pingback: genrric viagra
  119. Pingback: tricor purchase
  120. Pingback: verapamil tablet
  121. Pingback: zanaflex canada
  122. Pingback: zestril usa
  123. Pingback: view website
  124. Pingback: check this
  125. Pingback: zocor canada
  126. Pingback: order viagra usa
  127. Pingback: sildenafil cost
  128. Pingback: cialis captions
  129. Pingback: cialus vs viagra
  130. Pingback: atomoxetine cheap
  131. Pingback: cialis online
  132. Pingback: buy viagra online
  133. Pingback: buspirone price
  134. Pingback: clonidinemg cost
  135. Pingback: cefuroxime otc
  136. Pingback: cheap citalopram
  137. Pingback: cialis online
  138. Pingback: clozapine 50mg uk
  139. Pingback: alcohol and viagra
  140. Pingback: cialis on line
  141. Pingback: rosuvastatin pills
  142. Pingback: divalproex prices
  143. Pingback: cheap viagra 100mg
  144. Pingback: trazodone pills
  145. Pingback: buy cialis rush
  146. Pingback: permethrin price
  147. Pingback: 141genericExare
  148. Pingback: order cialis
  149. Pingback: buy cialis now
  150. Pingback: cialis vs levitra
  151. Pingback: nulwvwgm
  152. Pingback: generic ed pills
  153. Pingback: lzitnnnw
  154. Pingback: viagra hoe lang
  155. Pingback: otc viagra
  156. Pingback: furosemida
  157. Pingback: noroxin tablets
  158. Pingback: isosorbide online
  159. Pingback: flagyl for sale
  160. Pingback: vantin online
  161. Pingback: cheap loperamide
  162. Pingback: comprar cialis
  163. Pingback: buy cialis
  164. Pingback: azathioprine cheap
  165. Pingback: propranolol usa
  166. Pingback: viagra
  167. Pingback: write my essay uk
  168. Pingback: viagra porn
  169. Pingback: buy cialis toronto
  170. Pingback: Google
  171. Pingback: price of viagra
  172. Pingback: amoxicillin pills
  173. Pingback: albuterol
  174. Pingback: ventolin price usa
  175. Pingback: doxycycline hyc
  176. Pingback: clomid and twins
  177. Pingback: priligy pastilals
  178. Pingback: neurontin 400
  179. Pingback: propecia buy
  180. Pingback: cialis by mail
  181. Pingback: doses of metformin
  182. Pingback: propecia proscar
  183. Pingback: propecia tablets
  184. Pingback: Aceon
  185. Pingback: herbals
  186. Pingback: Zakhar Berkut
  187. Pingback: buy levitra online
  188. Pingback: Cialis Soft Tabs
  189. Pingback: cialisis online
  190. Pingback: 4569987
  191. Pingback: \'generic cialis\'
  192. Pingback: cialis online uk
  193. Pingback: news news news
  194. Pingback: psy
  195. Pingback: psy2022
  196. Pingback: projectio-freid
  197. Pingback: natural viagra
  198. Pingback: Google
  199. Pingback: ivermectin pills
  200. Pingback: Tinderentrar.com
  201. Pingback: kinoteatrzarya.ru
  202. Pingback: topvideos
  203. Pingback: video
  204. Pingback: canadian services
  205. Pingback: tinder scams text
  206. Pingback: 1911 Magazines
  207. Pingback: Ukrainskie-serialy
  208. Pingback: site
  209. Pingback: cialis 5mg tablet
  210. Pingback: Adult dating site
  211. Pingback: top
  212. Pingback: sublingual cialis
  213. Pingback: sex toys
  214. Pingback: bondage toys
  215. Pingback: vibrator
  216. Pingback: fildena 100 online
  217. Pingback: Glock 17
  218. Pingback: best ed drugs
  219. Pingback: eskort pendik
  220. Pingback: canadapharmacy.com
  221. Pingback: anal vibe
  222. Pingback: viagra online
  223. Pingback: treatment for ed
  224. Pingback: viagra connect cvs
  225. Pingback: naughty sex games
  226. Pingback: anal vibrator
  227. Pingback: stendra vs viagra
  228. Pingback: price of viagra
  229. Pingback: cvs viagra cost
  230. Pingback: PARROTS FOR SALE
  231. Pingback: software review
  232. Pingback: PULVERIZER
  233. Pingback: kratom capsules
  234. Pingback: Dating online
  235. Pingback: best kratom
  236. Pingback: chelovek-iz-90-h
  237. Pingback: podolsk-region.ru
  238. Pingback: plus size toys
  239. Pingback: cytotmeds.com

Comments are closed.