Having a solid hypothesis before you run a test is essential. Without it you don’t know what you are trying to prove or disprove, and you risk wasting valuable time and resource.

A hypothesis helps to clarify why you are running a test and aligns your team on a clear objective.

There are three questions you should ask yourself when developing a test idea:

  1. What is the problem you are trying to solve?
  2. What is your proposed solution?
  3. What is your predicted outcome?

If you can’t answer these questions then you don’t have a test worth running. If you can answer these questions then you have your hypothesis.

 

Problem
Most test ideas evolve off the back of data. For example, you might spot that step 2 in your sign up funnel has a significant drop off rate.

Solution
You can see what is happening but you might not necessarily know why. It’s time to get creative and come up with some assumptions about why the problem is occurring. Armed with these assumptions you can create some solutions that you think will fix the issue.

For example, I think users are dropping off from step 2 in the sign in funnel because we are asking for their date of birth and the request for personal data is putting them off from continuing. We should remove this mandatory field.

Outcome
What’s the expected outcome of the test? In this example, I predict by making the changes above we will increase the sign in rate.

I can now structure this thought process into a written hypothesis for everyone to see:

“60% of users are dropping out of step 2 of the sign in funnel. This is because we are asking for a date of birth, which is deterring people. By removing this mandatory field we will remove this barrier and increase sign in rate”

This hypothesis has even given me a success metric to measure the outcome of my test – sign in rate.

I spend alot of time preaching to my colleagues about this approach. I even have it on the wall above my desk for the whole office to see:

Early on in my testing days I made some epic mistakes. Running tests without a solid hypothesis was one of them, so I encourage you to take the right approach in order to maximise your ab testing efforts.

The featured image was Designed by Freepik

Growth Lead at Dailymotion, Richard has a passion for improving user experience and ROI through data and experimentation.

1,093 thoughts on “How To Form A Hypothesis for A/B Testing

  1. Pingback: viagra coupon
  2. Pingback: levitra vs cialis
  3. Pingback: prices of cialis
  4. Pingback: ed pills online
  5. Pingback: cialis 20 mg
  6. Pingback: canadian pharmacy
  7. Pingback: cialis visa
  8. Pingback: order vardenafil
  9. Pingback: buy viagra online
  10. Pingback: payday loans
  11. Pingback: cash loan
  12. Pingback: buy cialis
  13. Pingback: 5 mg cialis
  14. Pingback: generic for cialis
  15. Pingback: cialis 5 mg
  16. Pingback: cialis 20
  17. Pingback: gambling casino
  18. Pingback: viagra canada
  19. Pingback: viagra dosage
  20. Pingback: tadalafil 20 mg
  21. Pingback: viagra
  22. Pingback: generic sildenafil
  23. Pingback: viagra
  24. Pingback: buy sildenafil
  25. Pingback: buy Viagra 130 mg
  26. Pingback: free cialis coupon
  27. Pingback: Viagra 50 mg cheap
  28. Pingback: order Viagra 50 mg
  29. Pingback: Cialis 60 mg otc
  30. Pingback: Cialis 20mg uk
  31. Pingback: Cialis 10 mg usa
  32. Pingback: Cialis 20mg uk
  33. Pingback: canadian viagra
  34. Pingback: buy viagra online
  35. Pingback: Cialis 60 mg pills
  36. Pingback: lexapro 5 mg usa
  37. Pingback: viagra price
  38. Pingback: abilify 20 mg uk
  39. Pingback: actos 15mg tablet
  40. Pingback: order aricept 10mg
  41. Pingback: order cialis
  42. Pingback: atarax 25mg nz
  43. Pingback: benicar 40 mg nz
  44. Pingback: cialis 10mg
  45. Pingback: cardizem 90 mg nz
  46. Pingback: generic cialis
  47. Pingback: casodex nz
  48. Pingback: order ceclor
  49. Pingback: buy cheap viagra
  50. Pingback: celexa 20mg uk
  51. Pingback: best ed pills
  52. Pingback: buy claritin 10 mg
  53. Pingback: play casino
  54. Pingback: casino real money
  55. Pingback: slots real money
  56. Pingback: casino online
  57. Pingback: generic cialis
  58. Pingback: casino slot
  59. Pingback: buy tadalafil
  60. Pingback: buy cialis
  61. Pingback: buy cialis
  62. Pingback: usaa car insurance
  63. Pingback: cialis
  64. Pingback: quick loans online
  65. Pingback: 5mg cialis
  66. Pingback: payday loans pa
  67. Pingback: buy cialis online
  68. Pingback: how to use cbd oil
  69. Pingback: were to buy viagra
  70. Pingback: Buy online viagra
  71. Pingback: writer essay
  72. Pingback: clomid pills
  73. Pingback: clonidine purchase
  74. Pingback: buy viagra now
  75. Pingback: clozaril 25mg nz
  76. Pingback: cialis tubs
  77. Pingback: cialis ohne ed
  78. Pingback: coreg pills
  79. Pingback: cheap coumadin
  80. Pingback: buy viagra online
  81. Pingback: dapsone caps price
  82. Pingback: buy depakote
  83. Pingback: cheap diltiazem
  84. Pingback: Viagra mail order
  85. Pingback: viagra pills
  86. Pingback: etodolac australia
  87. Pingback: online pharmacy
  88. Pingback: buy viagra
  89. Pingback: cialis reviews
  90. Pingback: does cialis work
  91. Pingback: imodium coupon
  92. Pingback: cheap viagra
  93. Pingback: generic pills
  94. Pingback: lopid pills
  95. Pingback: generic sildenafil
  96. Pingback: lopressor cost
  97. Pingback: luvox australia
  98. Pingback: order macrobid
  99. Pingback: meclizine cheap
  100. Pingback: viagra copyright
  101. Pingback: mestinon tablet
  102. Pingback: Enalapril
  103. Pingback: canada pharmacy
  104. Pingback: sildenafil citrate
  105. Pingback: buy motrin
  106. Pingback: cheapest periactin
  107. Pingback: viagra
  108. Pingback: phenergan for sale
  109. Pingback: proscar tablets
  110. Pingback: generic viagra
  111. Pingback: pyridium usa
  112. Pingback: claritin-d
  113. Pingback: buy rogaine 5%
  114. Pingback: viagra
  115. Pingback: slipped viagra mom
  116. Pingback: tadora vs cialis
  117. Pingback: buy viagra online
  118. Pingback: genrric viagra
  119. Pingback: tricor purchase
  120. Pingback: verapamil tablet
  121. Pingback: zanaflex canada
  122. Pingback: zestril usa
  123. Pingback: view website
  124. Pingback: check this
  125. Pingback: zocor canada
  126. Pingback: order viagra usa
  127. Pingback: sildenafil cost
  128. Pingback: cialis captions
  129. Pingback: cialus vs viagra
  130. Pingback: atomoxetine cheap
  131. Pingback: cialis online
  132. Pingback: buy viagra online
  133. Pingback: buspirone price
  134. Pingback: clonidinemg cost
  135. Pingback: cefuroxime otc
  136. Pingback: cheap citalopram
  137. Pingback: cialis online
  138. Pingback: clozapine 50mg uk
  139. Pingback: alcohol and viagra
  140. Pingback: cialis on line
  141. Pingback: rosuvastatin pills
  142. Pingback: divalproex prices
  143. Pingback: cheap viagra 100mg
  144. Pingback: trazodone pills
  145. Pingback: buy cialis rush
  146. Pingback: permethrin price
  147. Pingback: 141genericExare
  148. Pingback: order cialis
  149. Pingback: buy cialis now
  150. Pingback: cialis vs levitra
  151. Pingback: nulwvwgm
  152. Pingback: generic ed pills
  153. Pingback: lzitnnnw
  154. Pingback: viagra hoe lang
  155. Pingback: otc viagra
  156. Pingback: furosemida
  157. Pingback: noroxin tablets
  158. Pingback: isosorbide online
  159. Pingback: flagyl for sale
  160. Pingback: vantin online
  161. Pingback: cheap loperamide
  162. Pingback: comprar cialis
  163. Pingback: buy cialis
  164. Pingback: azathioprine cheap
  165. Pingback: propranolol usa
  166. Pingback: viagra
  167. Pingback: write my essay uk
  168. Pingback: viagra porn
  169. Pingback: buy cialis toronto
  170. Pingback: Google
  171. Pingback: price of viagra
  172. Pingback: amoxicillin pills
  173. Pingback: albuterol
  174. Pingback: ventolin price usa
  175. Pingback: doxycycline hyc
  176. Pingback: clomid and twins
  177. Pingback: priligy pastilals
  178. Pingback: neurontin 400
  179. Pingback: propecia buy
  180. Pingback: cialis by mail
  181. Pingback: doses of metformin
  182. Pingback: propecia proscar
  183. Pingback: propecia tablets
  184. Pingback: Aceon
  185. Pingback: herbals
  186. Pingback: Zakhar Berkut
  187. Pingback: buy levitra online
  188. Pingback: Cialis Soft Tabs
  189. Pingback: cialisis online
  190. Pingback: 4569987
  191. Pingback: \'generic cialis\'
  192. Pingback: cialis online uk
  193. Pingback: news news news
  194. Pingback: psy
  195. Pingback: psy2022
  196. Pingback: projectio-freid
  197. Pingback: natural viagra
  198. Pingback: Google
  199. Pingback: ivermectin pills
  200. Pingback: Tinderentrar.com
  201. Pingback: kinoteatrzarya.ru
  202. Pingback: topvideos
  203. Pingback: video
  204. Pingback: canadian services
  205. Pingback: tinder scams text
  206. Pingback: 1911 Magazines
  207. Pingback: Ukrainskie-serialy
  208. Pingback: site
  209. Pingback: cialis 5mg tablet
  210. Pingback: Adult dating site
  211. Pingback: top
  212. Pingback: sublingual cialis
  213. Pingback: sex toys
  214. Pingback: bondage toys
  215. Pingback: vibrator
  216. Pingback: fildena 100 online
  217. Pingback: Glock 17
  218. Pingback: best ed drugs
  219. Pingback: eskort pendik
  220. Pingback: canadapharmacy.com
  221. Pingback: anal vibe
  222. Pingback: viagra online
  223. Pingback: treatment for ed
  224. Pingback: viagra connect cvs
  225. Pingback: naughty sex games
  226. Pingback: anal vibrator
  227. Pingback: stendra vs viagra
  228. Pingback: price of viagra
  229. Pingback: cvs viagra cost
  230. Pingback: PARROTS FOR SALE
  231. Pingback: software review
  232. Pingback: PULVERIZER
  233. Pingback: kratom capsules
  234. Pingback: Dating online
  235. Pingback: best kratom
  236. Pingback: chelovek-iz-90-h
  237. Pingback: podolsk-region.ru
  238. Pingback: plus size toys
  239. Pingback: cytotmeds.com
  240. Pingback: website
  241. Pingback: bender na4alo 2021
  242. Pingback: blogery_i_dorogi
  243. Pingback: Best THC Gummies
  244. Pingback: ed aids
  245. Pingback: delta 8 products
  246. Pingback: delta 8
  247. Pingback: stromectol canada
  248. Pingback: buy plaquenil
  249. Pingback: best pocket pussy
  250. Pingback: buy weed online
  251. Pingback: buy weed
  252. Pingback: abc rifle company
  253. Pingback: stromectol online
  254. Pingback: Investor obligasi
  255. Pingback: ed pills
  256. Pingback: chernaya vodova
  257. Pingback: 66181
  258. Pingback: escort istanbul
  259. Pingback: s racer chair
  260. Pingback: Hedgehog For Sale
  261. Pingback: Porno
  262. Pingback: vechernyy urgant
  263. Pingback: ukraine
  264. Pingback: viagra amazon
  265. Pingback: A3ixW7AS
  266. Pingback: visit website
  267. Pingback: hbcuex.com
  268. Pingback: link
  269. Pingback: KremlinTeam
  270. Pingback: medunitsa.ru
  271. Pingback: kremlin-team.ru
  272. Pingback: psychophysics.ru
  273. Pingback: yesmail.ru
  274. Pingback: cialisorigina
  275. Pingback: Suicide Squad 2
  276. Pingback: psiholog
  277. Pingback: turmeric viagra
  278. Pingback: best wand massager
  279. Pingback: regcialist.com
  280. Pingback: escort bayanlar
  281. Pingback: the best ed pill
  282. Pingback: plaquenil 0.2
  283. Pingback: fun88
  284. Pingback: pocket masturbator
  285. Pingback: MILF Porn
  286. Pingback: ground leases
  287. Pingback: huay
  288. Pingback: male strokers
  289. Pingback: big dildo
  290. Pingback: dildo and balls
  291. Pingback: Dank Vapes
  292. Pingback: etiler escort
  293. Pingback: 99defi Blockchain
  294. Pingback: streamcomplet
  295. Pingback: shift a car
  296. Pingback: site de streaming
  297. Pingback: casino
  298. Pingback: CTRLCOIN
  299. Pingback: lipitor withdrawal
  300. Pingback: best male strokers
  301. Pingback: pussy masturbation
  302. Pingback: thrusting vibrator
  303. Pingback: 1xbit esports
  304. Pingback: pocket stroker
  305. Pingback: best in ottawa
  306. Pingback: lexapro and lsd
  307. Pingback: 메이저사이트
  308. Pingback: 피망슬롯머니
  309. Pingback: sildenafil generic
  310. Pingback: viagra alternative
  311. Pingback: viagra samples
  312. Pingback: viagra 100mg
  313. Pingback: viagra online
  314. Pingback: cialis germany
  315. Pingback: Kingpen
  316. Pingback: ed treatments
  317. Pingback: lexapro 40 mg
  318. Pingback: cialis oral
  319. Pingback: NAPHYRONE FOR SALE
  320. Pingback: Duna 2021
  321. Pingback: buy viagra
  322. Pingback: canada pharmacy
  323. Pingback: male sex toys
  324. Pingback: 1
  325. Pingback: stromectol 6mg a45
  326. Pingback: buy generic cialis
  327. Pingback: ivermect tablet
  328. Pingback: viagra
  329. Pingback: 400 mg sildenafil
  330. Pingback: Referencement web
  331. Pingback: THC Vape Oil
  332. Pingback: get coupon
  333. Pingback: buy clomid
  334. Pingback: propecia prezzo
  335. Pingback: viagra generic
  336. Pingback: ivermectin 3
  337. Pingback: ivermectin 2%
  338. Pingback: ivermectin 9 mg
  339. Pingback: Kampala City Tour
  340. Pingback: best sex toys
  341. Pingback: aromatherapy oils
  342. Pingback: doxycycline 200 mg
  343. Pingback: cialis samples
  344. Pingback: izrada sajtova
  345. Pingback: myloweslife login
  346. Pingback: cialis shop
  347. Pingback: zpak medicine
  348. Pingback: THC PUFF BAR
  349. Pingback: ivermectin reviews
  350. Pingback: pdx1 12 defender
  351. Pingback: sig m18 for sale
  352. Pingback: magic mushrooms
  353. Pingback: magic mushrooms
  354. Pingback: cialis superactive
  355. Pingback: order zithromax uk
  356. Pingback: buy viagra jellies
  357. Pingback: background check
  358. Pingback: bestellen viagra
  359. Pingback: sildenafil 100mg
  360. Pingback: kush carts
  361. Pingback: exotic weed
  362. Pingback: RissMiner
  363. Pingback: dizziness
  364. Pingback: bitcoin
  365. Pingback: nyoks wa katta
  366. Pingback: Safari to Uganda
  367. Pingback: Uganda Safari
  368. Pingback: beretta pistols
  369. Pingback: sig sauer handguns
  370. Pingback: stroker toy
  371. Pingback: strokers
  372. Pingback: viagra en ligne
  373. Pingback: cleantalkorg2.ru
  374. Pingback: oris discount code
  375. Pingback: glo blue dream
  376. Pingback: learn more
  377. Pingback: prednisone
  378. Pingback: prednisone 20
  379. Pingback: viagra on line
  380. Pingback: generic viagra
  381. Pingback: red viagra tablets
  382. Pingback: happyLuke
  383. Pingback: stromectol generic
  384. Pingback: viagra cost
  385. Pingback: lasix 40
  386. Pingback: neurontin tablets
  387. Pingback: viagra generic
  388. Pingback: plaquenil
  389. Pingback: quineprox 30
  390. Pingback: prednisone pills
  391. Pingback: women viagra
  392. Pingback: purchase priligy
  393. Pingback: buy albuterol usa
  394. Pingback: viagra kaufen
  395. Pingback: viagra in india
  396. Pingback: albuterol 5 mg
  397. Pingback: levitra
  398. Pingback: getzq.com
  399. Pingback: Mining Rigs
  400. Pingback: valtrex 2000 mg
  401. Pingback: valtrex cost india
  402. Pingback: CableFreeTV News

Comments are closed.