Creating a testing culture in an organisation that is unfamiliar with the concept is not easy, especially in large companies. However, when you do eventually make an impact, which can be extremely rewarding, it can begin to snowball. And by this I mean lots of people getting wind of the benefits of testing and wanting a piece of the pie. It is fantastic to reach this point, but it can come with its own problems.

Depending on how you’re structured, very quickly you can have a queue of business owners wanting to run tests on their areas of the product. If you and your team are in charge of testing, then it is your responsibility to maintain law and order. It’s all well and good implementing a shiny new testing tool, but your job should not just be about becoming the gatekeeper for this tool — it is so much more than that.

It is very easy to get carried away and just launch a test when another one has finished, because you have a Business Owner bugging you, asking “when will my test be prioritised”. Before you know it, you have run a multitude of tests without any time to breath before or afterwards. This may not be the most effective way for you to run your testing program. Here is a few points to be aware of:

Testing Culture Maintenance

Build a roadmap

You hear this alot in the world of AB testing and MVT, but I think it is easy to get carried away and forget the importance of careful planning and maintenance. Ensure you have a roadmap on a single document or wiki page, which gives you a clear overview of all the tests you want to run over the next quarter or half year. This plan will not stay the same, it will evolve and grow as you start testing.

If you don’t maintain a roadmap, then before you know it, there will be no strategy and you will just be answering ad hoc requests from around the business.

Prioritise

Once you have built a roadmap with lots of test ideas, you then need to prioritise them. I find that a good way to do this is to rank your ideas in order of desirability and feasibility. It might be that the easier tests with quick, small wins is where you want to start. Or maybe you want to run with a test that has huge desirability and low feasibility, and you have the allocated resource to develop the experiences and launch the test. This is individual to you and your business, but the point is, you must prioritise your tests to maintain law and order

Iterate

Testing can raise as many questions as it answers, so It is not wise to just analyse the data, form a conclusion and move onto the next test. It may be that you don’t have a winning experience but there could still be some valuable insights you can take from the test in order to build out an iterative test, and help find answers. Or you might have a test result which is close to reaching statistical significance and needs a bit more exploring.

This would not be possible if you just jumped onto the next test because a Business Owner is banging on your door

Create traffic groups

When a user enters a test, the last thing you want to do is contaminate the data by allowing them into another test that’s running at the same time. This is where traffic groups are extremely necessary. All 3rd party testing tools have their own terminology and ways of creating traffic groups, but the outcome is the same — creating rules in the UI that says only this group of users are allowed to enter this test.

Providing your site has the traffic volumes; traffic groups allow you to run multiple tests at the same time. If you have enough traffic to the site, you could allocate a certain percentage of your traffic to those adhoc test requests. For example, a redesign that’s due to be pushed live (and needs to be tested) tomorrow, that nobody has communicated to you. This happens alot in some organisations, especially large ones. It’s difficult to get a handle on everything that is going on across the business, but ultimately the testing should become part of the design process, so it can be built into the roadmap and scheduled as best as possible. However, for when that doesn’t happen, having a dedicated traffic group could prove useful.

Hypothesise

When teams get the testing bug and they start chucking tests they’d like to run at you, they often forgot to hypothesise or they are unaware of the importance of forming a solid hypothesis before running an experiment. This is where strategy and best practices really need to be communicated internally. It might even be necessary to run a training session to explain why we need a solid hypothesis and how we can form our hypothesis.

In Conclusion

Ultimately, it is your responsibility to structure your plan so you can either accommodate those ad hoc “emergency” requests or have the processes in place for prioritising them amongst your other planned tests. The key to success is to maintain a fluid plan and ensure all areas of the business it impacts, are aware of it and your processes. You need to take charge, so you can be strategic about your test and learn programme. This is only going to benefit your team and the business in the long run.

Growth Lead at Dailymotion, Richard has a passion for improving user experience and ROI through data and experimentation.

1,152 thoughts on “How to Maintain A Testing Culture

  1. Pingback: viagra walmart
  2. Pingback: cialis coupons
  3. Pingback: cialis for sale
  4. Pingback: viagra 50mg
  5. Pingback: men's ed pills
  6. Pingback: cialis generic
  7. Pingback: online pharmacy
  8. Pingback: Buy cialis online
  9. Pingback: vardenafil generic
  10. Pingback: levitra generic
  11. Pingback: generic vardenafil
  12. Pingback: online casinos
  13. Pingback: installment loans
  14. Pingback: cash loan
  15. Pingback: viagra 100mg
  16. Pingback: buy cialis
  17. Pingback: cialis 5 mg
  18. Pingback: 20 cialis
  19. Pingback: cialis buy
  20. Pingback: generic for cialis
  21. Pingback: cialis 5 mg
  22. Pingback: gambling games
  23. Pingback: online slots
  24. Pingback: purchase viagra
  25. Pingback: viagra price
  26. Pingback: viagra online
  27. Pingback: tadalafil generic
  28. Pingback: tadalafil 10 mg
  29. Pingback: cheap viagra
  30. Pingback: real casino online
  31. Pingback: viagra pill
  32. Pingback: viagra generic
  33. Pingback: cialis prices
  34. Pingback: buy Viagra 120mg
  35. Pingback: buy generic viagra
  36. Pingback: Cialis 80 mg otc
  37. Pingback: Cialis 40mg pills
  38. Pingback: order Cialis 20 mg
  39. Pingback: online viagra
  40. Pingback: Cialis 10 mg nz
  41. Pingback: Cialis 80mg cost
  42. Pingback: cialis pills
  43. Pingback: Cialis 60mg prices
  44. Pingback: Cialis 60 mg pills
  45. Pingback: cialis online
  46. Pingback: levitra 40mg cheap
  47. Pingback: lasix 40mg tablets
  48. Pingback: buy generic viagra
  49. Pingback: viagra sale
  50. Pingback: allegra 120mg otc
  51. Pingback: amaryl 4mg canada
  52. Pingback: sildenafil
  53. Pingback: arava 20 mg otc
  54. Pingback: cialis price
  55. Pingback: buy baclofen 10 mg
  56. Pingback: cialis 5mg
  57. Pingback: cialis pink
  58. Pingback: generic sildenafil
  59. Pingback: viagra 120 pills
  60. Pingback: catapres prices
  61. Pingback: sildenafil generic
  62. Pingback: red dog casino
  63. Pingback: slot machine games
  64. Pingback: play casino
  65. Pingback: casinos
  66. Pingback: kako deluje viagra
  67. Pingback: top car insurance
  68. Pingback: buy cialis
  69. Pingback: abc car insurance
  70. Pingback: au cialis
  71. Pingback: Buy viagra in us
  72. Pingback: cheap payday loans
  73. Pingback: buy cialis
  74. Pingback: cbd oil for pain
  75. Pingback: write essay for me
  76. Pingback: viagra uk cost
  77. Pingback: ace homework
  78. Pingback: ace homework
  79. Pingback: paper writer
  80. Pingback: clomid price
  81. Pingback: cialis generic uk
  82. Pingback: clonidine purchase
  83. Pingback: viagra or cialis
  84. Pingback: cialis miami
  85. Pingback: Order viagra usa
  86. Pingback: coreg pharmacy
  87. Pingback: everyday cialis
  88. Pingback: generic cialis
  89. Pingback: cozaar otc
  90. Pingback: dissertation topic
  91. Pingback: cymbalta prices
  92. Pingback: thesis advice
  93. Pingback: buy thesis online
  94. Pingback: ddavp 10 mcg cost
  95. Pingback: depakote usa
  96. Pingback: diamox nz
  97. Pingback: cheap dramamine
  98. Pingback: erythromycin otc
  99. Pingback: geodon purchase
  100. Pingback: cheap hyzaar
  101. Pingback: imdur 20mg online
  102. Pingback: cialis and alcohol
  103. Pingback: cialis for sale
  104. Pingback: buy cialis online
  105. Pingback: viagra online
  106. Pingback: imodium 2mg tablet
  107. Pingback: this post
  108. Pingback: go to these guys
  109. Pingback: buy viagra
  110. Pingback: imuran generic
  111. Pingback: order lopressor
  112. Pingback: luvox coupon
  113. Pingback: macrobid coupon
  114. Pingback: meclizine uk
  115. Pingback: pharmacy discount
  116. Pingback: Viagra Gold
  117. Pingback: order micardis
  118. Pingback: motrin 400mg uk
  119. Pingback: Brand Cialis
  120. Pingback: prevacid 15 mg nz
  121. Pingback: prilosec tablets
  122. Pingback: procardia purchase
  123. Pingback: proscar generic
  124. Pingback: pulmicort online
  125. Pingback: pyridium 200mg otc
  126. Pingback: order risperdal
  127. Pingback: seroquel coupon
  128. Pingback: spiriva generic
  129. Pingback: tenormin canada
  130. Pingback: toprol otc
  131. Pingback: tricor nz
  132. Pingback: vantin purchase
  133. Pingback: voltaren pharmacy
  134. Pingback: click over here
  135. Pingback: my explanation
  136. Pingback: zocor generic
  137. Pingback: zovirax australia
  138. Pingback: buy viagra where
  139. Pingback: zyvox nz
  140. Pingback: sildenafil cheap
  141. Pingback: cost of tadalafil
  142. Pingback: cheap furosemide
  143. Pingback: escitalopram otc
  144. Pingback: atomoxetine pills
  145. Pingback: olmesartan pills
  146. Pingback: buspirone price
  147. Pingback: cialis sale 20mg
  148. Pingback: trazodone cost
  149. Pingback: buy tolterodine
  150. Pingback: buy cialis rush
  151. Pingback: cialis online
  152. Pingback: phenytoin canada
  153. Pingback: bisacodyl cheap
  154. Pingback: permethrin nz
  155. Pingback: ityyouwo
  156. Pingback: cialis sale 20mg
  157. Pingback: xgwyobxh
  158. Pingback: buy viagra in uae
  159. Pingback: viagra
  160. Pingback: buy cialis rush
  161. Pingback: buy cialis now
  162. Pingback: indomethacin usa
  163. Pingback: cialis in europe
  164. Pingback: help with an essay
  165. Pingback: cheap lamotrigine
  166. Pingback: buy terbinafine
  167. Pingback: digoxinmg cheap
  168. Pingback: cost of ivermectin
  169. Pingback: order metoprolol
  170. Pingback: doxycycline fish
  171. Pingback: nolvadex clomid
  172. Pingback: is clomid safe
  173. Pingback: diflucan iv
  174. Pingback: synthroid itching
  175. Pingback: buy an essay paper
  176. Pingback: propecia for life
  177. Pingback: propecia alopecia
  178. Pingback: dapoxetine/cialis
  179. Pingback: metformin dementia
  180. Pingback: metformin names
  181. Pingback: paxil marijuana
  182. Pingback: weaning off paxil
  183. Pingback: icd 10 plaquenil
  184. Pingback: Protonix
  185. Pingback: Zakhar Berkut
  186. Pingback: cialis dapoxetine
  187. Pingback: 4569987
  188. Pingback: free cialis
  189. Pingback: news news news
  190. Pingback: psy
  191. Pingback: psy2022
  192. Pingback: projectio-freid
  193. Pingback: viagra retinopathy
  194. Pingback: kinoteatrzarya.ru
  195. Pingback: topvideos
  196. Pingback: video
  197. Pingback: buy tadalafil uk
  198. Pingback: buy tadalafil uk
  199. Pingback: Ukrainskie-serialy
  200. Pingback: site
  201. Pingback: top
  202. Pingback: ed treatment
  203. Pingback: order cheap cialis
  204. Pingback: Free dating
  205. Pingback: chelovek-iz-90-h
  206. Pingback: podolsk-region.ru
  207. Pingback: cytotmeds.com
  208. Pingback: bender na4alo 2021
  209. Pingback: blogery_i_dorogi
  210. Pingback: chernaya vodova
  211. Pingback: 66181
  212. Pingback: Porno
  213. Pingback: vechernyy urgant
  214. Pingback: ukraine
  215. Pingback: A3ixW7AS
  216. Pingback: link
  217. Pingback: KremlinTeam
  218. Pingback: medunitsa.ru
  219. Pingback: kremlin-team.ru
  220. Pingback: psychophysics.ru
  221. Pingback: yesmail.ru
  222. Pingback: Suicide Squad 2
  223. Pingback: psiholog
  224. Pingback: buy cialis
  225. Pingback: cheap viagra
  226. Pingback: regcialist.com
  227. Pingback: price of priligy
  228. Pingback: stromectol a
  229. Pingback: lyrica 25mg
  230. Pingback: sildenafil 50 mg
  231. Pingback: viagra buy online
  232. Pingback: viagra price
  233. Pingback: cialis australia
  234. Pingback: is lexapro a maoi
  235. Pingback: get cialis online
  236. Pingback: cialis 20mg
  237. Pingback: purchase cialis
  238. Pingback: Duna 2021
  239. Pingback: sildenafil 100mg
  240. Pingback: 1
  241. Pingback: viagra otc
  242. Pingback: stromectol 6 cost
  243. Pingback: sildenafil viagra
  244. Pingback: viagra online
  245. Pingback: price for cialis
  246. Pingback: australia cialis
  247. Pingback: jeffers ivermectin
  248. Pingback: ventolin hsa
  249. Pingback: india ivermectin
  250. Pingback: natural viagra
  251. Pingback: what is viagra
  252. Pingback: cleantalkorg2.ru
  253. Pingback: taking viagra
  254. Pingback: amoxil rash
  255. Pingback: viagra dosages
  256. Pingback: buy amoxil 250mg
  257. Pingback: lasix 1975
  258. Pingback: gabapentin 40 mg
  259. Pingback: plaquenil uk price
  260. Pingback: canadian pharmacy
  261. Pingback: prednisone 5442
  262. Pingback: buy dapoxetine
  263. Pingback: avana 200mg price
  264. Pingback: ivermectin drug
  265. Pingback: albuterol 100
  266. Pingback: combivent price
  267. Pingback: zithromax tablet
  268. Pingback: zithromax 500 mg
  269. Pingback: herbal viagra
  270. Pingback: lasix 500 mg tab
  271. Pingback: viagra cialis
  272. Pingback: viagra tablet
  273. Pingback: viagra substitute
  274. Pingback: viagra cost
  275. Pingback: sildenafil goodrx
  276. Pingback: low price viagra
  277. Pingback: generic viagra
  278. Pingback: aabbx.store
  279. Pingback: cheap viagra pills
  280. Pingback: ne-smotrite-naverx
  281. Pingback: lawn mower oil
  282. Pingback: arrogant
  283. Pingback: Dead-Inside
  284. Pingback: cialis coupons
  285. Pingback: médicament cialis
  286. Pingback: cialis buy online
  287. Pingback: Keyword
  288. Pingback: stromectol pills
  289. Pingback: ivermectin 24 mg
  290. Pingback: albuterol coupon
  291. Pingback: flccc ivermectin
  292. Pingback: heb pharmacy
  293. Pingback: aralen antiviral
  294. Pingback: baricitinib price
  295. Pingback: canadian pharmacy
  296. Pingback: cialis timeline
  297. Pingback: buy clomid in usa
  298. Pingback: Anonymous
  299. Pingback: tizanidine 44
  300. Pingback: india ivermectin
  301. Pingback: stromectol tablets
  302. Pingback: cost of stromectol
  303. Pingback: ivermectin rx
  304. Pingback: cost of ivermectin
  305. Pingback: Anonymous
  306. Pingback: Anonymous
  307. Pingback: ivermectin generic
  308. Pingback: imask protocol
  309. Pingback: ivermectin buy
  310. Pingback: 3rpUI4X
  311. Pingback: ivermectin uk
  312. Pingback: uliocx
  313. Pingback: 34tfA26
  314. Pingback: 3J6w3bD
  315. Pingback: 3GrvxDp
  316. Pingback: 3rrZhf7
  317. Pingback: 3L1poB8
  318. Pingback: my-vse-mertvy-2022
  319. Pingback: meritroyalbet
  320. Pingback: meritking
  321. Pingback: madridbet
  322. Pingback: stromectol tablets
  323. Pingback: tadalafil cialis
  324. Pingback: tadalafil pills
  325. Pingback: generic tadalafil
  326. Pingback: meritroyalbet
  327. Pingback: meritroyalbet
  328. Pingback: elexusbet
  329. Pingback: meritroyalbet
  330. Pingback: viagra connect usa
  331. Pingback: stromectol nz
  332. Pingback: ivermectin 3
  333. Pingback: baymavi
  334. Pingback: baymavi
  335. Pingback: tombala siteleri
  336. Pingback: 2upbringing
  337. Pingback: 1fisting
  338. Pingback: tadalafil citrate
  339. Pingback: viagra from canada
  340. Pingback: meritroyalbet
  341. Pingback: what is cialis
  342. Pingback: eurocasino
  343. Pingback: ivermectin 90 mg
  344. Pingback: real money casinos
  345. Pingback: cialis walmart
  346. Pingback: viagra alternative
  347. Pingback: cialis tablets
  348. Pingback: ivermectin gold
  349. Pingback: ivermectin 200mg
  350. Pingback: z.globus-kino.ru
  351. Pingback: ivermectin 0.5
  352. Pingback: ivermectin 1 cream
  353. Pingback: cialis online
  354. Pingback: meritroyalbet
  355. Pingback: meritking
  356. Pingback: lasix 40 mg cost
  357. Pingback: meritking
  358. Pingback: eurocasino
  359. Pingback: trcasino
  360. Pingback: lasix 20 mg tablet
  361. Pingback: stromectol usa
  362. Pingback: eurocasino
  363. Pingback: eurocasino
  364. Pingback: ivermectin lice
  365. Pingback: yutub
  366. Pingback: madridbet
  367. Pingback: luckyland
  368. Pingback: covid ivermectin
  369. Pingback: child porn
  370. Pingback: ivermectin nahdi
  371. Pingback: mazhor4sezon
  372. Pingback: filmfilmfilmes
  373. Pingback: gRh9UPV
  374. Pingback: ivermectin covid
  375. Pingback: 9-05-2022
  376. Pingback: TopGun2022
  377. Pingback: Xvideos
  378. Pingback: XVIDEOSCOM Videos
  379. Pingback: ivanesva
  380. Pingback: cialis
  381. Pingback: meritroyalbet
  382. Pingback: Netflix
  383. Pingback: FILM
  384. Pingback: designchita.ru
  385. Pingback: YA-krasneyu
  386. Pingback: design-human.ru
  387. Pingback: designmsu.ru
  388. Pingback: vkl-design.ru
  389. Pingback: irida-design.ru
  390. Pingback: ivermektin
  391. Pingback: psy-
  392. Pingback: psy online
  393. Pingback: Gz92uNNH
  394. Pingback: uels ukrain
  395. Pingback: covid ivermectin
  396. Pingback: bahis siteleri
  397. Pingback: DPTPtNqS
  398. Pingback: qQ8KZZE6
  399. Pingback: D6tuzANh
  400. Pingback: SHKALA TONOV
  401. Pingback: 3Hk12Bl
  402. Pingback: 3NOZC44
  403. Pingback: 01211
  404. Pingback: tor-lyubov-i-grom
  405. Pingback: film-tor-2022
  406. Pingback: hd-tor-2022
  407. Pingback: hdorg2.ru
  408. Pingback: JXNhGmmt
  409. Pingback: Psikholog
  410. Pingback: netstate.ru
  411. Pingback: bit.ly
  412. Pingback: meritking
  413. Pingback: bucha killings
  414. Pingback: War in Ukraine
  415. Pingback: stats
  416. Pingback: Ukraine-war
  417. Pingback: movies
  418. Pingback: gidonline
  419. Pingback: web
  420. Pingback: film.8filmov.ru
  421. Pingback: Anonymous
  422. Pingback: online cialis
  423. Pingback: filmgoda.ru
  424. Pingback: rodnoe-kino-ru
  425. Pingback: confeitofilm
  426. Pingback: stat.netstate.ru
  427. Pingback: sY5am
  428. Pingback: Dom drakona
  429. Pingback: JGXldbkj
  430. Pingback: aOuSjapt
  431. Pingback: ìûøëåíèå
  432. Pingback: psikholog moskva
  433. Pingback: A片
  434. Pingback: Dim Drakona 2022
  435. Pingback: TwnE4zl6
  436. Pingback: psy 3CtwvjS
  437. Pingback: lalochesia
  438. Pingback: film onlinee
  439. Pingback: 3qAIwwN
  440. Pingback: video-2
  441. Pingback: sezons.store
  442. Pingback: psy-news.ru
  443. Pingback: 000-1
  444. Pingback: 3SoTS32
  445. Pingback: 3DGofO7
  446. Pingback: rftrip.ru
  447. Pingback: dolpsy.ru
  448. Pingback: kin0shki.ru
  449. Pingback: 3o9cpydyue4s8.ru
  450. Pingback: mb588.ru
  451. Pingback: newsukraine.ru
  452. Pingback: kamagra 50mg
  453. Pingback: edu-design.ru
  454. Pingback: tftl.ru
  455. Pingback: brutv
  456. Pingback: site 2023
  457. Pingback: sitestats01
  458. Pingback: 1c789.ru
  459. Pingback: cttdu.ru
  460. Pingback: 1703
  461. Pingback: hdserial2023.ru
  462. Pingback: serialhd2023.ru
  463. Pingback: matchonline2022.ru
  464. Pingback: bit.ly/3OEzOZR
  465. Pingback: bit.ly/3gGFqGq
  466. Pingback: vidalista 60mg
  467. Pingback: bit.ly/3ARFdXA
  468. Pingback: bit.ly/3ig2UT5
  469. Pingback: bit.ly/3GQNK0J
  470. Pingback: grandpashabet
  471. Pingback: grandpashabet
  472. Pingback: bep5w0Df
  473. Pingback: www
  474. Pingback: icf
  475. Pingback: 24hours-news
  476. Pingback: rusnewsweek
  477. Pingback: uluro-ado
  478. Pingback: irannews.ru
  479. Pingback: klondayk2022
  480. Pingback: fildena 100 online
  481. Pingback: gay porno
  482. Pingback: 2022-film
  483. Pingback: türk porno seks
  484. Pingback: sikiş
  485. Pingback: fuck google
  486. Pingback: mangalib
  487. Pingback: madridbet
  488. Pingback: x
  489. Pingback: 9xflix
  490. Pingback: xnxx
  491. Pingback: 123movies
  492. Pingback: xxx
  493. Pingback: 1strongly
  494. Pingback: kinokrad
  495. Pingback: batmanapollo
  496. Pingback: amoxil
  497. Pingback: vsovezdeisrazu
  498. Pingback: 2023
  499. Pingback: vardenafil reviews
  500. Pingback: porn
  501. Pingback: ipsychologos
  502. Pingback: yug-grib.ru
  503. Pingback: studio-tatuage.ru
  504. Pingback: fuck google
  505. Pingback: madridbet
  506. Pingback: meritking giriş
  507. Pingback: video.vipspark.ru
  508. Pingback: vitaliy-abdulov.ru
  509. Pingback: grandpashabet
  510. Pingback: child porn

Comments are closed.