There are some indicators that youtube's new A/B testing tool could damage channels. Please post your findings.
#If you have A/B tested old videos, how did the views evolve ?
barren jay
ancient sphinx
Everything fine
barren jay
https://www.youtube.com/watch?v=4XZecrrCqB4
I want to publish an article on the matter, however I need more data.
Here is how you can participate and figure out for your own content to what extent youtube's A/B testing is trustworthy :
- Find old videos that still get views daily
- Run an A/B/C test with the last thumbnail and 2 new different thumbnails
- Wait for a clear winner. If the winner is different go to 4) If the winner is the same as before create new thumbnails to test again
- Set it as the new visible thumbnail
- Watch over the next weeks for a change in the number of views
- Share your results here
teal pier
I do agree it is weird that YT ranks the a/b tests for watch-time rather than CTR, so in that aspect its weird. But I think at the same time, the issue you posted with the photo shows them only having done a/b testing for 7 days. As far as I'm aware 7 days from what I know is the minimum and if you think you need to test more around 2 weeks is the goal to reach (especially if you have a smaller audience).
But overall seems pretty interesting, will post in here if I find anything new. 🤷👍
fast kiln
There are some indicators that youtube's new A/B testing tool could damage chann...
From my tests on older Minecraft videos it hasn't really impacted views, as all my thumbnails are always like 49% - 51% or something lol and it's always so unhelpful
But when I upload new videos it is really helpful and only impacts my views positively
fast kiln
I do agree it is weird that YT ranks the a/b tests for watch-time rather than CT...
I think it is great that it does watch time instead. Because obviously that still takes into consideration if people don't click then there is 0 watch time.
It helps for longevity of a video, like clickbait won't work and stuff
barren jay
Ok I finally wrote the article : https://x.com/MilkyWay_li/status/1843701499261767912
Twitter