Google Groups Home
Help | Sign in
Discussions > Optimization Questions & Tips > Any thoughts on A/B testing
There are currently too many topics in this group that display first. To make this topic appear first, remove this option from another topic.
There was an error processing your request. Please try again.
flag
  Messages 1 - 25 of 30 - Collapse all   Newer >
The group you are posting to is a Usenet group. Messages posted to this group will make your email address visible to anyone on the Internet.
Your reply message has not been sent.
Your post was successful
NilsC  
View profile
 More options 7 Sep, 17:51
From: NilsC
Date: Sun, 7 Sep 2008 09:51:58 -0700 (PDT)
Local: Sun 7 Sep 2008 17:51
Subject: Any thoughts on A/B testing
Background for the question:
I have to admit I have not paid much attention to advertising on my
site prior to the last couple of months.

I'm showing ads to guests only to avoid clicking by members that think
they support me by clicking ads.

This is what I'm doing to test:
I have setup several channels to track performance of ads located in
different locations of a forum. With 75% of the traffic coming
directly to a post I have the highest CTR in that area so this is
where I'm concentrating my efforts. Setting up ads on a forum to cover
all entry areas and not breaking any AdSense TOS takes some effort
since ads can not be shown on login , sign up pages etc.

For the A/B testing I'm using the area between post 1 and 2 because it
is an area where guests reading a post will go by while reading.
Currently the Link Units on top prior to the post and the ad below the
post receive more clicks.

The A/B testing setup is rotating 728x90 Text Ads and Image Ads to see
if any of the two will perform.

Prior to the A/B testing I tried to see if the alignment of an ad
played any significant role when it came to CTR. Because of forum
layout any ads centered seem to perform better than left or right
alignment. Text ads (Link Units) with font color and background color
matching the forum is performing better than image ads

What are your AdSense Pro's opinion when it comes to the A/B testing?

Thank You,
Nils


    Forward  
You must Sign in before you can post messages.
To post a message, you must first join this group.
Please update your nickname on the subscription settings page before posting.
You do not have the permission required to post.
Dan B.  
View profile
(2 users)  More options 8 Sep, 18:45
From: Dan B.
Date: Mon, 8 Sep 2008 10:45:03 -0700 (PDT)
Local: Mon 8 Sep 2008 18:45
Subject: Re: Any thoughts on A/B testing
I am not a pro, which is who's response was asked for regarding the
OP's question, but A/B testing is useful and practical. Set up one
channel of image only, one of text only, then use a server side script
to randomly display one or the other script to the browser. I've done
it many times and it does not break TOS and it works.

However if you randomize it client side, with JavaScript, you run the
risk of violating the TOS by altering the delivery/script.

On Sep 8, 5:06 am, Maria Janet wrote:


    Forward  
You must Sign in before you can post messages.
To post a message, you must first join this group.
Please update your nickname on the subscription settings page before posting.
You do not have the permission required to post.
NilsC  
View profile
 More options 8 Sep, 19:04
From: NilsC
Date: Mon, 8 Sep 2008 11:04:14 -0700 (PDT)
Local: Mon 8 Sep 2008 19:04
Subject: Re: Any thoughts on A/B testing
Dan,

based on your previous answers in other treads you are closer to a pro
than me. Maybe the "pro" part should have been replaced with
"experienced users"

I'm using the script supplied from the AsSense support files for the
testing and for some reason image ads are doing better than text ads
in that position. I'll give it another week to see if trend continues.

Thanks for the answer,
Nils

On Sep 8, 1:45 pm, Dan B. wrote:


    Forward  
You must Sign in before you can post messages.
To post a message, you must first join this group.
Please update your nickname on the subscription settings page before posting.
You do not have the permission required to post.
Dan B.  
View profile
(2 users)  More options 8 Sep, 19:10
From: Dan B.
Date: Mon, 8 Sep 2008 11:10:37 -0700 (PDT)
Local: Mon 8 Sep 2008 19:10
Subject: Re: Any thoughts on A/B testing
Whoa, they have a script back there for testing? I didn't know that.

That said, are you just comapring revenue, or, are you comparing the
other factors as well, maybe images are getting more impressions? Just
remember to look at the full picture...not just revenue

On Sep 8, 1:04 pm, NilsC wrote:


    Forward  
You must Sign in before you can post messages.
To post a message, you must first join this group.
Please update your nickname on the subscription settings page before posting.
You do not have the permission required to post.
NilsC  
View profile
 More options 8 Sep, 19:41
From: NilsC
Date: Mon, 8 Sep 2008 11:41:56 -0700 (PDT)
Local: Mon 8 Sep 2008 19:41
Subject: Re: Any thoughts on A/B testing
Dan,

I'm not comparing revenue just clicks per view. The setting on the
script is 50/50 of image ads and text ads.

Her is the link to Google AB testing stipt:
http://adsense.blogspot.com/2006/08/abcs-of-ab-testing.html

And this is the help center link:
https://www.google.com/adsense/support/bin/answer.py?answer=45030&sou...

maybe I'm the only one who found it :)

Nils

On Sep 8, 2:10 pm, Dan B. wrote:


    Forward  
You must Sign in before you can post messages.
To post a message, you must first join this group.
Please update your nickname on the subscription settings page before posting.
You do not have the permission required to post.
Dan B.  
View profile
(2 users)  More options 8 Sep, 20:08
From: Dan B.
Date: Mon, 8 Sep 2008 12:08:28 -0700 (PDT)
Local: Mon 8 Sep 2008 20:08
Subject: Re: Any thoughts on A/B testing
interesting, I've never seen it, I've never wanted to mess with their
JS for fear of violating some rogue TOS rule...

remember, programming languages are incapable of being "random", it's
seeded and the results are not back and forth perfectly, over the
course of hundreds it should even out, but it doesn't always, so watch
for impression counts being even and such too.

On Sep 8, 1:41 pm, NilsC wrote:


    Forward  
You must Sign in before you can post messages.
To post a message, you must first join this group.
Please update your nickname on the subscription settings page before posting.
You do not have the permission required to post.
NilsC  
View profile
 More options 8 Sep, 23:37
From: NilsC
Date: Mon, 8 Sep 2008 15:37:40 -0700 (PDT)
Local: Mon 8 Sep 2008 23:37
Subject: Re: Any thoughts on A/B testing
If they give us the code then I guess it's not breaking the TOS.

The script setup should close 50/50, it's not random but but the image
ads is receiving .94% more pi's. I flipped the order of the ads in the
A/B script to see if that changes anything for the next couple of
days. Page reload may affect the accuracy

Another interesting aspect of this testing is that I see there are
different parts of the forum that receive a lot page impressions and
some of those locations never have a click. I have to use those areas
for something else.

Nils

On Sep 8, 3:08 pm, Dan B. wrote:


    Forward  
You must Sign in before you can post messages.
To post a message, you must first join this group.
Please update your nickname on the subscription settings page before posting.
You do not have the permission required to post.
AdSensePro Ashley Google employee  
View profile
(1 user)  More options 11 Sep, 15:36
From: AdSensePro Ashley
Date: Thu, 11 Sep 2008 07:36:29 -0700 (PDT)
Local: Thurs 11 Sep 2008 15:36
Subject: Re: Any thoughts on A/B testing
Hi NilsC,

Thanks for sharing your experiences with A/B testing with us, and for
providing the links to the resources we provide on the subject.

It is indeed a useful experiment to carry out, and we hope that you
will share your conclusions with us.

Ashley

On Sep 8, 11:37 pm, NilsC wrote:


    Forward  
You must Sign in before you can post messages.
To post a message, you must first join this group.
Please update your nickname on the subscription settings page before posting.
You do not have the permission required to post.
Maria Janet  
View profile
 More options 11 Sep, 17:53
From: Maria Janet
Date: Thu, 11 Sep 2008 09:53:15 -0700 (PDT)
Local: Thurs 11 Sep 2008 17:53
Subject: Re: Any thoughts on A/B testing
What about A/B/C testing?

Well, currently google has provided support for A/B testing.
Undoubtedly it is a nifty addition especially for those who use free
webhosts like blogger and so on.

For A/B testing, Google suggest the following format,

<script type="text/javascript">
    var random_number = Math.random();
    if (random_number < .5){
        //your first ad unit code goes here
    } else {
        //your second ad unit code goes here
    }
</script>
<script type="text/javascript"     src="http://
pagead2.googlesyndication.com/pagead/show_ads.js"></script>

So, I wonder can we use A/B/C or more testing by altering the code
similar way. I mean sometimes, say if you wanna test which of the
three perform more, like say whether 1)728x90 Image or 2)728x90 text
or 3)468x90

For this I am suggesting this model, as follows:

<script type="text/javascript">
    var random_number = Math.random();
    if (random_number < .33){
        //your first ad unit code goes here
    } else if (random_number > .33 && random_number < .66 ){
        //your second ad unit code goes here
    }else{
        //your third ad unit code goes here
    }
</script>
<script type="text/javascript"     src="http://
pagead2.googlesyndication.com/pagead/show_ads.js"></script>

I wonder whether we are allowed to use like above mentioned. Any
Adsense Pros hearing?

Regards,
Maria

-
Ways to Make Money Online other than Adsense
http://MoneyOnline.CrazeNut.com

On Sep 11, 7:36 pm, AdSensePro Ashley wrote:


    Forward  
You must Sign in before you can post messages.
To post a message, you must first join this group.
Please update your nickname on the subscription settings page before posting.
You do not have the permission required to post.