Self hosted split testing software

JoseArmando

JoseArmando

work = life
Jul 24, 2008
2,461
65
0
Our product is getting around 100 sales a day and it's getting harder and harder for me to set up split tests manually.

In the past I've been using Split test accelerator and if any of you guys used it you know it was amazing for its time with multivariate taguchi testing. Apparently the guy that programmed it abandoned it so I'm looking for alternatives. Most of the software I found is billed monthly depending on the amount of traffic you get which I dislike since we're already on a bunch of monthly services and it adds up fast.

If there's no good self hosted one time fee alternative of course I'll take the monthly subscription but I'm wondering if there are any good ones out there without it.
 


Genetify.

The site is no longer up and running but the author moved his stuff to github:

https://github.com/gregdingle/genetify

It's been many years since I've used it but the initial setup is fairly simple. Also:

- very little overhead
- fast performance
- automatically split test and choose winning combos on any web/jscript element (bg color, text, images)

It got to the point where i was split testing different times on a countdown timer, widths of text blocks on landers, and paragraph break locations.

I log on here twice a month at this point but let me know if you have quest.
 
update - i found the post from 5 years ago (fuck) that has "7 jquery tricks".

first - this is the lander that was used. very simple for ppv:

PPV Landing Page Template

second - here's the post with all of the details:

7 jQuery Effects To Explode Your PPV CTR! | Aff Playbook.com

You may have come across this before as you've been around almost as long as me. But the lander shows the clock code that I used at some point. Out of all of the elements that I split tested over time that clock code got me the most bang for my buck (multiple landers/verticals/etc/etc)


good luck bros
 
groneg said:
update - i found the post from 5 years ago (fuck) that has "7 jquery tricks".

first - this is the lander that was used. very simple for ppv:

PPV Landing Page Template

second - here's the post with all of the details:

7 jQuery Effects To Explode Your PPV CTR! | Aff Playbook.com

You may have come across this before as you've been around almost as long as me. But the lander shows the clock code that I used at some point. Out of all of the elements that I split tested over time that clock code got me the most bang for my buck (multiple landers/verticals/etc/etc)


good luck bros
Click to expand...

I'm not too sure and correct me if I'm wrong but weren't countdown timers on order pages targeted by FTC as bad advertising practices? Or was it visa&mastercard...

Though I don't see what'd be the issue with a legitimate countdown timer that expires a discount or whatever.

Other things that can have huge impact:
- headline (its content, size, color)
- testimonials
- order button (size, position, call to action, colors)
- images

PS: Atm I'm split testing 6 headlines

l52Vgl4.jpg


Still need to wait a couple more days to get statistical significance, but if #3 beats the control #1 with as wide margin as it looks right now it will rock my world with the increase in conversions.
 
JoseArmando said:
I'm not too sure and correct me if I'm wrong but weren't countdown timers on order pages targeted by FTC as bad advertising practices? Or was it visa&mastercard...

Though I don't see what'd be the issue with a legitimate countdown timer that expires a discount or whatever.

Other things that can have huge impact:
- headline (its content, size, color)
- testimonials
- order button (size, position, call to action, colors)
- images

PS: Atm I'm split testing 6 headlines

l52Vgl4.jpg


Still need to wait a couple more days to get statistical significance, but if #3 beats the control #1 with as wide margin as it looks right now it will rock my world with the increase in conversions.
Click to expand...

is that the genetify interface?
 
bizkiller said:
is that the genetify interface?
Click to expand...

Nope, this is the Split test accelerator. I went through the code and managed to fix it to work on a modern server so it works like a charm now :)

Running a simple one factor A/B/C... split test but once I'm finished with this one I'll set up a multivariate 6/3/3/3/3/3/3 test (one factor with six options, and six factors with three options each. 4,374 combinations) and once its finished report here just how much of an improvement that makes (as far as shortening the testing time).
 
I would think any decent stats package should be able to do this for you.
Setup each new test as a new affiliate/publisher...name it as such so you can track it visbily when it is in stats...Multivariate test #1/trafficsoure...whatever....
Then within break it down using campaign trackers or any other trackers in your standard stats package.

Keep it to 3 different factors you change up and split test those.
So your affiliate acct/publisher acct has 8 campaigns named properly so you know which one is which. (H1,t1,i1......h2,t2,i2)

where h denotes header, t denotes text, i denotes image.
 
JoseArmando said:
Nope, this is the Split test accelerator. I went through the code and managed to fix it to work on a modern server so it works like a charm now :)

Running a simple one factor A/B/C... split test but once I'm finished with this one I'll set up a multivariate 6/3/3/3/3/3/3 test (one factor with six options, and six factors with three options each. 4,374 combinations) and once its finished report here just how much of an improvement that makes (as far as shortening the testing time).
Click to expand...

I tried to check out the site but it looks like its down

update: just reread the OP about how it's no longer supported --

any way I get a copy to play around with?
 
groneg said:
I tried to check out the site but it looks like its down

update: just reread the OP about how it's no longer supported --

any way I get a copy to play around with?
Click to expand...

Yeah if you haven't bought it before it went down it's kinda hard to find it which is a shame since it's such a wonderful piece of software.
 
yeah, i'd love to get my hands on that. I have the Landing Page Genius which only works with the older versions of Prosper and CPVlab. so, it's a bummer :(
 
JoseArmando said:
Nope, this is the Split test accelerator. I went through the code and managed to fix it to work on a modern server so it works like a charm now :)

Running a simple one factor A/B/C... split test but once I'm finished with this one I'll set up a multivariate 6/3/3/3/3/3/3 test (one factor with six options, and six factors with three options each. 4,374 combinations) and once its finished report here just how much of an improvement that makes (as far as shortening the testing time).
Click to expand...

Ive got SPA 4 and 5. What code changes did you make if you dont mind me asking?
 
eliquid said:
Ive got SPA 4 and 5. What code changes did you make if you dont mind me asking?
Click to expand...

For the ver 5 all I did was replace the instances of TYPE=MyISAM with ENGINE=MyISAM in install.php. Also make sure not to include BOM characters when saving the LP pages in which you include STA's code.
 
eliquid said:
OK, that might be the issue Im having.

I cant seem to make more than 1 factor. Ill try that out.
Click to expand...

The fix I posted up there was to get the STA to properly install, I'm not too sure you could be running tests with this issue.

I haven't tested the multivariate option yet though, I'm running a single factor split test atm... So I hope I won't get errors too.
 
So in conclusion the control had 2% overall conversion and the winning headline had a 3% conversion with 95% confidence (the conversions fell a little since we've done some changes on our ad sources). I'll set up a multivariate test now, this is freaking free money.

Up to now we've done standard A/B split tests and even though we did improve conversions greatly in time I've never seen such a huge increase. Going from 100 sales a day to 150 just by changing a headline is pretty awesome
 
Let me know how that goes. Im still having issues with STA 5... might just be me.

Let me know how future tests ( the 6/3/3/3/3/ if you do it ) pan out
 
eliquid said:
Let me know how that goes. Im still having issues with STA 5... might just be me.

Let me know how future tests ( the 6/3/3/3/3/ if you do it ) pan out
Click to expand...

I've set it up yesterday and it works perfectly. What's the issue you're having?

afuWc5o.jpg
 
Im going to make some time tonight and tomorrow to mess with it some more with your code fix and reinstalling it.

I'll let you know, but thanks for bring up this thread and posting that fix
 
You must log in or register to reply here.
Top Bottom