You can hire my services

I am Ben Lang an independent web conversion specialist with over 20 years of experience in IT and Digital and 12 years Conversion Rate Optimization (CRO) know-how. I provide a full analysis of your website conversion performance and the execution of tried and tested CRO optimization exercises through AB testing, split testing or MVT (Multivariate testing ) deployed to fix your online conversion issues. Contact me at https://www.benlang.co.uk/ for a day rate or catch up with me on LinkedIn

Maxymiser - Multiple KPIs


A natty little feature of the Maxymiser reporting interface is the ability to report on multiple KPIs within the same report. Below is a screen grab of a conversion report which reports on both the 'Application submit rate' referred to as KPI 1, whilst also showing the performance of the secondary KPI 2 of 'Click to Apply rate' for the same test combinations. In the past you would have to flick between separate reports for each KPI, whereas this is obviously no longer the case. 

To enable this feature you simply select multiple KPI or Actions in the report filter drop-down menu within the Maxymiser console. See illustration below.

Charlotte 29th Oct 2011

Google Analytics - Map Overlay

Lessons learnt from Retail* #1


I know Google Analytics (GA) has had it's Map Overlay function for sometime now, a report in GA which shows geographically where your online traffic comes from. Recently though I've had a degree of exposure to the retail sector as opposed to just the financial sector. With this particular brand it was interesting to see how the online traffic so accurately matched up with the branch locations. See image below, on the left is GA map overlay report for the brand and on the right you see its store locations. An incredibly obvious relationship appears between online activity and store location illustrating in retail how branch locality drives online brand awareness.

This kind of thing just doesn't happen in the financial sector where online traffic bears no immediate correlation with the offline world and the companies branches.
Obviously though when there is a match there's a geotargeting opportunity if you chose to act upon that information. This is obviously taken to a higher level with augmented reality applications in the mobile world where there are great marketing opportunities when GPS technology meets the highstreet retail opportunity. I will cover this in more detail in a later post.


*I've been privileged to get access to the web analytics of a retail brand lately. In a brief series I will cover insights I've found between the retail world and the financial sector where I specialize as an online optimization expert 

Tracking uplift post ab testing


Once you've ran either an A/B test or a Multivariate (MVT) test on your website and you're told by your testing tool of choice that your test has achieved statistical conclusion how do you continue to measure performance, and more importantly, should you continue to monitor performance?


I know it sounds reckless, to continue to track uplift is the responsible thing to do right? But in reality there's an important aspect of optimisation testing that needs to be taken into consideration here. Testing outcome is usually the result of the following variables:


product benefit + moment in time + market position + customer experience


Can you continue to accurately measure and account for each of these factors after you've conducted a test? The honest answer is probably no. Also I don't know many people with the personal bandwidth to monitor every single test once it's finished. If I wanted to double my workload I certainly would!


The important thing to do is ensure is that your test has been given enough testing time and traffic volume in the first place before you conclude the test as this post reasonably states Don't Fool Yourself with A/B Testing. If you've done that you should have a reasonable level of confidence in it's future performance.


If you still want to track uplift after testing I would suggest the following are available options for you:


1. Set up a Google Analytics Goal. This gives you the ability to track the performance of a specific customer journey within your normal web analytic. Yes you have to use Google for this one, but any web metrics tool worth it's salt will have the same functionality.


2. Leave your test running. This to me is the fail-safe option. Once you have a test winner up-weight this in favour of the default content but leave a small percentage of your traffic going to the default as a benchmark for continued performance. I usually leave 5% going to the default for a period of time where possible to ensure I've made the right decision. 


3. Run a Follow-up experiment. This is a great feature in Google Optimizer but you can do the same in any other testing tool if you have the resource to do it and there's lingering doubt about the original test outcome.


4. Bespoke tracking. On the pages I optimise I append tracking values to the application form that when submitted to a sales database can be used to tie back sales to a specific landing page. Using this approach you can monitor conversion rate performance before, during and after a test. I cant recommend this approach enough and is entirely dependent upon your on-line application forms particular design as to whether you can implement it.


That's about it really. If I think of any other methods for ongoing tracking I'll add them in.


Happy testing!

1st Direct Bank throw it out there

First Direct have recently launched First Direct Labs. This is a new section of their site which shows you what new ideas and concepts they are testing for their on-line experience. Current tests being; QR Code functionality, redesign concepts, and mobile apps.Visitors are encouraged to rate these concepts and designs as well as make suggestions of their own for new tests. The missing link here is that this feedback is obviously a channel for qualitative testing of these ideas and for my mind seems to be their only current means of gauging how effective these new ideas will be. Obviously I'm not privy to their whole web testing strategy but I would hope there is more in their testing toolbox than just this focus group approach. Either way First Direct are to be commended for divulging part if not all of their testing strategy, it's a safe thing to do as experience has shown that competitors can rarely benefit from implementing test finding vicariously without first doing their own comprehensive testing. I'll address vicarious testing in greater detail in a later post.

Continuing with my ongoing retrospective theme it's worth pointing out that I haven't been averse to going public with test ideas and designs in the past as seen in this post from 2009 where I ask the general public to rate our page designs following a non-conclusive round of MVT testing.

Testing During a Traffic Spike revisited





In a post I wrote back in 2009 I talked of the benefits of combining MVT testing with campaign activity in a post called Riding the tsunami. Coming late to the party, but nonetheless getting there in the end are Get Elastic ,a very good web optimisation site with some valuable testing ideas and concepts, endorsing this very same approach after a bit of soul searching with an article titled "Should You Avoid Testing During a Traffic Spike?" Definitely worth a read. 


I think fundamentally the message remains the same, it's okay to be MVT testing during a campaign if you're trying to optimize that campaign and not the long-term web experience of your visitor.  As ever testing results are usually as a result of the following variables:


 product benefit + moment in time + market position + customer experience