In theory, Facebook’s Conversion Lift Tests allow us to measure incremental lift. This is different from total conversions; basically, what lift tests set out to do is parse out which conversions you would have gotten anyway and show us what conversions Facebook was responsible for driving.

So do lift tests work? We put them, well, to the test…and we were pleased by the results.

SAMSUNG DIGITAL CAMERA

SAMSUNG DIGITAL CAMERA

 

What we tested

Our client (a B2C company in financial services) wanted to know what additional impact Facebook ads would have when run on top of their direct mail campaign. We ran the test over 8 weeks (Facebook recommends running the test for 4-6 weeks and then having a 2-week observation period for latent conversions), totaling over 6.5 million impressions.

We took the company’s direct mail audience and divided it in two; one half was shown Facebook ads, and the other was a control. We then served ads to our test group, ran the ads for the duration of the DM campaign, and measured the number of conversions from the control vs. the test group.

 

Why we tested

We wanted to measure the delta in conversions between an audience seeing both direct mail and Facebook ads versus those receiving direct mail only. Because the only difference between the test and control groups was the Facebook ads, we can assume that any incremental conversions were the result of our ads.

 

Results

We saw a 13% lift from our Facebook ads; this means that Facebook ads drove an additional 13% of conversions. We immediately used those learnings to scale our Facebook campaigns and adjust budget with respect to our CPA goals. The data also led us to recommend running Facebook ads alongside future direct marketing programs.

 

Test caveats

The test showed that in order to make full use of the feature, we have to start with large targets (4-6 million users). Because we save half of the audience as a control, and our bid type also limited reach, the target shrunk quickly.

It’s also important to note that lift can vary by campaign. Our direct mail test was to users who were familiar with our brand (they received mail from us). A digital-only lift test may have a higher or lower lift depending on the audience.

Conclusion

If you or your clients are running multi-channel campaigns that include Facebook, we’d recommend setting these up immediately. The resulting data can help you make recommendations for budget allocation – not to mention highlight interplay between channels.

1 Comment

  1. apa October 6th, 2017

    instead of a 50 – 50 split between test and control, would it not be better to have a 80 (test) 20 (control) setting?

Leave a Comment

James Houchin
James Houchin is a Social Account Manager at 3Q Digital. Prior to joining 3Q, he worked with a number of B2B and B2C brands in organic and paid social. James currently lives in Wisconsin. In his free time he can be found biking, kayaking and playing with his dog Dozer.