You dont have javascript enabled! Please enable it!

BEAUMONT

Business College

Experimentation is the key to ad effectiveness

cogs

IAB Australia has released a new guide for measuring digital ad impact. Research director Natalie Stanbury walks us through the digital ad testing checklist.

Original and full article at:
https://www.marketingmag.com.au/hubs-c/opinion-stanbury-iab-digital-ad/

Success means different things to different companies and brands. For some it’s all about ‘fail fast and learn’ while others may be aligned with a more conservative approach. But regardless of the preferred approach, the reality is that with digital now accounting for more than 50% of all advertising spend in Australia, it has never been more important for marketers to develop their understanding of digital’s impact on their campaigns and its overall role within the media mix.

Yet there is still a lot of confusion and conflict as to which metrics and methods to use and indeed what they really mean. That’s hardly surprising and it’s certainly worth taking some time to understand the strengths and weaknesses of each measurement approach and taking care to select the best metric to show whether you have achieved your objectives. But more than that, marketers need to step up to understand what’s going on beyond the results and to dig under the hood to understand which part of a campaign worked and which didn’t – and why.

It’s all about understanding the real impact of your digital ad. And it’s about going far further than using something like click through rates (CTR) to measure interactions with an ad. CTRs provide a very narrow view of success and can actually be damaging or, at a minimum, misleading for measuring brand campaigns. Instead, marketers need to choose more meaningful metrics that are matched to the campaign objectives and KPIs of the ad campaign.

One of the most effective tools for digital ad testing is controlled experiments. Sounds scientific, geeky and kind of fun, right? And indeed, they kind of are but controlled experiments offer the perfect opportunity to adopt best practice scientific methods to add confidence and precision to marketing investment decisions. They are flexible by nature and can be particularly helpful in testing the interplay between digital and offline activity. Their power is in understanding the true business impact of your advertising that wouldn’t have otherwise happened.

So where to begin?  IAB Australia’s latest ‘Guide to Designing Digital Impact Studies’ is a best practice guide to digital ad testing and is freely available. It’s a useful framework to help you measure varied creative assets; help you shake up your digital marketing mix and validate your existing marketing activities and fill gaps in your knowledge.

Here’s the IAB’s top 10 list of must-knows when it comes to digital ad testing:

  1. Set clear objectives and KPIs upfront that relate to your business challenge — avoid retrofitting your objectives after the test. Success means different things to different companies and brands so make sure your objectives are aligned with your goals.
  2. Create a clear hypothesis for your test that will you address the business problem. This is a testable prediction about what you expect to happen in your study.
  3. Choose appropriate metrics aligned to your objectives – don’t just rely on what is most accessible (CTR, for example).  Include long-term as well as short-term metrics.
  4. Understand the strengths and weaknesses of the measurement method that you use.Create a measurement strategy — a clear, consistent plan for which tools you are selecting and why.
  5. Measure for incrementality  not correlation — so that you can understand what your advertising activity did that would not otherwise have happened.
  6. Design experiment cells to ensure best possible comparability of exposed and control. Ensure that you have: a) adequately sized groups for the precision needed in your test, b) random assignment of control and test groups, c) cells that match — for example, demographically, attitudinally, in propensity to use your product, and prior exposure – and finally, d) ensure your subjects are either in the control or exposed group, not both.
  7. Test and learn how to adjust your campaign to drive better results, apply and keep testing including building benchmarks to compare your results and set targets.
  8. Devote time to preparing the presentation of your results to stakeholders. Whether presenting to the executive management team or a board, answer the business question succinctly and understand your audience and their level of appetite for detail and technical language.
  9. Understand the measurement activities already happening in your organisation and external companies — don’t operate in a silo.
  10. Be brave. It’s an ever-changing world of new and the unknown but if you don’t push the boundaries and experiment then you run the risk of falling behind. Importantly, if you try and fail, simply start afresh and importantly, don’t be afraid to share your learnings as the more we dare to bare the better educated the whole market can become.
Beaumont Logo NEW 2

FREE Business & Marketing Courses

If this article interests you & you'd like to start a career in business and marketing see our free business and marketing courses.

certificate iv sample only 2023

FREE Business & Marketing Courses

If this article interests you & you'd like to start a career in business and marketing see our free business and marketing courses.

Social media monitoring helps businesses and individuals stay on top of their online reputation, identify trends, and engage with their audience.

Social media marketing involves creating and sharing content, engaging with customers, and building a community around your brand.

A well-designed customer acquisition process is crucial to streamline the process of attracting and converting new customers.

Scalability is a key factor in the success of any business, and it's particularly important for startups that are just starting out. To scale effectively, startups need to focus on a few key areas.

Social media monitoring helps businesses and individuals stay on top of their online reputation, identify trends, and engage with their audience.

Social media marketing involves creating and sharing content, engaging with customers, and building a community around your brand.

A well-designed customer acquisition process is crucial to streamline the process of attracting and converting new customers.

Scalability is a key factor in the success of any business, and it's particularly important for startups that are just starting out. To scale effectively, startups need to focus on a few key areas.

As employees work with their managers to develop their skills, they have a specific end in mind: promotion. Organizations are paying attention too and are looking for signs you’re ready for a promotion!

Market research is an important step in creating a strong brand. The purpose of market research is to gather information about your target audience, competitors, and the market as a whole.

subscribe

Get the latest College news, new courses and scholarship offers. 

OUR MISSION

Our Mission at Beaumont is to make a world class education available to everyone.

© 2025 Beaumont Business College

Keep it simple

Don't make this harder than it really is. Just think like a consumer and keep your ideas simple for now. All we're doing here is getting used to thinking about our company critically and like a business person.

In the upcoming lessons we'll investigate these ideas in more depth.

older-man-thinking

Maybe the company you’re thinking of is a cafe that has great products.  But are there other cafe’s around that also sell great products that are similar? This may suggest a product orientation. What would a marketing orientation do?

As a consumer what else would you like this company to do?

This website uses cookies to ensure you get the best experience on our website.