Utilizing Meta Experiments to understand incrementality in your ecommerce

Spearheading marketing for an e-commerce business in 2024 comes with many challenges, one of the biggest being attribution - more specifically, incrementality. In other words, what is the true value added to the business for each of our marketing activities? In this post, I will introduce incrementality, and outline how to utilize native tools in Meta to get more insights into the incrementality for your business.

Utilizing Meta Experiments to understand incrementality in your ecommerce
Kristoffer Skjærbæk
CCO & Partner
October 29, 2024
7
min read

Spearheading marketing for an e-commerce business in 2024 comes with many challenges, one of the biggest being attribution - more specifically, incrementality.

Before we dive into the rabbit hole of incrementality, let’s start by defining what it is:

Incrementality is the measure of the additional impact or lift generated by a marketing activity beyond what would have happened without it.

In other words, what is the true value added to the business for each of our marketing activities?

In this post, I will introduce incrementality, and outline how to utilize native tools in Meta to get more insights into the incrementality for your business. More specifically, we will cover:

1. What is incrementality and why is it important?

2. How can we use Meta Experiments to understand more about our incrementality on Meta?

3. What are the different types of experiments?

4. How do you implement your first experiment?

Let's get to it 🙌

Why is incrementality increasingly important?

I just claimed that incrementality is one of the biggest challenges for anyone spearheading marketing for an ecommerce in 2024. But why is that the case? And more importantly, why is it becoming more and more important?

First, the advertising landscape has become increasingly fragmented over the last 10 years. Now, most ecommerce is not just running ads on one platform. Today, the typical mix consists of multiple platforms like Meta, Google, Tiktok, Snapchat, Pinterest etc. This is making it increasingly difficult to understand what value each platform brings to the firm.

Secondly, consumers are increasingly interacting with your brand from multiple devices, making the purchase process longer and less linear. Back in the day, consumers logged on to their home computer, where all online interactions with the brand happened. Now, they are using their computer, their phone, their tablet - maybe they even have multiple devices in each category, which means you have to track across devices, resulting in less accurate tracking.

Lastly, we need to add several technical difficulties to the mix. The introduction of Intelligent Tracking Prevention (ITP), App Tracking Transparency, and the European Cookie Compliance policies are all technical measures put in place, resulting in companies having a hard time understanding the true incremental value added from each of their digital activities. Fingers crossed this trend in tracking difficulties will derail, but as of right now, nothing is indicating that. We can only expect this issue to grow over the coming years.

Why is Meta Experiments a great option to understand incrementality?

If you are running ads on Meta, they offer you a great opportunity to get a sense of your incremental return on investment from your activities on the platform, and are probably one of the best advertising platforms out there for it.

In Meta, there are two main types of experiments, or 'studies' as they call them, that you can run: self-service and fully managed

Self-service being the easy and approachable solution, while fully-managed is much bigger and complicated, but also provides more flexibility in the study design. Please note that fully-managed studies require that you have a Meta account executive connected to your account - either directly or through an agency.

Let’s focus on the self-serviced options for now. There are three options for self-serviced studies on Meta:

A/B testing: Split testing of minor elements in the account on either campaign group, campaign, or ad set level.

Brand lift study: Measure the impact of Meta ads on brand awareness, recall, consideration and action intent.

Conversion lift study: Measure the incremental impact of Meta ads on purchases or other conversions.

The conversion lift study is great for understanding the incremental revenue from running campaigns on Meta. It takes five minutes to implement, thus there is no reason for not doing so.

One important note, when it comes to the brand lift and conversion lift study… To ensure a lift from the ads can be calculated, a holdout group of 10% of your test group will be established. This means that in the testing period, 10% of the test group audience will not receive any ads from your brand.

How do I set up my first experiment?

It’s now time to dive into the account and set up your first experiment to get insights on the incrementality of your advertisement on Meta.

Luckily, setting up your first experiment is pretty easy 🥳

Step 1: Navigate to your Meta Business Manager and click on “Experiments”.

Step 2: Click “Create test” and pick the desired test type. To study the incrementality of your advertisement on Meta, a conversion lift study is the right choice for you.

Step 3: Now it’s time to fill in a lot of information. Select the campaigns you want to include in the study, specify the testing period, and ensure the right tracking event(s) is selected. Please note that you can create multiple cells for the study, but that would require substantially more data for the result to become statistically significant. You can also include multiple tracking events (objectives), if you have primary and secondary metrics, which are important to evaluate.

Step 4: Press “Review test details” and set the study live.

That’s how simple is it - now it’s your turn 😉

Final thoughts

There is no doubt, incrementality is becoming increasingly important for all ecommerces. We are living in a time where more and more advertisement channels are added to the mix, legal and technical barriers are put into place, and the potential customers increase their number of devices used

Luckily, advertisement platforms are introducing strong countermeasures to continue allowing for insights into incrementality of our marketing activities. Meta’s Experiments is right now one of the strongest and easiest to use tools out there, thus should be the first stop for most advertisers. 

If you are not already running experiments as part of your recurring activities on Meta, the best time to start was yesterday 🚀

Do you want to get tips and tricks on how to gain even more from your ecommerce marketing activities?

Then reach out to me on email, ks@profoundnorth.com, or by phone, +45 22 41 77 97.

Or reach us through the form below 👇

Subscribe our newsletter

We don’t chase short-term tricks—we connect strategy, paid channels, automation, and BI so your pipeline stays full and predictable month after month. If you want a team that embeds in your business and hunts for the highest-impact bets, we’re here to accelerate growth you can measure.

By subscribing you agree to with our Privacy Policy.
Thank you! Your submission has been received!
Oops! Something went wrong while submitting the form.
// Insights

Discover Profound Insights

View all
View all
Practical Guide to Bidding Strategies in Google Ads
July 31, 2025

Practical Guide to Bidding Strategies in Google Ads

Paid Search
Paid Growth
The 30-60-90 framework: How D2C CMOs can hit profit targets faster
July 28, 2025

The 30-60-90 framework: How D2C CMOs can hit profit targets faster

Paid Growth
Organic Growth
Revenue marketing for D2C: Applying the Bowtie Model to ecommerce growth
July 21, 2025

Revenue marketing for D2C: Applying the Bowtie Model to ecommerce growth

Growth Architecture
What is Revenue Marketing, and how does it help you connect brand with pipeline?
July 18, 2025

What is Revenue Marketing, and how does it help you connect brand with pipeline?

Growth Architecture
What is Revenue Operations, and why does it matter for B2B teams?
July 15, 2025

What is Revenue Operations, and why does it matter for B2B teams?

RevOps
YouTube. Your audience is there. Why is your company not?
July 7, 2025

YouTube. Your audience is there. Why is your company not?

Paid Growth
Paid Search

Need help solving your challenges?

Let's have a short conversation to get to know you’re challenges and how we might be able to help.

Schedule a call with Kevin or fill out the form.

Schedule call with Kevin
Thank you! Your submission has been received!
Oops! Something went wrong while submitting the form.