Let’s be honest: proving ROI in digital experimentation has often felt like trying to solve a Rubik’s Cube, blindfolded.

For years, teams have been stuck in the same old debate: “This test boosted conversion rate, but AOV dropped!” or “AOV is up, but conversions are down!” Which is better? Who’s right? And most importantly, how do you convince your CFO that your work is actually making money?

The Problem: Conflicting Metrics and Stalled Decisions

Picture a scenario familiar to many: one campaign variation boosts conversion rate but lowers AOV, while another does the opposite. Which is the real winner? Without a unifying metric, teams get stuck in endless debates, unable to confidently declare a result or justify next steps. As a result, a significant share of tests end up in limbo, and existing ROI dashboards suffer from low trust and adoption.

In fact, last year, 8% of A/B test campaigns with a transaction goal ended up in the dreaded “no decision” zone.

The Solution: RevenueIQ

Now, imagine a world where you don’t have to choose between conversion rate and AOV. Where you don’t have to explain why one number went up while the other went down. Where you can walk into any meeting and say, “Here’s a monthly revenue projection of exactly how much revenue this campaign is generating.”

That’s the world RevenueIQ is building.

RevenueIQ is AB Tasty’s new, patented metric—a result of years of R&D and statistical expertise. It takes all the messy, contradictory data and boils it down to one simple, business-focused number: monthly revenue projection. No more “unclear winners.” No more “conversion vs. AOV” dilemmas; just a clear, actionable view of financial impact.

Key Benefits of RevenueIQ:

• Always a Clear Revenue View: RevenueIQ provides a direct view of revenue per visitor and per month, making it easy to see the financial impact of every campaign.
• Eliminates “Unclear Winners”: Even in complex scenarios, RevenueIQ provides a definitive view of which variation delivers the most revenue. This means no more inconclusive campaigns and a significant reduction in “undecidable” tests.
• Delivers faster results: Combining the two key metrics into a single revenue metric gives actionable insights more quickly than analyzing them separately
• ROI Projections Before Going Live: Teams can now project the revenue impact of a campaign before full rollout, complete with confidence intervals for best- and worst-case scenarios. This transparency helps avoid surprises and supports more strategic decision-making.
• Strong Differentiation: RevenueIQ is powered by a unique, patented Bayesian engine, ensuring robust, trustworthy results. It’s not just another metric—it’s the business truth.

Revenue IQ is able to give a confidence interval around the revenue prediction, allowing for better business decisions. With a clear best-case and worst-case scenario, business decisions are easier than just having one number without knowing its accuracy.

The best thing? No competitor currently offers an equivalent.

How RevenueIQ Works

RevenueIQ is deeply integrated into the AB Tasty platform. When a campaign runs, users see not just conversion rates or AOV, but a clear revenue uplift per visitor and per month. The system visually identifies the winning variation, quantifies the potential monthly revenue gain, and provides confidence intervals to show the range of possible outcomes.

For example, if a variation is projected to generate an additional €4,000 per month, RevenueIQ will also display the probability of this outcome and the range (e.g., €2,700–€6,000). This approach is both rigorous and transparent, helping teams make decisions with confidence.

More RevenueIQ resources:

• Curious to know more details? Please read our RevenueIQ Whitepaper for a full scientific explanation written by our Data Scientist, Hubert Wassner.
• Not a data scientist, but still want to know more? Read our RevenueIQ article that goes into more detail about the practical use of RevenueIQ.

The Impact: Confidence, Adoption, and Differentiation

With RevenueIQ, AB Tasty is setting a new standard for ROI proof in digital experimentation. The result is a simple, credible, and actionable narrative for QBRs and renewal discussions—one that restores confidence, drives adoption, and differentiates AB Tasty in a crowded market.

Revenue IQ lowers the risk of making business mistakes by focusing on revenue.

For teams tired of inconclusive debates and complex metrics, RevenueIQ offers a new way forward: clear, credible, and actionable proof of business impact.

FAQs about RevenueIQ

What is RevenueIQ?

RevenueIQ is a proprietary, patented metric developed by AB Tasty that provides a clear, unified view of how much revenue your digital experiments generate—expressed as revenue per visitor, per month.

How trustworthy are RevenueIQ’s numbers?

RevenueIQ is powered by a patented Bayesian engine, ensuring robust, transparent, and reliable calculations. All projections include confidence intervals, so you always see the full picture.

How does RevenueIQ handle complex or ambiguous test results?

RevenueIQ always provides a clear winner based on revenue impact, even in cases where traditional metrics are inconclusive (due to their lack of integration). This means fewer “stuck” campaigns and more decisive action.

How is RevenueIQ different from what competitors offer?

No competitor currently offers a metric like RevenueIQ. While others may provide “all-purpose” statistics for each individual metric, only RevenueIQ gives you a patented, unified view of revenue per visitor, per month—making it a true differentiator.

Let’s face it: launching a new feature can feel a bit like walking a tightrope. You want to wow your users with something fresh, but you also know that even the best-tested releases can have surprises lurking in the shadows.

What if you could take the nerves—and the guesswork—out of your next launch? That’s exactly what Progressive Rollout is here to do.

The Problem: Risky Feature Releases and Manual Workarounds

Picture this: your team has spent weeks (maybe months!) building a new payment system, a revamped booking flow, or a shiny loyalty program. You’re excited. But you’re also worried. What if something breaks? What if a bug slips through and impacts thousands of users at once?

This is the reality for most product and engineering teams. The stakes are high, and the pressure to “get it right” is real. That’s why so many teams look for ways to release new features gradually—starting with a small group, then expanding as confidence grows.

But here’s the catch: most teams don’t have a dedicated tool for this. Instead, they put together workarounds using feature toggles or A/B tests. These methods can work, but they’re clunky, manual, and often lack the visibility and reassurance everyone craves during a launch.

The Solution: Progressive Rollout

Progressive Rollout is our answer to this all-too-common problem. It’s a feature designed not just for the tech wizards, but for everyone involved in a product launch—product managers, developers, and even business stakeholders.

How does it work?
With Manual Progressive Delivery, you can schedule your feature release in stages. Maybe you want to start with 10% of your users, then move to 20%, 40%, and so on. You decide the pace and the audience.

Our platform handles the rest, automatically exposing more users to your new feature at each step. And at every stage, you get clear notifications and a visual overview, so you always know exactly what’s happening.

What Makes Progressive Rollout a Game-Changer?

1. It’s Actually Easy to Use
Let’s be honest: many “enterprise” tools are intimidating. Progressive Rollout is different. The interface is clean, intuitive, and designed so that anyone can set up a rollout in just a few clicks. No advanced segmentation or manual math required. Whether you’re a seasoned developer or a product manager new to experimentation, you’ll feel right at home.

2. Full Control, Full Reassurance
One of the biggest anxieties during a rollout is not knowing what’s happening. With Progressive Rollout, you get a crystal-clear view of your rollout plan: who’s getting the feature, when, and how much of your audience is included at each step. Email notifications keep you in the loop, so you’re never caught off guard. This transparency isn’t just a nice-to-have—it’s a must for teams who want to move fast and stay safe.

3. Flexible for Any Scenario
Want to give early access to your VIPs or most loyal users? Easy. Need to roll out to everyone, but in controlled increments? No problem. You can import user lists, target specific segments, or just roll out to “all users” in stages. Progressive Rollout adapts to your needs, not the other way around.

Fun Fact: Most Teams Aren’t Doing This—Yet

Here’s something surprising: despite the clear benefits, most teams aren’t using dedicated progressive rollout tools. They’re still relying on toggles and A/B tests, or even manual processes. Why? Because until now, the tools have been too complex or not user-friendly enough. Progressive Rollout changes that, making safe, staged launches accessible to everyone.

The Bottom Line: Launch With Confidence

Progressive Rollout isn’t just another feature—it’s peace of mind for your next big launch. By making gradual releases easy, transparent, and accessible, we help you reduce risk, improve user experience, and focus on what matters: delivering value to your customers.

Picture this: You’ve just launched a new product line, or maybe you’re gearing up for a themed campaign–think “Back to School” or a limited-edition collection. You want your customers to discover the right products, right away. But traditional recommendation engines are stuck waiting for data to trickle in, leaving you with generic suggestions and little control over what’s shown. For merchandisers, that’s not just frustrating – it’s a missed opportunity.

That’s exactly why we built AB Tasty’s Semantic Proximity Algorithm. Instead of relying on yesterday’s sales numbers, this new approach lets you craft relevant, business-driven product recommendations from day one. Whether you’re working with a fresh catalog or pivoting to a new campaign, you get the flexibility and control you need –  no waiting, no guesswork, just smarter recommendations tailored to your goals.

From Algorithm to Merchandiser Mindset

Most recommendation engines are just that – algorithms. But AB Tasty’s Semantic Proximity Algorithm is a paradigm shift: it allows your catalog to think like a merchandiser. Instead of passively waiting for data, it actively understands your products, your campaigns, and your business goals – giving your catalog a brain and putting you in the driver’s seat from day one.

Why Rethink Product Recommendations?

Traditional recommendation algorithms are built on analytics data – think Google Analytics or similar tools. These models can be effective, but only if you have enough historical data. What happens when you launch a new product line, a new brand, or want to activate a campaign around a specific theme (“Back to School,” “Harry Potter,” etc.)? Merchandisers are often left with little control, unable to quickly tailor recommendations to their business needs or campaign goals.

This is the challenge that inspired us to create the Semantic Proximity Algorithm: a tool that empowers merchandisers to launch relevant, business-driven recommendations instantly, even with zero historical data.

The Semantic Proximity Algorithm: A New Approach

AB Tasty’s Semantic Proximity Algorithm takes a fundamentally different approach. Instead of relying on analytics data, it leverages advanced Natural Language Processing (NLP) to analyze the attributes of your product catalog – such as product name, description, category, price, and even custom metafields. This allows the algorithm to identify products that are semantically related, regardless of whether they have ever been purchased together.

Key benefits include:

• Fast ROI: Campaign launches, upsell, cross-sell
• Instant setup: No need to wait for analytics data to accumulate. Recommendations are ready as soon as your catalog is integrated.
• Total flexibility: Merchandisers can select and combine any catalog attributes to build strategies and adapt recommendations on the fly for seasonal events or business needs.
• Full control and transparency: Preview and iterate on recommendations before going live, ensuring relevance and quality.
• Adaptable for all expertise levels: The algorithm is as simple or as advanced as you need. SMBs can start with just product names, while advanced users can leverage dozens or even hundreds of attributes for highly customized strategies.

Previously, recommendation engines were blind – waiting for clicks, sales, and data to slowly trickle in before making generic suggestions.

AB Tasty’s Semantic Proximity Algorithm delivers instant, intelligent recommendations. As soon as your catalog is integrated, the algorithm “thinks” like a merchandiser – making smart, relevant suggestions based on product meaning, not just past behavior. No more waiting, no more guesswork -just instant, business-driven recommendations that adapt as quickly as you do

Unique on the Market

No direct competitor offers this level of semantic attribute selection and flexibility. While some platforms provide basic attribute filtering, none allow merchandisers to select and combine multiple catalog attributes to fine-tune recommendations. Most competitors still rely mainly on analytics and sales data, with only limited semantic analysis capabilities.

This is a true differentiator for AB Tasty, empowering clients to adapt their recommendation strategies to their unique business challenges – without being held back by data limitations.

How Does It Work in Practice?

The Semantic Proximity Algorithm is designed to be both powerful and user-friendly. Merchandisers can choose which attributes to use for each recommendation strategy  – whether that’s product name, description, category, price, or even custom fields like Shopify metafields. This means you can tailor recommendations for specific campaigns, themes, or business objectives.

For example, during a seasonal campaign, you might want to recommend products that share a common theme in their description or category, even if they’ve never been purchased together before. Or, you might want to upsell higher-value editions of a product by prioritizing price as an attribute. The algorithm allows you to preview and iterate on these strategies instantly, making it easy to adapt to changing business needs.

Upsell, Cross-sell, and Beyond with Product Recommendations

The flexibility of the Semantic Proximity Algorithm opens up new possibilities for both upsell and cross-sell strategies. For upsell, you can recommend alternative products that are not only similar but also more profitable. For cross-sell, you can suggest complementary items that enhance the customer’s purchase – think of the classic “chewing gum at the checkout” scenario, but tailored to your specific catalog and business logic.

This approach is especially valuable for businesses with large or complex catalogs, or those looking to launch new products and campaigns quickly. It’s also ideal for expert merchandisers who want granular control over their recommendation logic, as well as for SMBs seeking a fast, easy-to-implement solution.

Fun Facts & Unique Highlights

• Did you know? This is the first AB Tasty algorithm that works directly from your product catalog–no analytics setup required.
• Unique on the market: No competitor allows merchandisers to select and combine multiple catalog attributes (including custom metafields) to fine-tune recommendations.
• Instant preview: You can see and iterate on your recommendation strategies before going live – perfect for adapting to seasonal campaigns or special events.
• Scalable: The algorithm can handle catalogs with hundreds or even thousands of attributes per product.

Conclusion

AB Tasty’s Semantic Proximity Algorithm ushers in a new era for product recommendations: faster, more flexible, and more intelligent. Whether you’re an SMB looking for simplicity or an enterprise seeking advanced personalization, this innovation lets you transform the customer experience and maximize revenue from day one.

FAQs

Is this just another “black box” AI?

No. You control which attributes are used, can preview results, and iterate. It’s transparent and customizable.

What if the recommendations don’t make sense?

You can filter and combine attributes, set thresholds, and preview results before going live. Early feedback has led to rapid improvements.

Does it work with custom fields?

Yes! Any attribute in your catalog, including custom metafields, can be used.

Breaking down silos between your data and your experiments

Every marketing team dreams of having a unified view of their customers. But in reality, data often lives in silos: a CRM here, a CDP there, a custom analytics tool somewhere else. If you want to use these audience segments inside AB Tasty for targeting and personalization, you need a simple way to connect them to our platform—regardless of the tool you use.

That’s exactly what AB Tasty’s Universal Connector delivers.

What is the Universal Connector?

The Universal Connector is built on top of AB Tasty’s Universal Data Connector (UDC). It allows you to import audience data from any third-party tool—even those not available as native integrations—and make them available in AB Tasty’s Segment Builder for experiments, personalizations, and patches.

In simple terms: If your tool can send audience data to AB Tasty, the Universal Connector can make it actionable.

Why it matters

• Agnostic by design: Works with any CRM, CDP, analytics platform or custom tool capable of sending data via API.
  
• Self-service: Marketers can set up their connectors through a simple interface—no heavy dev work required.
  
• Unified audience view: Imported audiences automatically appear in AB Tasty’s audience management and, once synced, are instantly available in the Segment Builder—ready to power your campaigns.
  
• Compatible with BYID: Works seamlessly with AB Tasty’s Bring Your Own ID feature, ensuring perfect reconciliation with your own user IDs across devices and platforms.

From complex workflows to a streamlined process

Traditional approach:

• Importing custom audiences often requires manual code injection, custom attributes, and support from technical teams.
  
• Segments have to be declared one by one in the JavaScript console, with a risk of errors.
  

With AB Tasty’s Universal Connector:

• Configure a connector in a few clicks: declare the source, specify how to identify the visitor (cookie, local storage, BYID), and let AB Tasty handle the reconciliation automatically.
  
• Audiences flow directly into the Segment Builder without manual coding.

Who benefits the most?

• Global brands with complex stacks: Multiple CRMs, custom CDPs, or proprietary data systems.
  
• The Travel & Hospitality industry: Hotel groups, cruise lines, and booking platforms that need to unify CRM, loyalty, and reservation data across web and mobile apps.
  
• The Retail & e-commerce sector: Brands that want to leverage loyalty IDs or offline CRM segments in their onsite personalizations.

A powerful use case: Travel & Hospitality

Travel brands often need to merge data from several tools: CRM, booking engines, loyalty programs, and mobile apps. The Universal Connector makes it easy to bring these audiences into AB Tasty and deliver hyper-personalized experiences.

For example, a major international hotel group uses the connector to unify audiences from its CDP and CRM, enabling precise targeting based on booking history and loyalty status across devices.

Getting started

The Universal Connector is designed to be quick to set up and easy to maintain. Most of the work can be done by a marketer, with only light support from a technical contact.

1. Create your connector: Make sure the audience identifier matches your imported file and specify how visitors are identified—via cookie, localStorage, or your own ID (BYID). The connector will handle the rest.
   
2. Send your audience data to UDC: Push your segments via a simple API call.
   
3. Target with confidence: Once synced, your imported segments automatically appear in the Segment Builder, ready to use in experiments and personalizations.

Bonus point: No complex coding. No manual segment declarations. Just a straightforward connection between your data and AB Tasty.

Ready to unlock your audiences?

Go beyond native integrations and make any audience actionable with AB Tasty’s Universal Connector.

Contact your KAM and start importing any audience into AB Tasty today.

Already an AB Tasty client? Let your CSM know your interest in this feature for further activation.

If you’ve ever run an A/B test, you know the thrill of watching those numbers tick up and down, hoping your new idea will be the next big winner. But behind every successful experiment is a secret ingredient: the statistical model that turns your data into decisions.

With so many options – Bayesian, Frequentist, CUPED, Sequential – it’s easy to feel like you’re picking a flavor at an ice cream shop you’ve never visited before. Which one is right for you? Let’s dig in!

The Scoop on Statistical Models

Statistical models are the brains behind your A/B tests. They help you figure out if your shiny new button color is actually better, or if you’re just seeing random noise. But not all models are created equal, and each has its own personality – some are straightforward, some are a little quirky, and some are best left to the pros.

Bayesian Testing Model: The Friendly Guide

Imagine you’re asking a friend, “Do you think this new homepage is better?” The Bayesian model is that friend who gives you a straight answer: “There’s a 92% chance it is!” Bayesian statistics use probability to tell you, in plain language, how likely it is that your new idea is actually an improvement.

Bayesian analysis works by updating what you believe as new data comes in. It’s like keeping a running tally of who’s winning the race, and it’s not shy about giving you the odds. This approach is especially handy for marketers, product managers, and anyone who wants to make decisions without a PhD in statistics. It’s clear, actionable, and – dare we say – fun to use.

At AB Tasty, we love Bayesian. It’s our go-to because it helps teams make confident decisions without getting tangled up in statistical spaghetti. Most of our clients use it by default, and for good reason: it’s easy to understand, hard to misuse, and perfect for fast-paced digital teams.

Pros of Bayesian Testing:

• Results are easy to interpret (“There’s a 92.55% chance to win!”).
• Great for business decisions (and no need to decode cryptic p-values).
• Reduces the risk of making mistakes from peeking at your data.

Cons of Bayesian Testing:

• Some data scientists may prefer more traditional methods.
• Can require a bit more computing power for complex tests.

Frequentist Testing Model: The Classic Statistician

If Bayesian is your friendly guide, Frequentist is the wise professor. This is the classic approach you probably learned about in school. Frequentist models use p-values to answer questions like, “If there’s really no difference, what are the chances I’d see results like this?”

Frequentist analysis is all about statistical significance. If your p-value is below 0.05, you’ve got a winner. This method is tried and true, and it’s the backbone of academic research and many data teams.

But here’s the catch: p-values can be tricky. They don’t tell you the probability that your new idea is better; they tell you the probability of seeing your data if nothing is actually different. It’s a subtle distinction, but it trips up even seasoned pros. If you’re comfortable with statistical lingo and want to stick with tradition, the Frequentist model is a good choice. Otherwise, it can feel a bit like reading tea leaves.

Pros of Frequentist Testing:

• Familiar to statisticians and data scientists.
• Matches legacy processes in many organizations.

Cons of Frequentist Testing:

• Results can be confusing for non-experts.
• Easy to misinterpret, leading to “false positives” if you peek at results too often.

CUPED Testing Model: The Speedster (But Only for the Right Crowd)

CUPED (Controlled Experiment Using Pre-Experiment Data) is designed to go fast by using data from before your experiment even started. By comparing your test results to users’ past behavior, CUPED can reduce the noise and help you reach conclusions quicker.

But here’s the twist: CUPED only shines when your users come back again and again, like on streaming platforms (Netflix) or big SaaS products (Microsoft). If you have an e-commerce site, CUPED can actually steer you wrong, leading to misleading results.

For most e-commerce teams, CUPED is a bit like putting racing tires on a city bike, not the best fit. But if you’re running experiments on a platform with high user recurrence, it can be a powerful tool in your kit.

Pros CUPED Testing:

• Can deliver faster, more precise results for high-recurrence platforms.
• Makes the most of your existing data.

Cons of CUPED Testing:

• Not suitable for most e-commerce or low-frequency sites.
• Can lead to errors if used in the wrong context.
• More complex to set up and explain.

Sequential Testing Model: The Early Warning System

Sequential testing is your experiment’s smoke alarm. Instead of waiting for a set number of visitors, it keeps an eye on your results as they come in. If things are going south – say, your new checkout flow is tanking conversions – it can sound the alarm early, letting you stop the test and save precious traffic.

But don’t get too trigger-happy. Sequential testing is fantastic for spotting losers early, but it’s not meant for declaring winners ahead of schedule. If you use it to crown champions too soon, you risk falling for false positives – those pesky results that look great at first but don’t hold up over time.

At AB Tasty, we use sequential testing as an early warning system. It helps our clients avoid wasting time and money on underperforming ideas, but we always recommend waiting for the full story before popping the champagne.

Pros of Sequential Testing:

• Helps you spot and stop losing tests quickly.
• Saves resources by not running doomed experiments longer than necessary.

Cons of Sequential Testing:

• Not designed for picking winners early.
• Can lead to mistakes if used without proper guidance.

Which Statistic Model is Best for A/B Testing?

If you’re looking for a model that’s easy to use, hard to misuse, and perfect for making fast, confident decisions, Bayesian is your best bet – especially if you’re in e-commerce or digital marketing. It’s the model we recommend for most teams, and it’s the default for a reason.

If you have a team of data scientists who love their p-values, or you’re working in a highly regulated environment, Frequentist might be the way to go. Just be sure everyone’s on the same page about what those numbers really mean.

Running a streaming service or a platform where users log in daily? CUPED could help you speed things up – just make sure you’ve got the right data and expertise.

And if you want to keep your experiments safe from disasters, Sequential is the perfect early warning system.

Conclusion: The Right A/B Testing Model for the Right Job

Choosing a statistical model for A/B testing doesn’t have to be a headache. Think about your team, your users, and your goals. For most, Bayesian is the friendly, reliable choice that keeps things simple and actionable. But whichever model you choose, remember: the best results come from understanding your tools and using them wisely.

Ready to run smarter, safer, and more successful experiments? Pick the model that fits your needs—and don’t be afraid to ask for help if you need it. After all, even the best chefs need a good recipe now and then.

Hungry for more?
Check out our guides on Bayesian vs. Frequentist A/B Testing and When to Use CUPED. Happy testing!