LogoLogo
SDK ReferenceChangelogBlogStatusGet HelpGo To Dashboard
  • Introduction
  • Basics
    • How ContextDecision Works
    • How ContextPush Works
    • Getting Started
  • Context Decision
    • Logging Conversions
    • Revenue Outcomes
      • Logging Revenue with RevenueCat
    • Adding Entry Points
    • Release Checklist
    • Advanced
      • Custom Signals
      • Alternative Outcomes
      • Custom Outcome Metadata
      • Listening for Good Moments
      • Model Distribution Methods
      • Custom A/B Test Segmentation
      • Analytics & Reporting
  • Context Push
    • Integrating ContextPush
    • Push Notification Providers
      • OneSignal
      • Customer.io
      • Simple Web Request
    • Release Checklist
    • Analytics & Reporting
  • Discover By Use Cases
    • Multivariate Monetization
    • Inline Banners
  • Other Information
    • Glossary
    • Updating Your SDK
    • Minimum SDK Requirements
    • FAQ
    • Get Help
    • Changelog
  • Advanced
    • Custom Configuration
    • Capturing Context In Key Moments
Powered by GitBook
On this page
  • Built-In A/B Test Mechanism (Recommended)
  • Custom A/B Test Segmentation

Was this helpful?

  1. Context Decision
  2. Advanced

Custom A/B Test Segmentation

Learn how to configure A/B test segmentation using our built-in mechanism or manage it manually for full control.

PreviousModel Distribution MethodsNextAnalytics & Reporting

Last updated 24 days ago

Was this helpful?

Each machine learning model deployed to your app includes an associated . This allows us to accurately compare performance data between control and treatment groups, ensuring that observed changes are driven by our model rather than by random variation or other product-level adjustments.

We provide two options for configuring the A/B test split:

Built-In A/B Test Mechanism (Recommended)

We recommend using our built-in A/B test mechanism, which automates split assignment, deployment, and metric adjustments on your behalf.

No action is required to opt in to this approach.

Refer to Analytics & Reporting to learn how to report user segmentation groups to your internal analytics system.

Custom A/B Test Segmentation

If your app requires direct control over A/B test segmentation, we also support that, and it takes 2 simple steps:

Step 1: Segment Your Users

ContextManager.setControlMode(enabled: true)

Not yet supported in Android. Reach out to our team to request this feature.

Not yet supported in Flutter. Reach out to our team to request this feature.

Not yet supported in Unity. Reach out to our team to request this feature.

Not yet supported in React Native. Reach out to our team to request this feature.

Passing true assigns the user to the control group, preventing the SDK from making any decisions, as shouldUpsell will always be true then. Passing false allows the SDK to utilize the machine learning model to optimize conversions, provided that a model has already been deployed to the designated flow.

Even when using setControlMode, it’s important to keep all the context capturing and logging fully operational for both cohorts (control and treatment) as this is critical to train the ML models.

The SDK initialization via ContextManager.applicationDidFinishLaunchingWithOption and other configurations should also remain unchanged.

Step 2: Inform Us Of The Segmentation Split

Since your app controls the split, we request that you inform our team of the initial split percentage and notify us of any planned changes, as this impacts our reporting.

A/B test split