Campaign Analytics

We are excited to inform you that in April 2016, we have made some changes to campaign delivery statistics and subsequent analytics. The changes are done to make the metrics we track more relevant and meaningful to your business.

  1. Campaign Delivery 
  2. Campaign Performance
  3. Campaign Performance Tracking

 

Campaign Delivery

The new metrics are here under with the numbers they represent:

Segment Count: Represents the total number of users that satisfy the segment criteria

After Uninstall Removal: Number of users having at-least one active device

After FC Removal: Number of users that do not breach Frequency Capping (FC) criteria

Active Device Tokens: Number of devices active for the users satisfying all the above criteria (No breaching of FC, Not uninstalled etc.)

Of all the active device tokens, some might fail due to errors (Read more here) that come while sending the messages to GCM/APNS. The final number to which the notifications were sent successfully is the Successful Sent metric as below.

Successful Sent: Number of devices for which notification was sent successfully to GCM or APNS. Please note that this number does not guarantee that GCM/APNS will be able to deliver to these many devices. 

Campaign Performance 

Metrics and what they mean

Impressions:

What the metric meant earlier: Unique users who received the notification

Why we thought to change it: One user can have multiple devices. While the notification is delivered on all of them, we were counting them only for one of user’s device which was resulting in under-reporting of the impressions.

What will it report now: Total number of notification impressions

What it means for you: If one user has two Android devices and received notifications on both of them, the impressions will be counted as 2 which earlier was being counted as 1.

Note:In case of iOS, due to platform limitations, we cannot measure how many users received a particular notifications hence Impressions are assumed to be same as successful sent numbers.

Clicks:

What the metric meant earlier: Unique users who clicked on the notification

Why we thought to change it: One user can have multiple devices. When a notification is delivered on all of them, and user clicked on all of these devices, we were counting them only for one of user’s device which was resulting in under-reporting of the actual clicks.

What will it report now: Total number of notifications clicked

What it means for you: If one user has two Android devices and receive notifications on both of them and clicks these notifications on both devices, the clicks will be counted as 2 which earlier was being counted as 1.

 

Conversion Events (previously being tracked as Conversions):

Per se, no changes have been done in this metric but only the name has changed to provide more clarity.

What the metric means: Total number of primary conversion goal events happened within the attribution period (configurable) from the notification impression time.

In case of Active campaigns ( Smart triggers, geo fences and User Level Transactional Push ), this metric reports the cumulative primary conversion events since the starting of first campaign instance.

Bottom Line: Assume a user received a notification for which campaign goal was making purchase. Now if he/she has made two purchases, the conversion events will be 2.

Conversions (previously being called Converted Users)

What they meant earlier: Unique users who have accomplished the primary conversion goal event 

Why we thought to change it: In case of recurring/always active campaigns, if a user converted once from each instance of campaign, he/she was reported only once i.e. if user received an Abandonment Trigger on Day 1 as well as Day 3 and converted on both the days, he was being reported only once.

What will they report now: Number of times Unique users executed primary goal event from each notification of this campaign

Bottom Line: Nothing will change for general push campaign.  For always active campaigns,

  1. If user receives 1 Campaign Instance on Day X  and another on Day Y and converts once on both the days, the conversions will be counted as 2 (instead of being counted as 1 in past)
  2. If user receives 1 campaign instance on Day X  and converts twice from the same campaign, conversions will be counted as 1
  3. If a user receives 2 campaign instances of same campaign on Day X and converts for both of them, conversions will be counted as 2.

 

General Push/ Transactional Push (All User or Custom Segment) 

Old Metric Name

New Metric Name

What it means?

Impressions

Impressions

Total Notification Received Events

Clicks

Clicks

Total Notification Clicked events

Conversions

Conversion Events

Total conversion goal events

Converted Users

Conversions

Users who did the conversion goal event

     

Smart Triggers / Geo-Fence Triggers/ Transactional APIs - User Level 

Old Metric Name

New Metric Name

What it means?

Impressions

Impressions

Total Notification Received Events

Clicks

Clicks

Total Notification Clicked events

Conversions

Conversion Events

Number of conversion events from all notifications of this campaign

Converted Users

Conversions

Number of times users converted from each notification of this campaign

 

When  and where will these changes be reflected?

General Push:  These new metric changes will be active on New (Created after April 4th, 2016) as well as old campaigns (Created before April 4th, 2016).

Smart Triggers/GeoFenced/User Level Transactional APIs: Reporting format for Old Campaigns (Created before April 4th, 2016) will remain the same. New analytics will only be visible for campaigns created after April 4th, 2016

Conversion Goals Performance

You will be able to see this section when you have set more than one conversion goals for your campaigns. The section compares the performance of goals set by the marketer for the campaign.

All Goals: Will show all goal events for respective goal i.e. if a user made purchase twice, it will be shown twice. It is an equivalent of conversion events covered in sections above.

Unique Goals: Goals uniques across the users converted per campaign instance. It is an equivalent of Conversions metric covered in sections above.

Click Action Performance

We have introduced Interactive Notification Actions through which marketers can let users take specific actions without even opening the app. "You cannot manage what you cannot measure" and hence we launched the click performance of these Notification Actions to let marketers measure how many clicks are coming from these additional actions.

Default action refers to Notification click action while Action 1 and Action 2 denote the additional actions (if used) in notification payload.

Personalization Performance

While bringing you Push Personalization, we wanted to understand the impact of this personalized experience. Personalization performance will enable the marketer to compare the Click and Conversions across the personalized and non-personalized messages of the same campaign.

Campaign Performance Tracking

You can now (after August 9th, 2016) track your conversion via three methods. These three methods will, by default, be present as filters in campaign performance.

1. Impression Based Tracking

The one which you were using hitherto i.e. Number of conversion goals executed by users who received your communication,  within the configured attribution window from time of receiving the campaign. This appears as a default filter in your Campaign Performance.

2. Click based tracking

Number of conversion goals executed by users who clicked your communication, within the configured attribution window from time of click

3. In - session Tracking

Number of conversions goals executed by users, within 30 minutes after clicking your communication

 

 

Have more questions? Submit a request

Comments