// Track message interactions
logEvent('in_app_message_viewed', {
  message_id: 'breathing_tab_prompt',
  user_segment: 'free_active',
  screen: 'home'
});

// A/B testing setup
firebase.remoteConfig.setConfigSettings({
  minimumFetchIntervalMillis: 3600000,
  fetchTimeoutMillis: 60000
});

1. Executive Summary: Key Findings & Action Plan

The "SnoreSolutions" in-app messaging campaign successfully drove measurable improvements in core user behaviors. Contextual, action-oriented messages led to a 19% increase in weekly recording consistency among the test group and doubled the rate of remedy exploration. Qualitative feedback confirms users find these nudges helpful rather than intrusive.

✅ Top Success: Personalized triggers based on Snore Score data were highly effective, with a 31% click-through rate (CTR).

⚠️ Key Learning: Messages sent after 9 PM had a 40% higher dismiss rate, indicating user fatigue.

🎯 Next Month: Scale successful "High Score" nudge to 100% of eligible free users and develop a new message series focused on interpreting BreathFlow™ trends.

2. Experiment Overview

Aspect	Details
Primary Goal	Increase user engagement with SnoreLab's core tracking and remedy discovery features to improve retention and health outcomes.
Experiment Duration	October 1-31, 2024 (Full 31 days)
User Sample	10,000 active free-tier users (Active = recorded ≥ 3 nights in previous month). • Test Group (50%): Received contextual in-app messages. • Control Group (50%): Received no new in-app messages.
Message Types Tested	1. Consistency Nudge: Triggered after 3 days of no recording. 2. High Score Insight: Triggered morning after a Snore Score > 50. 3. Weekly Summary: Sent every Monday morning to all test users. 4. Feature Education: About BreathFlow™ (iOS only) and SnoreGym integration.
Tools Used	Firebase (A/B testing & analytics), Braze (message delivery), Apptopia (reviews sentiment).

3. Quantitative Results

3.1. Primary Engagement Metrics

Note: "Lift" shows Test Group performance relative to Control Group.

Metric	Test Group	Control Group	Lift	MoM Trend
Avg. Nights Recorded/Week	4.2	3.5	+19%	↑
% Users Exploring "Remedies" Tab	22%	11%	+100%	↑
7-Day User Retention	65%	61%	+4 pp	→
Overall Message CTR	24%	N/A	N/A	N/A

3.2. Performance by Message Type

Analysis of individual message campaigns.

Message Type	Trigger / Content	CTR	Primary Action Taken	Dismiss Rate
A. High Score Insight	"Last night's Snore Score was 65. Review your recording & see tips that can help."	31%	65% clicked "See Tips"	15%
B. Consistency Nudge	"You're on a 3-day streak! Record tonight to keep tracking your progress."	22%	58% started a recording	25%
C. Weekly Summary	"Your weekly avg. Snore Score was 42. Tap for insights & trends."	18%	42% viewed trends page	32%
D. Feature Education	"New: Understand your breathing stability with BreathFlow™."	12%	28% viewed feature guide	45%

3.3. Impact on Business Metrics

Metric	Test Group	Control Group	Notes
Visits to 'SnoreGym' Promo Page	+85%	Baseline	Strong cross-promotion signal.
Visits to 'Premium' Upgrade Page	+18%	Baseline	Indirect uplift observed.
Avg. Snore Score	41	43	Slight decrease, requires more data to confirm trend.

4. Qualitative Insights & User Feedback

4.1. Thematic Analysis from Reviews & Surveys

"The morning after a bad snoring night, the app suggested checking my 'sleep position' tips. It felt less like an ad and more like a coach." – User #A47 (Survey Response)

"I like the weekly report, but I get it when I'm rushing on Monday morning. I'd read it more if it came Sunday evening." – User #H22 (Survey Response)

"Seeing the high score message made me finally listen to the recording. Hearing it was… motivating to try the exercises." – App Store Review, Oct 15

4.2. Sentiment & Usability Notes

Positive Sentiment was strongly correlated with data-driven messages (High Score Insight).
Neutral/Negative Sentiment often cited poor timing (messages late at night) or repetition.
The ability to tap from the message directly into the relevant app section (e.g., recording, remedy page) was praised for usability.

5. Challenges, Learnings & Iterations

Challenge Identified	Adjustment Made (During Experiment)	Result/Learning
High dismiss rate for Feature Education messages.	Switched from a modal pop-up to a less intrusive banner at the top of the home screen.	Dismiss rate improved from 60% to 45%. Learning: Users are task-focused; education works best when contextual.
"Consistency Nudge" had lower impact on long-lapsed users (>7 days).	For this segment, changed copy to "Let's get back on track" with a link to a "Quick Start" guide instead of assuming a streak.	Slight CTR improvement (18% to 22%). Learning: Different messaging needed for re-engagement vs. maintenance.
Late-evening messages had poor engagement.	Implemented a "quiet hours" block (9 PM - 7 AM local time) for all non-critical messages.	Overall message CTR increased by 8%. Learning: Respecting the sleep context is crucial.

6. Recommendations & Next Steps

Short-Term Actions (Next 30 Days)

Scale & Automate: Roll out the highest-performing "High Score Insight" message to 100% of eligible free-tier users.
Optimize Timing: A/B test sending the "Weekly Summary" on Sunday evening vs. Monday morning.
Deepen Personalization: Develop a new message variant that suggests a specific remedy (e.g., "SnoreGym exercise," "side sleeping") based on the user's historical data and clicked tips.

Long-Term Roadmap Considerations

BreathFlow™ Integration: Design a message series that educates users on their BreathFlow™ stability score and suggests actions for improvement.
Outcome Correlation Study: Initiate a long-term analysis to see if users who engage with messages show a greater long-term reduction in their average Snore Score.
Preference Center: Explore building a simple settings option for users to choose message frequency or topics (e.g., tips, weekly reports, new features).

7. Appendix

A1. Full A/B Test Configuration Details: [Link to Internal Dashboard]
A2. Anonymized User Feedback Transcripts: [Link to Secure Repository]
A3. Raw Data Tables & Statistical Significance Calculations: [Link to Data Sheet]

Participant

So it's now giving me options about buying a premium version. I'm going to try for free first.

Researcher

Okay, and what do you think triggered this to come on screen?

Participant

Because I clicked try now.

Researcher

Okay, and then what are your options here? What can you do?

Participant

So I could either buy a one month rolling subscription or one year subscription is obviously significantly cheaper.

Researcher

And what do you think the subscription is for? What does it give you?

Participant

So I. I think all of the information that it's recording for me so I can do analysis over time.

Researcher

And what do you think you can do if you don't have a subscription?

Participant

Well, that's not entirely clear.

Participant

It's not entirely clear how much information I will get if I just use the free version.

Researcher

Do you think a subscription is necessary to use the app?

Participant

I am not clear because I would have thought not. It says try free and subscribe, which suggests that I do need to subscribe, but it also says free trial. So I'm not clear whether I need to subscribe and then I get my 7 day free trial that I can cancel or whether I can try it for free and then subscribe afterwards.

Researcher

Are there any similar apps or systems that you've used that have trial periods? Can you think of anything?

Participant

Not off the top of my head, but it's not infrequent.

Example Firebase Analytics Implementation

SnoreSolutions In-App Messaging Campaign Report [EXAMPLE ONLY]

1. Executive Summary: Key Findings & Action Plan

2. Experiment Overview

3. Quantitative Results

3.1. Primary Engagement Metrics

3.2. Performance by Message Type

3.3. Impact on Business Metrics

4. Qualitative Insights & User Feedback

4.1. Thematic Analysis from Reviews & Surveys

4.2. Sentiment & Usability Notes

5. Challenges, Learnings & Iterations

6. Recommendations & Next Steps

Short-Term Actions (Next 30 Days)

Long-Term Roadmap Considerations

7. Appendix

User Research Interview Excerpt [EXAMPLE]