Oncourse · impact read · data through Nov 9, 2026

New Home and Rezzy: what changed, and what didn't

We compared about 6 weeks before launch (Sep 15 to Oct 29) with the first 11 days after (Oct 30 to Nov 9), across all courses. Short version: the redesign is very good at getting new learners into a conversation with Rezzy, and does little yet for learners who were already here. Trial to paid conversion looks better on the new Home (33% vs 17%), but only 15 of those trials have finished, so it's too early to call.

1.69.0 · Oct 30 · new Home, Rezzy chat as its own page, Home composer and starters, Home paywall can't be closed without access, App Review paywall copy 1.70.0 · Nov 5 · tutor invite card on Home, replies stream under a pinned question
Clear win
New signups who chat with Rezzy within 3 days
25.4%
up from 15.2% (+67%)
Flat at 15 to 16% for two months, then a step to 26.8% the week 1.69 shipped. Strongly significant.
No real change
Share of app learners who chat each week
28.0%
vs 29.1% before
Weekly chatters rose about a third vs the three weeks before, but because more learners opened the app, not because more of them chatted.
Mostly flat
Messages per Rezzy chat
4.0
average, up from 3.5; median fell from 2 to 1
Half of all chats are still one message. The average rose only because a few heavy users go longer.
Too early
Trial to paid conversion
33%
vs 17.3% before, but only 15 finished trials
Trials that ran fully on the new Home converted 5 of 15. That could still be chance (about 1 in 10). The next 45 trials finish by Nov 16.

My read: the new Home works as a front door. It turns new learners into Rezzy users at nearly twice the old rate. It hasn't yet changed how deep chats go or how often existing learners come back to Rezzy, and the generative invite card has barely been seen, so it can't be judged yet. Trial to paid conversion is up in the first trials, but there are too few to trust.

New learners reach Rezzy almost twice as often

Share of each week's signups (with a course picked) who sent Rezzy at least one message within 3 days of signing up. New installs always get the latest build, so this is the cleanest before and after we have.

% of signups chatting within 3 days, by signup week

What happened

15.2% of 4,092 signups chatted within 3 days before launch; 25.4% of 751 after. The jump lands exactly in the release week and holds across most courses: US Medical PG 21% to 42%, CFA 8% to 28%, NCLEX 9% to 15%, MCAT 5% to 13%.

Why I think it happened

The new Home puts a Rezzy composer and a "first chat" card front and center, and the chat now opens as its own page. In the week of Nov 2, about 110 of roughly 154 learners who chatted opened Rezzy from Home. The old Home made Rezzy one option among many.

The exception

Indian Medical PG did not move (12.9% to 11.9%). These learners are mostly on Android, which was slower to update. Worth checking before we call it a universal win.

More chatters, because more learners opened the app

Rezzy chats come from the database, so they count every chat with at least one learner message. Learner counts are signed-in learners active in the iOS or Android app.

Learners who chatted with Rezzy, per week
% of active app learners who chatted, per week
Learner messages to Rezzy, per day (weekly average)

Same learners, before and after

302 learners active both in Oct 1 to 26 and Nov 1 to 9, split by whether they updated to the new app.

GroupDays with a chatMsgs per active dayMsgs per chat day
Updated (231)36% → 33%1.87 → 1.665.2 → 5.1
Still on old app (71)43% → 37%3.03 → 1.897.0 → 5.2

Both groups dipped in November, the updated group a little less. With only 71 learners on the old app, I wouldn't call that a lift. In the same days, 30% of updated learners chatted vs 21% on the old app, but the updated group is also more active overall.

Weekly chatters went from about 190 to 265, back to September levels. Most of that is more learners opening the app after the update (478 to 550 a week). The share who chat stayed at about 28%. For existing learners, the redesign hasn't yet made Rezzy a bigger habit.

Chats are about as short as before

Length is learner messages per chat. A "chat" is one Rezzy conversation with at least one learner message.

How long chats are: share of chats by learner messages
Before (3,835 chats)After (843 chats)
% of chats with 3 or more learner messages, per week

What happened

Average rose from 3.5 to 4.0 messages, but the median fell from 2 to 1 and the shape barely moved: 52% of chats are a single message (48% before), and 33% reach three or more, same as before. The average moves on a handful of very long chats, so it overstates the change.

Messages got shorter

Learner messages average 189 characters, down from 360. Learners are tapping starters and asking quick follow-ups rather than pasting long questions. That's healthy for engagement, but it means Home starts more conversations without making them go further.

Opened but unused

46% of Rezzy chats created never get a learner message (49% before). Every chat page open that doesn't turn into a message is a missed first turn.

Trial to paid: early signs are good, but too few trials to call

Trial to paid conversion is the share of finished trials (converted or expired) that turned into a paid subscription. A trial lasts about 7 days, and the learner spends it in the app, so this is the money metric Home can actually move. Trials are grouped by the day they started. Source: RevenueCat, all stores.

Trial to paid conversion by trial start week (finished trials only)
Trial to paid conversion by how much of the trial ran on the new Home

45 more trials started Nov 3 to 9 and are still running. They finish by Nov 16.

Before launch: trial to paid by whether the learner chatted with Rezzy during the trial (App Store and Play, Aug 3 to Oct 25)

Learners who chat with Rezzy during their trial convert about 1.5 times as often. This is a correlation, since keener learners do both, but it's the path Home is meant to push.

Share of trialers who chatted with Rezzy during their trial

About half of trialers chatted with Rezzy before launch, and about half still do. Home hasn't yet pulled more trialers into Rezzy.

What happened

Before launch, 17.3% of finished trials converted (58 of 336). Trials where launch landed mid-trial converted 19.4% (6 of 31). Trials that ran fully on the new Home converted 33% (5 of 15). Weekly conversion has bounced between 12% and 26% all autumn, so one good week of 15 trials isn't a trend yet.

Is it Home?

Possibly, but the mechanism isn't visible yet: the share of trialers who chat with Rezzy hasn't moved. The other suspect is 1.69's paywall copy, which now shows the billed price first and the date of the first charge. That cut trial starts by about a quarter, likely the less committed ones, and the learners who still start a trial would convert better regardless of Home.

When we'll know

By Nov 16 we'll have about 60 trials that ran on the new Home. That only catches a very large lift. Spotting a 7 point lift reliably takes about 450 trials per group, roughly 10 weeks at our volume. A Home holdout for part of new trialers is the only way to get a clean answer sooner.

Not about Home: fewer trials start, more people buy directly

Trial starts happen on the onboarding paywall, before Home, so Home can't explain them. They're here because the same release changed them.

Trial start rate: % of new customers who start a trial, by week first seen
Onboarding paywall: % of viewers who tap to purchase, by app version
iOSAndroid
New paid subscriptions per week
From a trialDirect purchase
Revenue per week (USD)

Trial start rate fell from about 5.5% to 3.9% as 1.69 rolled out with the new paywall copy. Direct purchases rose at the same time because Home's paywall can no longer be closed without access, so weekly revenue held ($1,433 in the week of Nov 2 vs an October average of about $1,320).

Which Home entry points learners use

Signed-in app learners, Oct 30 to Nov 9. 542 learners saw Home; 200 sent Rezzy a message.

Learners who opened Rezzy from each Home entry point

The composer does the work

The plain "ask Rezzy" box on Home is how most learners start (79 learners, 400 opens). Suggested starters, tool chips and daily prompts each reach only 13 to 27 learners, under 5% of Home viewers.

The invite card barely shipped

Only 9 learners saw the tutor's invite card and 8 tapped it (30 saw any Home card). It only appears after a learner has finished their first chat and chosen a study mode, which most haven't. So the generative piece has no measurable effect yet, good or bad.

By course

Per-day averages before (45 days) vs after (11 days). Small courses swing a lot on a handful of learners, so read them as direction, not size. The All courses row pools every learner and chat, so big courses count for more; it leaves out the few chats with no course set.

CourseSignups chatting in 3 daysChatters per dayMessages per dayMsgs per chatChats with 3+ msgsChats after

What we should do next

  1. Find out why Indian Medical PG didn't move.Every course already opens Home on the first chat, and it worked almost everywhere else. Check how many of these learners are still on an app version older than 1.69 (mostly Android), and whether the suggested starters fit this exam.
  2. Re-read trial to paid conversion on Nov 17, and add a Home holdout for trialers.About 60 trials will have run on the new Home by then, still too few for anything but a big lift. Track the share of trialers who chat with Rezzy during the trial as the early signal (before launch, trialers who chatted converted 20% vs 14% for those who didn't), and hold the old Home back for a slice of new trialers to get a clean answer.
  3. Put the invite card in front of people, with a holdout.Show it to learners still in the first-chat or "choose" state, roll it out to half of eligible learners, and compare chats per learner. Right now 9 people have seen it.
  4. Work on the second message, not the first.Half of chats end after one message, and almost half of opened chats get none. End each Rezzy reply with two or three concrete next steps (quiz me, go deeper, make a flashcard) and track "% of chats with 3+ messages" as the depth metric, currently 34%.
  5. Watch retention for the hard Home paywall.It's paying off in direct purchases now. Compare D7 and D14 return for learners who hit it, against the October baseline, before keeping it as is.
  6. Separately, look at the onboarding paywall.Fewer learners tap purchase on 1.69 and 1.70. That's not a Home effect, but it costs trials. Test a layout that keeps the App Review copy with the old hierarchy, and check Android 1.70, where purchase completion fell to about 5%.
  7. Fix chat tracking.In PostHog, "Rezzy Chat Started" fires on every message, so it matches "Rezzy Query Asked" one to one. Send a chat id and fire it once per chat so these reports don't need the database.

How this was measured

Sources, windows and caveats

Prepared Nov 10, 2026.