Trials
Every mapped trial — active and closed — with the testing footprint it built up during its trial window. Metrics are measured as of the trial-window end; activity after it is excluded. "Day of trial" (and trial length) counts from the trial-window start (day 0).
The trial window is the curated Notion window (Trial Start → Trial End from the
🏄 Trials database) when one exists for the org, otherwise the derived window
(first activity → deal close). For an active trial with no close date, the
window runs to today. An open Status (not Closed Won/Closed Lost) means the
trial is still active, so its Closed date is blank.
The won-vs-lost comparisons below are scoped to closed trials only — an active trial has no outcome yet.
Column definitions worth knowing:
- Trial window — the curated Notion window (Trial Start → Trial End), when set;
otherwise first activity → deal close (or today, while active). It drives
Lengthand the day-0 anchor. - First activity — the first real testing footprint for the org: the earliest
of its first build ingested, first test authored, or first test run. It
deliberately ignores
Org created(an administrative row that is often written days after the app was first set up and tested). Shown for reference even when the curated window overrides it as day 0. - Days visited — distinct days an org user loaded the production dashboard
(
app.semaloop.com), from PostHog$pageviewevents matched to org users by email, counted only within the trial window. - Tests are attributed by their author's email:
- By them — author is not an
@semaloop.comuser, i.e. the customer wrote it. - By us — author is an
@semaloop.comuser, i.e. we wrote it for them. - Tests with no recorded author (unknown origin) count in
Testsbut neither column.
- By them — author is not an
Won vs lost
Median per closed-trial group — the fastest read on which signals separate winners from losers. Full distributions for each are below.
Distributions
"Time to first"
Cumulative share of trials that reached a milestone by each day of the trial. The denominator is all trials in the group, so a curve that never reaches 100% means some trials never hit the milestone.
Test distributions
Across every test in these closed trials.