Khatabook Growth Operations & Decision Playbook

1.1 Aggregation Integrity: Ratio-of-Sums vs. Row-Level Averages

The Operational Problem: Ad networks report metrics across fragmented ad sets with orders-of-magnitude volume disparities (from 10 to 1,000,000+ impressions). Averaging row-level rates introduces severe aggregation distortion.

The Empirical Evidence: In Campaign 1178, the true Ratio-of-Sums CTR is 0.0176%, whereas unweighted row-averaging yields 0.0162% (-7.9% understated):

Averaging row-level rates distorts performance by assigning equal weight to micro-budget ad sets with small, noisy sample sizes and scaled ad sets with millions of impressions. Across all 1,143 ads, unweighted row-averaging yields 0.0164% vs true ratio-of-sums 0.0179% (-8.2% understated).

1.2 Direct Acquisition Cost vs. Fully Loaded Merchant CAC

The Diagnostic Boundary: Marketing teams frequently label direct social ad spend divided by approved conversions as "Customer Acquisition Cost" (CAC). This misrepresents business reality to finance and executive leadership.

• Direct social ad spend tracks only media spend across a single acquisition channel.
• "Approved Conversions" in top-of-funnel ad platforms represent qualified leads or initial app installations—not retained, active merchants.
• True CAC must incorporate blended organic discovery, brand marketing amortization, influencer and agency fees, creative production, OTP SMS infrastructure costs, and downstream \(D_1/D_7\) onboarding retention.

1.3 Revenue & Return Integrity (Why Synthetic ROAS Is Rejected)

Public ad delivery datasets provide impression, click, spend, and conversion counts, but do not track downstream merchant transaction volume, loan origination value, or soundbox subscription renewals. Synthesizing fictional revenue figures produces unreliable ROI claims.

When comparing Campaign 936 ($2,893.37 across 464 ad sets) to Campaign 1178 ($55,662.15 across 625 ad sets, a 19.2x media budget expansion), Cost per Approved Conversion escalated from $15.81 to $63.83 (+303.7% cost inflation).

Rather than relying on qualitative speculation, the gap is decomposed via a continuous 3-factor mathematical identity:

The Methodological Challenge: A frequent counter-hypothesis is: "Campaign 1178 only performed worse because it targeted an older or more expensive demographic cohort."

The Solution: Direct standardization re-weights both campaigns under an identical pooled benchmark audience distribution (\(w_i = \frac{\text{Clicks}_i}{\text{Total Clicks}}\)):

Strategic Takeaway: Even holding demographic mix 100% constant, Campaign 1178's unit acquisition cost remains 3.3x higher. Confounding is ruled out; post-click experience failure is confirmed.