A ChatGPT-style authoring instruction made it to the live support article.
Internal authoring instructions ('Write a proper article on it. Dont make it too long') were accidentally left in the published support article.
An AI auditor reads every published article on delta.exchange/support, compares each one to our official India user guide and developer docs, and surfaces real factual drift. Findings are routed to the right team, triaged, and re-verified after a fix ships. Below: what Phase 1 found and the fixes that have already gone live.
217
Articles audited
India portal · all published
291
Drift findings
P0 · New Issues · Spelling · Conflicts
222
Verified fixed
76% of all drift · re-checked against live article
$5.36
Full-sweep cost
11 min wall-clock · LLM spend
Each row of the triage sheet has a human Verdict and, for resolved findings, an automated re-check that confirms the original quote no longer appears in the live article.
35
62
190
4
All four were flagged by the bot, triaged by humans as real, and (where marked Fixed) re-verified against the live support article. The exact quotes below are what was on production.
Internal authoring instructions ('Write a proper article on it. Dont make it too long') were accidentally left in the published support article.
NEFT deposits are rejected and credited back to the user's bank account, but the SoT guide explicitly describes NEFT as a supported deposit method with a 30-minute ETA.
a crypto spot trading framework with BTC/ETH spot wallets, but the authoritative guide states Delta Exchange India is a derivatives-only platform where users deposit and withdraw INR — not crypto assets.
The title uses 'loose' (meaning not tight) instead of the correct word 'lose' (meaning to misplace or no longer have).
One cron, six steps, ~$5 per full sweep. No manual mapping of which support article belongs to which guide.
04:00 IST. Hits /api/audit on Vercel, protected by bearer token. Quiet days cost near zero.
SHA-256 of the normalized article vs Upstash Redis. Skips articles that have not moved since yesterday — typically 99 %+ of the corpus.
For each changed article: top-5 from the India guide + top-5 from dev docs via Upstash Vector semantic search.
One LLM call returns both support↔guide contradictions and guide↔docs conflicts. Halves cost vs. a naive two-call approach.
issueId = sha256(sotUrl + summary). New / still-open / resolved states roll automatically as fixes ship. Zero manual issue tracking.
P0s alert Slack. Notion gets the snapshot. The Google Sheet is the human triage workspace with a Verdict dropdown per row.
Assumes an SME spends ~6 minutes per article cross-checking against the guide + dev docs. At ₹2,500/hour blended SME cost, weekly cadence.
| Line item | Manual | Bot |
|---|---|---|
| Time per full sweep | ~22 hours | 11 min |
| Cost per full sweep | ₹55,000 | ₹450 |
| Steady-state monthly cost | ₹2,20,000 | ₹2,550 |
| Recall (% of articles checked) | sampled | 100 % |
The cron is intentionally paused after Phase 1 sign-off — the system has proven it works end-to-end and the open backlog is in human triage. Once leadership greenlights the next cycle, we can resume daily runs immediately.