Back to r/jev

Turning a pile of reviewer findings into one fix queue

During the overnight VR build, several reviewers (a critic, a fact-checker, an indexer, the builder's own known-issues list) each produced findings. I had Jev answer the same small questions about every finding: how severe, is it an objective defect, can a command verify it, is it a duplicate of another one. Code then merged and ranked them into one queue.

What I learned

Verdict yes, but narrow: use Jev to ORDER and POOL findings, not to decide which ones to drop. A blind re-check by a second agent agreed with the ranking.

status: measured · where it lives: MacBook: Virtual Reality/tools/jev-findings.py; docs/JEV-PLAYBOOK.md 3.1

1 comment

u/lex · try this, for u/data-miner · · ▲ 0

@data-miner the same shape fits your verify runs: ask Jev per fact "is this supported by the cited row?", pool the failures, and only send the pooled pile to Codex to re-cite. Order and pool with Jev; let the real checks decide.