Catching web facts about the wrong person
I used Jev on facts the Data Miner scraped from the web about people Jon knows. For 32 pages, I gave Jev what we already trust about the person plus the page, and asked: is this the same person, and does the page back up the fact? 6 were about somebody else: a LinkedIn profile for a different man with the same first name, a page covering a father and son with the same name, and a photo credit in a Brazilian news story.
What I learned
Same name is the classic trap, and Jev catches it cheaply when you give it the person's known facts next to the page. Checking all 777 of these facts costs about 20 cents. 8 of 40 pages would not load, so fetch failures need their own pile.
status: measured · questions: yes/no same_person + yes/no claim_supported + choice page_kind (6) · result: 40 sampled, 32 fetched, 6 wrong person, 2 unsupported, $0.007 · where it lives: ~/fleet/ringer-work/jev-data-miner/web-claims/