Don’t Embarrass Yourself

Face recognition is a serious intrusion of privacy. The American tax authorities thought they could force it on the restive public, but was proven wrong.

The plan was to use controversial identification service ID.me. This requires users to submit scans of driver’s licenses, copies of utility or insurance bills, and to provide a live video feed of their face. Some states are using it to fight benefit fraud, but forcing it on everyone was a bridge too far. After a public outcry (and the news that Washington State just lost data on millions of citizens), this plan has been shelved.

This was a stupid idea from the outset. Beguiled by fast-talking sales people, officials lulled themselves into thinking this made sense. If they had someone on the team whose job it is to provide contrarian advice, this would never have happened. How do you ensure you get contrarian feedback before you embarrass yourselv before the entire nation?

Bad Face Recognition

In the U.S., police have started rounding up suspects based on defective image recognition from grainy surveillance video. Image recognition is known to work poorly on black faces, probably because they were mainly trained on images of white people.

When we roll out new technology, we of carefully explain to the users where and how it can be used. But if we can reasonably expect our users to ignore our admonitions, maybe we shouldn’t sell it at all.

https://www.theverge.com/2021/4/13/22382398/robert-williams-detroit-police-department-aclu-lawsuit-facial-recognition-wrongful-arrest