670
xkcd #2899: Goodhart's Law
(imgs.xkcd.com)
Alt text:
[later] I'm pleased to report we're now identifying and replacing hundreds of outdated metrics per hour.
you are viewing a single comment's thread
view the rest of the comments
view the rest of the comments
this post was submitted on 27 Feb 2024
670 points (98.8% liked)
xkcd
8588 readers
231 users here now
A community for a webcomic of romance, sarcasm, math, and language.
founded 1 year ago
MODERATORS
What's even better is when your metrics are based on last year's metrics so you better achieve exponential growth or start looking for another job.
The year before last we achieved 1% test error rate in an area, and the bosses were seriously considering having the following year's goal be 0%. Someone had to point out that if anyone had 1 error on Jan 1, we literally couldn't do anything to achieve the goal the rest of the year and may as well give up entirely.