I can confirm this is related to the 0.19.4 update. The bug goes away if I downgrade my instance.
That said, it was extra bad with the beta because I think they never got marked read but now that the final release is cut and I've upgraded, they're being marked read on refresh.
I think. It's possible I just missed that it was working on refresh on beta6 too.