I recently merged a contributor’s PR to update the test script for a concept exercise. I have not yet seen the “This exercise has been updated” on my solution page.
I think this is a feature not a bug. If your solution passes the latest tests, you shouldn’t get that prompt.