Unable to edit and test changes on older completed tasks showing failed testing

After years I have resumed working in exercism and looked at my completed tasks. Some show the test failing. Looking at the requirements and the test script it is clear that some change occurred.
While I can go into the editor and edit the script the test will never consider the changes but take the completed script apparently.

Which language, and which exercises?

Does it do the same when you submit from your machine using the exercism command line tool?

@DocKlobi Did you update the exercise to the latest version? There is a button to do so, I think behind the 3-dot-menu in the online editor.

Also very old exercises may have the wrong file names, these are not renamed when updating the exercise. Are there multiple tabs with files to edit in the online editor?