While trying to help a student with a learning exercise on the C++ track on discord, I went and update the exercise to the newest version but the test suite didn’t seem to update correctly.
The exercise in question was Election Day for the References concept. There was an additional test (9th) got added (the learner was seeing all 9 tests as intended), however after update the exercise I can still only see 8 of them.
This is what im currently looking at. Also I did change browser and clear cache just in case and it’s still the same.
For extra context, I did solve the exercise before the new update, but I’m pretty sure this shouldn’t matter and updated exercise should always show all the added test.
Sorry for the late reply. Yeah I crop the screenshot badly there, but I reset the exercise using ... → Revert to exercise start and the test suite is still the same…only show up to 8 and missing the 9th one
Yeah I don’t think that was a possibility because while I do the work on my local env, I submit 99% of all the work via the web editor (bar some exercises that explicitly require to use cli like alphametic)
Your solution’s git sha points to a SHA that appears to be correct and should include the added test. Could you use the CLI to download things locally and check what test file you’re getting?
@glaxxie Just to make sure: Did you re-run the tests? The screenshot does not include that. The Results tab only changes when running the tests (not when updating them / resetting the exercise).
This solved it!
I think i can see what’s going on now.
Back when I was doing python, sometimes an old exercise that i completed got updated and included new tests, when I update the exercise the test runner re-run my old submission automatically so it will fail and show the new added test.
It didn’t happen here, thus the confusion. Maybe this one was added with the flag to not trigger test runner to re-run?
But it is quite unusual, because it looks like an important edge case test that surely will fail people old submission if they did it incorrectly.
Sorry for wasting people time and thank you for helping.
It might have been merged with no important files changed which would have stopped this from happening (deliberately so not to strain the servers, but confusingly for you).
