Confusing message about a test failure while still accepting solution

Exercism Support
1

Apologies if I’m not using the Categories/Tags correctly.

Had a weird experience with the rna-transcripton exercise in the Clojure track; it claimed that my solution both passed all tests and failed one test at the same time :slight_smile:

See attached screen shot.

Screenshot from 2024-10-03 13-03-43
Screenshot from 2024-10-03 13-03-431854×1048 113 KB

2

That’s almost definitely a bug in the clojure test runner.

Maybe you could add some a test with your code and the test-suite to the tests folder and see if it’s easily reproducible?

Thanks!

3

I checked the test runner code and two other community solutions, and this issue seems to always be caused by an explicit assert that fails. If an AssertionError is thrown the other way, like so: (throw (AssertionError.)), everything works as it should.

However, there are two things worth noting:

  1. Currently, this is the only exercise in the track that uses AssertionError in the tests, which allows people to use assert in their code and trigger this behavior.
  2. The tests are out of sync with the problem specs, which don’t even include error checking. If we implement the new tests, this issue will no longer occur.

I believe Bobbi should immediately clarify what is going on.

In the meantime, I’ll create an issue on the clojure-test-runner repo and sync the tests.

1 Like