SchnorrSecp256k1 test failure

[jorisdral]

https://github.com/input-output-hk/cardano-base/actions/runs/5953821210/job/16148970273?pr=433 shows a test failure related to SchnorrSecp256k1 on MacOS with ghc-8.10.7:

SchnorrSecp256k1
      Signing and verifications should be successful.:                                              OK
      Verification only should be successful.:                                                      FAIL
        src/Test/Crypto/Vector/Secp256k1DSIGN.hs:330:
        Test failed. Verification only should be successful.
        Use -p '/SchnorrSecp256k1.Verification only should be successful./' to rerun this test only.

However, it seems to be a flaky failure, since the job was completed successfully after a restart.