Skip to content

[Feature] <Unit testing tolrances> #75

@oliverchampion

Description

@oliverchampion

Feature description

Currently, we have taken huge boundaries for the unit testing. I would think it is nicer to have more realistic/strict boundaries.
However, what is a realistic boundary will probably depend on:

  • SNR
  • f (for the boundaries of D and D*)

Moreover, now, the boundaries are defined per algorithm in the json file, which gives a lot of redundancy. The flexibility of changing boundaries per algorithm seems to me unneeded (unfair comparison).

Describe the solution

My initial suggestion would be something like:
rTol(f)=Tol * SNR
rTol(D)=Tol * SNR / (1-f+epsiolon)
rTol(D*)=Tol * SNR / (f+epsilon)

Although it is up to discussion.

Moreover, I think the Tol values could be stored centrally (not algorithm-dependent)

Describe alternatives

No response

Additional context

Are you working on this?

None

Metadata

Metadata

Labels

No labels
No labels

Type

No type

Projects

No projects

Milestone

No milestone

Relationships

None yet

Development

No branches or pull requests

Issue actions