Skip to content

Commit

Permalink
Update tolerance documentation for IDS: number format
Browse files Browse the repository at this point in the history
  • Loading branch information
Giuseppe Verduci committed May 9, 2024
1 parent 0402aec commit 0d50fd8
Showing 1 changed file with 28 additions and 28 deletions.
56 changes: 28 additions & 28 deletions Documentation/tolerance.md
Original file line number Diff line number Diff line change
Expand Up @@ -24,34 +24,34 @@ This means:

|v|lower bound<br>(v - abs(v) × ε - ε)| upper bound<br>(v + abs(v) × ε + ε)| absolute delta|
|---:|-------------:|-------------:|--:|
| 100000 | 99999,899999 | 100000,100001 | 0,200002 |
| 10000 | 9999,989999 | 10000,010001 | 0,020002 |
| 1000 | 999,998999 | 1000,001001 | 0,002002 |
| 100 | 99,999899 | 100,000101 | 0,000202 |
| 10 | 9,999989 | 10,000011 | 2,2E-05 |
| 1 | 0,999998 | 1,000002 | 4E-06 |
| 0,1 | 0,0999989 | 0,1000011 | 2,2E-06 |
| 0,01 | 0,00999899 | 0,01000101 | 2,02E-06 |
| 0,001 | 0,000998999 | 0,001001001 | 2,002E-06 |
| 0,0001 | 0,0000989999 | 0,0001010001 | 2,0002E-06 |
| 0,00001 | 0,00000899999 | 0,00001100001 | 2,00002E-06 |
| 0,000001 | -0,000000000001 | 0,000002000001 | 2,000002E-06 |
| 0,0000001 | -0,0000009000001 | 0,0000011000001 | 2,0000002E-06 |
| 0 | -0,000001 | 0,000001 | 2,0E-06 |
| -0,0000001 | -0,0000011000001 | 0,0000009000001 | 2,0000002E-06 |
| -0,000001 | -0,0000020000 | 0,000000000001 | 2,000002E-06 |
| -0,00001 | -0,0000110000 | -0,00000899999 | 2,00002E-06 |
| -0,0001 | -0,0001010001 | -0,0000989999 | 2,0002E-06 |
| -0,001 | -0,0010010010 | -0,000998999 | 2,002E-06 |
| -0,01 | -0,0100010100 | -0,00999899 | 2,02E-06 |
| -0,1 | -0,1000011000 | -0,0999989 | 2,2E-06 |
| -1,0 | -1,0000020000 | -0,999998 | 4E-06 |
| -10,0 | -10,0000110000 | -9,999989 | 2,2E-05 |
| -100,0 | -100,0001010000 | -99,999899 | 0,000202 |
| -1000,0 | -1000,0010010000 | -999,998999 | 0,002002 |
| -10000,0 | -10000,0100010000 | -9999,989999 | 0,020002 |
| -100000,0 | -100000,1000010000 | -99999,899999 | 0,200002 |
| -1000000,0 | -1000001,0000010000 | -999998,999999 | 2,000002 |
| 100000 | 99999.899999 | 100000.100001 | 0.200002 |
| 10000 | 9999.989999 | 10000.010001 | 0.020002 |
| 1000 | 999.998999 | 1000.001001 | 0.002002 |
| 100 | 99.999899 | 100.000101 | 0.000202 |
| 10 | 9.999989 | 10.000011 | 2.2E-05 |
| 1 | 0.999998 | 1.000002 | 4E-06 |
| 0.1 | 0.0999989 | 0.1000011 | 2.2E-06 |
| 0.01 | 0.00999899 | 0.01000101 | 2.02E-06 |
| 0.001 | 0.000998999 | 0.001001001 | 2.002E-06 |
| 0.0001 | 0.0000989999 | 0.0001010001 | 2.0002E-06 |
| 0.00001 | 0.00000899999 | 0.00001100001 | 2.00002E-06 |
| 0.000001 | -0.000000000001 | 0.000002000001 | 2.000002E-06 |
| 0.0000001 | -0.0000009000001 | 0.0000011000001 | 2.0000002E-06 |
| 0 | -0.000001 | 0.000001 | 2.0E-06 |
| -0.0000001 | -0.0000011000001 | 0.0000009000001 | 2.0000002E-06 |
| -0.000001 | -0.0000020000 | 0.000000000001 | 2.000002E-06 |
| -0.00001 | -0.0000110000 | -0.00000899999 | 2.00002E-06 |
| -0.0001 | -0.0001010001 | -0.0000989999 | 2.0002E-06 |
| -0.001 | -0.0010010010 | -0.000998999 | 2.002E-06 |
| -0.01 | -0.0100010100 | -0.00999899 | 2.02E-06 |
| -0.1 | -0.1000011000 | -0.0999989 | 2.2E-06 |
| -1.0 | -1.0000020000 | -0.999998 | 4E-06 |
| -10.0 | -10.0000110000 | -9.999989 | 2.2E-05 |
| -100.0 | -100.0001010000 | -99.999899 | 0.000202 |
| -1000.0 | -1000.0010010000 | -999.998999 | 0.002002 |
| -10000.0 | -10000.0100010000 | -9999.989999 | 0.020002 |
| -100000.0 | -100000.1000010000 | -99999.899999 | 0.200002 |
| -1000000.0 | -1000001.0000010000 | -999998.999999 | 2.000002 |

# Tolerance and range

Expand Down

0 comments on commit 0d50fd8

Please sign in to comment.