> If the contract/law passes the test suite, you're good!
Not necessarily, you risk the same sort of problems suffered by naïve statisticians who over-fit their data with ever more complicated models. This leads to erratic behaviour in real life and severe lack of predictability outside the range already covered by the data.
You need to run some kind of sensitivity analysis as well because the components used in the implementation (policemen, lawyers, auditors, traffic wardens, etc.) are not all of perfect quality. Think of an audio amplifier design, it looks wonderful on paper and works perfectly in the simulator. But fails spectacularly when built of real world components because each component is not quite exactly as specified. A sensitivity analysis can discover this by, for example, running the simulation multiple times with each component varied according to its expected quality (say +/- 10% for resistors, +/- 30 percent for transistor gain, etc.)
Not necessarily, you risk the same sort of problems suffered by naïve statisticians who over-fit their data with ever more complicated models. This leads to erratic behaviour in real life and severe lack of predictability outside the range already covered by the data.
You need to run some kind of sensitivity analysis as well because the components used in the implementation (policemen, lawyers, auditors, traffic wardens, etc.) are not all of perfect quality. Think of an audio amplifier design, it looks wonderful on paper and works perfectly in the simulator. But fails spectacularly when built of real world components because each component is not quite exactly as specified. A sensitivity analysis can discover this by, for example, running the simulation multiple times with each component varied according to its expected quality (say +/- 10% for resistors, +/- 30 percent for transistor gain, etc.)