In Project discussion on Jan 17, 2018 including review of RFC 8204, we identified the following five areas to improve the Soak tests:
- A new Pre-requisite test for Traffic Generator stability, primarily intended for SW implementations but applicable for all.
- The Throughput Pre-requisite test should include a 5 minute verification of the result
- The Throughput Pre-requisite test should provide the Load in Frames per second, using a frame size which did not achieve maximum theoretical throughput on the Interfaces used.
- The RFC 2889 Max Frame Rate Metric shall be measured every 5 minutes during the test, along with the Loss count (or ratio), and these results shall be recorded.
- The test shall terminate (or inform/interrupt the test operator in some way) when loss ratio exceeds 10^-7 (or other threshold chosen in advance and recorded with the test results.