https://app.neptune.ai/yuuk1/tsifter/e/TSIF-148/all | | | tn | fp | fn | tp | reduction_rate | accuracy | |---------------:|------:|---:|---:|---:|---:|---------------:|---------:| | chaos_type | step | | | | | | | | pod-memory-hog | step1 | 0 | 0 | 3 | 45 | 0.849976 | 0.937500 | | | step2 | 0 | 0 | 8 | 40 | 0.898798 | 0.833333 | | | | tn | fp | fn | tp | reduction_rate | accuracy | |-------------:|------:|---:|---:|---:|---:|---------------:|---------:| | chaos_comp | step | | | | | | | | carts | step1 | 0 | 0 | 0 | 5 | 0.849045 | 1.0 | | | step2 | 0 | 0 | 0 | 5 | 0.898089 | 1.0 | | carts-db | step1 | 0 | 0 | 0 | 5 | 0.842038 | 1.0 | | | step2 | 0 | 0 | 4 | 1 | 0.896497 | 0.2 | | catalogue | step1 | 0 | 0 | 0 | 5 | 0.831210 | 1.0 | | | step2 | 0 | 0 | 0 | 5 | 0.891720 | 1.0 | | catalogue-db | step1 | 0 | 0 | 0 | 5 | 0.788217 | 1.0 | | | step2 | 0 | 0 | 0 | 5 | 0.871338 | 1.0 | | front-end | step1 | 0 | 0 | 3 | 2 | 0.901274 | 0.4 | | | step2 | 0 | 0 | 3 | 2 | 0.920382 | 0.4 | | orders | step1 | 0 | 0 | 0 | 5 | 0.877389 | 1.0 | | | step2 | 0 | 0 | 0 | 5 | 0.911783 | 1.0 | | orders-db | step1 | 0 | 0 | 0 | 5 | 0.868471 | 1.0 | | | step2 | 0 | 0 | 1 | 4 | 0.907643 | 0.8 | | shipping | step1 | 0 | 0 | 0 | 5 | 0.863376 | 1.0 | | | step2 | 0 | 0 | 0 | 5 | 0.897134 | 1.0 | | user | step1 | 0 | 0 | 0 | 4 | 0.861067 | 1.0 | | | step2 | 0 | 0 | 0 | 4 | 0.907643 | 1.0 | | user-db | step1 | 0 | 0 | 0 | 4 | 0.817675 | 1.0 | | | step2 | 0 | 0 | 0 | 4 | 0.885748 | 1.0 | - [[ARモデルの予測誤差による外れ値検知]]を試した。 - step1での失敗はfront-endの3ケースのみ。手元での実験では、pod-cpu-hogはaccuracy 1.0 reduction rateは89%。 - front-endは故障注入に失敗しているので、実質3ケースのみ。