A/B Experiments

Timeout Optimization

running

Parameter: request_timeout_ms

Confidence

92%

control 50% traffic

Value: 5000

Conversions: 1234

Rate: 12.0%

variant_a 50% traffic

Value: 3000

Conversions: 1456

Rate: 15.0%

Batch Size Test

completed Winner: variant_a

Parameter: batch_size

Confidence

98%

control 50% traffic

Value: 10

Conversions: 2345

Rate: 8.0%

variant_a 50% traffic

Value: 25

Conversions: 2890

Rate: 11.0%