You can not select more than 25 topics Topics must start with a letter or number, can include dashes ('-') and can be up to 35 characters long.
Sean McBride 56f61e50ab
chore: Enhance experimental framework with dotenv
4 years ago
..
.gitignore test: add concurrency experiment 4 years ago
README.md test: centralize bimodal and refactor concurrency 4 years ago
edf.env chore: Enhance experimental framework with dotenv 4 years ago
fifo.env chore: Enhance experimental framework with dotenv 4 years ago
install.sh chore: selectively use sudo 4 years ago
latency.gnuplot test: add concurrency experiment 4 years ago
run.sh chore: Install hey if needed 4 years ago
spec.json test: centralize bimodal and refactor concurrency 4 years ago
success.gnuplot test: add concurrency experiment 4 years ago
throughput.gnuplot test: add concurrency experiment 4 years ago

README.md

Concurrency

Question

How does increasing levels of concurrent client requests affect tail latency, throughput, and the success/error rate of sandbox execution?

Independent Variable

  • The number of concurrent client requests made at a given time

Dependent Variables

  • p50, p90, p99, and p100 latency measured in ms
  • throughput measures in requests/second
  • success rate, measures in % of requests that return a 200

Assumptions about test environment

  • You have a modern bash shell. My Linux environment shows version 4.4.20(1)-release
  • hey (https://github.com/rakyll/hey) is available in your PATH
  • You have compiled sledgert and the empty.so test workload

TODO

  • Harden scripts to validate assumptions
  • Improve error handling in scripts. If sledgrt crashes, this charges forward until it hits a divide by error when attempting to clean data that doesn't exist