e1f7dbe6c3
fix: type error and typo
4 years ago
a0810a4533
chore: log client info on socket descriptor error
4 years ago
64fca85cc4
fix: correct socket address lifetime error
4 years ago
21d0f28572
chore: Fix missing csv comma
4 years ago
1517db0759
fix: Correct implicit pointer cast
4 years ago
65e8b27775
chore: Mask ARM source if not AARCH64 not defined
4 years ago
661748afe4
feat: Basic memory profiling
4 years ago
86b1a274e9
chore: validation and active as boolean
4 years ago
5968d9b72e
feat: more explicit config logging and validation
4 years ago
0d44e473e3
chore: formatting nits
4 years ago
e771e7e1e0
feat: add memory to sandbox log
4 years ago
192f539f36
test: Improve Image resize
4 years ago
1a828a4a40
chore: Add issue for context restore new
4 years ago
57af991ecc
chore: add issue for fixme
4 years ago
de1ab890c4
feat: admissions control headspace for overhead
4 years ago
978b692452
fix: correct assorted bugs
4 years ago
bcb00b4e1c
chore: log invalid context
4 years ago
b61da62c2b
chore: fix missing include
4 years ago
aa224d1ac1
chore: make quantum smaller
4 years ago
6554e6d1fe
fix: correct sloppy overflow
4 years ago
f8d3a0c991
docs: Update zombie funciton comment
4 years ago
240a1af6c7
chore: update extern to match integral MHz
4 years ago
9767aec9ad
chore: refactor away DEBUG define
4 years ago
5d8a761b61
feat: Refactor of conditional compilation units
4 years ago
25b67841e4
chore: rename state in unhygienic lock macros
4 years ago
f7df3c876e
chore: assorted socket error handling
4 years ago
a83ae29d1b
feat: remove libuv, rework pq, http close DRY up
4 years ago
8aef688553
feat: runtime configurable sandbox perf logging
4 years ago
99d33c46cb
fix: correct error code
4 years ago
e810d78561
feat: expose NWORKERS as environment var
4 years ago
c0a97a5394
feat: Expose scheduler as runtime config
4 years ago
46f597a78c
fix: correct http-parser bug
4 years ago
7ca1f8e63d
docs: Remove incorrect comment
4 years ago
25d746c2e4
feat: WIP
4 years ago
ef777c2705
refactor: set flags to bool
4 years ago
2a82fe96f3
feat: get epoll implementation working
5 years ago
ff8c04a6e9
chore: Change client parsing from error to log
5 years ago
10ad100847
feat: Use integers for admissions control
5 years ago
bf6b5d3c61
fix: cleanup lock API
5 years ago
3c7e062548
refactor: cleanup module DB
5 years ago
e0a80711f9
chore: Simplify module db add
5 years ago
92c17d7717
chore: Assorted debugging enhancements
5 years ago
f93a18e685
chore: change perror to debuglog
5 years ago
e91f9feb8e
fix: disable interrupts when lock is held
5 years ago
6c718dfa6e
chore: Stop adding to unused database
5 years ago
a7293a7a0a
feat: non-blocking listener core
5 years ago
0787b27b4f
fix: correct module db errors
5 years ago
019130b43c
chore: Cleanup module_database_dd
5 years ago
296a907107
docs: better document epoll backlog
5 years ago
c1edca2a42
chore: assorted socket error handling
5 years ago
9ead528dfc
chore: better debugging and small socket fixes
5 years ago
587e2ab354
feat: Only dequeue request if actually earlier
5 years ago
e3261244ee
chore: replace aborts with panics
5 years ago
9bed646e3b
chore: enhance log granularity
5 years ago
01d32c19f8
chore: replace asserts with abort to be use NDEBUG
5 years ago
04e63c2a02
chore: panic on recursive softint disables
5 years ago
c30018eb4a
chore: Improve buffer names
5 years ago
82d0505104
chore: make durations uint32_t
5 years ago
392d04423a
chore: ignore loop of asserts on NDEBUG
5 years ago
d1d27a9162
feat: percentiles for execution estimates
5 years ago
f8f1db7eaf
feat: complete lock refactor
5 years ago
b3215c6dbc
feat: all but trylock
5 years ago
6673734857
feat: mcs locks and profiling
5 years ago
c291b049c8
fix: Properly close malformed requests
5 years ago
e445e76870
feat: add ability to reject request
5 years ago
76ba308c16
feat: Initial MVP of admissions control
5 years ago
142a57dbb6
chore: make cleanup
5 years ago
4b107f3033
chore: cleanup debuglog file logic
5 years ago
0707f44989
chore: enforce that buffer is power of 2
5 years ago
c307f2a166
feat: Implement perf window
5 years ago
628275f6f9
docs: Associate FIXMEs and TODOs with issues
5 years ago
f963828db7
chore: general pq cleanup
5 years ago
6cb442d13d
docs: assumptions and runtime globals
5 years ago
ba4f9e2119
feat: precomp module deadline cycles
5 years ago
e898d5ab69
chore: validate interrupts disabled at spinlock
5 years ago
8e36412944
choe: add util to detect if worker
5 years ago
94a95c826d
fix: add missing header
5 years ago
d6f10cac7a
refactor: decompose types.h
5 years ago
9720f82441
chore: require min 2 cores
5 years ago
eb491a9018
chore: add always inline attributes
5 years ago
b315844c46
feat: constant propagation state transitions
5 years ago
eca1546f7a
chore: improved logging
5 years ago
465b820326
chore: static inline sandbox_state_stringify
5 years ago
c37b2ba9a9
docs: Assorted comment cleanup
5 years ago
842d078846
feat: set as error transition
5 years ago
c0bcbdbc2e
feat: set as returned
5 years ago
c014f94797
feat: set as blocked
5 years ago
b85d089537
feat: running, preempted, complete transitions
5 years ago
65b10f19dd
feat: sandbox set as runnable
5 years ago
fd22432cb0
refactor: set_as_initialized
5 years ago
048b01e690
feat: print_perf
5 years ago
24e25f255f
feat: add sandbox_state_stringify
5 years ago
33d65605b1
refactor: free linear memory func
5 years ago
7dc4488d74
chore: add sandbox state
5 years ago
853382dcda
fix: correct HTTP response syntax
5 years ago
8d1b447e74
refactor: cleanup HTTP response logic
5 years ago
81e3a88a1f
chore: fix case on enums
5 years ago
1370c9f3e1
changes in aarch64 for context variant
...
* Tested fibonacci with 10 and 20 seperately
* Tested fibonacci multi that are in tests/preemption with client1 and
client2 requests.
* Observed a bug in the response: The respone also includes request
headers/body in it, needs to be addressed.
5 years ago
cc88f82958
docs: clarify context switch documentation
5 years ago
3aba285862
refactor: namespace to arch_context_variant
5 years ago
8b199f702e
chore: remove extra consistency check
5 years ago
61fd015254
docs: add commet to mcontext restore
5 years ago
fdba1b1de8
feat: error check context variants
5 years ago
8c3ccc8f14
docs: fix zombie comment
5 years ago
859e87f425
refactor: remove extraneous zeroing out
5 years ago
3f4567ea6e
docs: remove restore comment about IP of 0
5 years ago
24beddd369
docs: preemption does not use fastpasth restore
5 years ago
5dc987c301
chore: remove extra memset
5 years ago
42566b1c6e
chore: comment context variants and use running
5 years ago
9dc6d8dd8a
refactor: arch_context_unused error handling
5 years ago
9a963f1d0c
refactor: rename confusing function name
5 years ago
f51fd1ef80
docs: remove redundant comment
5 years ago
7919dff0ba
refactor: decapitalize enums
5 years ago
64dc49a0fc
docs: Justify additional common.h file
5 years ago
68c767254a
docs: fix case in comment
5 years ago
31c3a9329a
refactor: rename QUICK to FAST
5 years ago
47672b4c93
fix: correct bugs
5 years ago
b979809c12
chore: fix debuglog usage
5 years ago
2db5f84f11
chore: Initial buggy port
5 years ago
236e39b263
refactor: DRY arch_context code
5 years ago
080c3d6656
chore: simplify RCs
5 years ago
2ceede804a
chore: revert sandbox alloc API
5 years ago
a9423b104c
chore: wrap multiline if
5 years ago
1ae6acbbee
fix: correct bug and harden error handling
5 years ago
1c65516164
chore: log invalid module errors
5 years ago
180df1a7d5
feat: initial implementation with interrupt bugs
5 years ago
5c87885722
chore: rename request_arrival_timestamp
5 years ago
2b161f2f86
refactor: move mcontext_restore to arch_context
5 years ago
d1f80d8b1e
chore: port simple doc and error handlign
5 years ago
a2319f2a68
chore: refactor out arch_context_t
5 years ago
2f164c3430
chore: refactor our sandbox_request_t
5 years ago
1487614863
chore: refactor out u8
5 years ago
7f9ffe236e
chore: refactor out u8
5 years ago
59c44f90e6
chore: refactor out i16
5 years ago
6b1880077a
chore: refactor out u16
5 years ago
213c558a75
chore: refactor out i32
5 years ago
ec3b489b21
chore: refactor out i64
5 years ago
4cb7c355b4
chore: refactor out u32
5 years ago
407a20d22a
chore: refactor out u64
5 years ago
eca987ccb4
fix: correct valgrind errors
5 years ago
f93da9e766
fix: add format printf to panic
5 years ago
df043c5a4a
chore: assert preemp disabled on mcontext restore
5 years ago
bb4e5467e8
docs: change TODO to FIXME in libuv cb
5 years ago
a19955f023
fix: Make userspace registers explicit integers
5 years ago
948947dec8
chore: merge changes from other branch
5 years ago
02d60a740d
chore: add trailing newlines
5 years ago
324253095d
refactor: clarify interval duration is not macro
5 years ago
47f24b6952
fix: namespace sandbox states
5 years ago
0d1d73018a
docs: remove redundant comments in types.h
5 years ago
50c46ae8e9
docs: better comment wasm init funcs
5 years ago
58a38016b1
chore: sandbox member cache->sandbox context cache
5 years ago
fbea46b84f
chore: add newline to panic function
5 years ago
613ed72ee5
chore: flatten x64 mcontext restore else
5 years ago
9eb5541afa
feat: propagate dequeue and remove return codes
5 years ago
d36b28bf21
chore: local_runqueue add cleanup
5 years ago
5ccf8bbd87
chore: organize preprocessor includes
5 years ago
dfb1c65e93
fix: push PQ error handling to caller
5 years ago
7384b2de1e
fix: harden panic logic
5 years ago
68e91a8853
chore: combine thread locals into struct
5 years ago
1c2aa448cd
chore: rename scheduler interfaces and variants
5 years ago
0eb474a8d7
chore: replace app header guards w pragma once
5 years ago
f7e472a8d9
chore: rename get_priority to get_priority_fn
5 years ago
46881a0f26
chore: suffix fn typedefs with _fn_t
5 years ago
ab41672359
docs: remove extraneous comment
5 years ago
08fecb21d1
docs: fixing additional multiline comment
5 years ago
3dd4a6857d
docs: fix multi-line comment
5 years ago
29201f737d
docs: Use style guide format for comments
5 years ago
cf42133127
chore: add explicit curly braces
5 years ago
94f69a912c
docs: better inline comment
5 years ago
b8a0e28d11
chore: cleanup sandbox logic
5 years ago
c0d82db22b
fix: Correct memory leak and general cleanup
5 years ago
fa5f254af1
chore: remove extraneous log
5 years ago
06dbd3cd21
chore: remove redudant typedef
5 years ago
218893ed3b
feat: Non-crashing demo state
5 years ago
3caecadefe
feat: Implement peek in ps
5 years ago
eef45c5983
chore: correct endif comment
5 years ago
996c147928
fix: correct runqueue cleanup bug
5 years ago
83ee42e89b
chore: break up runtime and worker_thread
5 years ago
4d29585236
chore: demonstrate priority
5 years ago
61c7ccea0c
feat: implement PQ-based runqueue
5 years ago
f5f9c168c6
chore: Simplify worker scheduling
5 years ago
307f7c0d59
chore: encapsulte http_parser_settings
5 years ago
321e26577d
chore: replace in_interrupt with bool
5 years ago
d42370c357
chore: simplify sandbox_allocate
5 years ago
c2c6332bc1
chore: encapsulate completion queue
5 years ago
dafa257273
chore: encapsulate current_sandbox
5 years ago
403b167a7e
chore: refactor out sandbox_run_queue
5 years ago
6a7bbc2e97
feat: add deadline logic
5 years ago
6478ff9b84
feat: WIP ps
5 years ago
4386b00479
chore: fix zombie comment
5 years ago
6eb5825b55
refactor: implement sandbox request interface
5 years ago
34d91cfa21
refactor: wrap existing request queue
5 years ago
d14af73c30
chore: remove unused types
5 years ago
0ace3119e6
chore: revert to __getcycles
5 years ago
a949cbebe3
chore: refactor double underscores
5 years ago
7ff05b9d73
making it work for aarch64 - seem to work on RPi
...
* changes to be fully tested!
* cas etc needs to be implemented for aarch64
5 years ago
178bef818f
feat: add relative_deadline_us to json and module
5 years ago
0bd22a2e9c
chore: de-dunder module_database
5 years ago
a70a83326c
chore: de-dunder worker_thread
5 years ago
a771b78a92
chore: de-dunder software_interrupt
5 years ago
fefd80d6a9
chore: de-dunder sandbox
5 years ago
ba032a5905
chore: de-dunder runtime
5 years ago
4d660e666b
chore: de-dunder listener thrd, module, libuv cbs
5 years ago
3e90b26243
chore: de-dunder http_response
5 years ago
06de754885
chore: de-dunder current_sandbox
5 years ago
4615c4736d
chore: de-dunder http_parser_settings
5 years ago
d64ca75c4e
chore: de-dunder current_sandbox
5 years ago
0271f4a48d
chore: fix consistent delimiter in module_database
5 years ago
5694366c96
chore: align consecutive macros
5 years ago
9dfc740d05
chore: namespace macros and globals in main.c
5 years ago
3cbb7f0748
chore: rename nested namespaces pending refactor
5 years ago
25bdc18118
chore: rename sigint to signal_interrupt in files
5 years ago
7ba5a3acbe
chore: rename softint to software_interrupt
5 years ago
21d9cd11fe
chore: flatten http directory
5 years ago
9000cc1065
chore: address assorted issues in sandbox_request
5 years ago
017174ffa4
chore: remove unused declare and comment untested code
5 years ago
fb7298d1d1
chore: rename sandbox argument
5 years ago
0a7cd2fdc7
docs: improve comments for sandbox->list
5 years ago
46a2fcfbc4
chore: rename handles to be more descriptive
5 years ago
d5366f11de
chore: fix comment to match renamed struct field
5 years ago
dd89fa511c
chore: remove zombie sandbox scheduling state
5 years ago
439bd523b8
chore: namespace runtime.h functions
5 years ago
ae0ff23fc2
docs: add missing params in func block
5 years ago
346c391ece
feat: Improve wasm string null-termintor checks
5 years ago
c9b9a6553e
chore: run clang-format
5 years ago
055d76e0ae
fix: correct rdtsc edits
5 years ago
bff1245572
chore: order arch files
5 years ago
07d2c8daaf
chore: sandbox.h cleanup
5 years ago
2d9a3925cd
chore: namespace runtime.c
5 years ago
70d87fcb51
chore: partial namespace of runtime
5 years ago
ef0056a511
chore: fix provide module_database includes
5 years ago
7f858d69dd
chore: namespace runtime state
5 years ago
81b5d3b00d
chore: namespace sandbox
5 years ago
3d96b0ed95
chore: namespace and comment softint stuff
5 years ago
d6c31f6728
chore: namespace rdtsc
5 years ago
08eb26e984
chore: move module json parsing to module
5 years ago
a29f36ca13
chore: decompose current_sandbox.h
5 years ago
1800d0ab31
chore: move parser_settings to http directory
5 years ago
5e937fc204
chore: decompose http
5 years ago
f471011776
chore: cleanup http
5 years ago
b0ae9ba266
chore: cleanup sandbox_request
5 years ago
75a34360b8
chore: Assorted cleanup
5 years ago
b896f6f1b1
chore: move rdtsc to util
5 years ago
dc9677e41f
chore: partial sandbox cleanup
5 years ago
cbd64d1f91
chore: refactor out libuv cbs
5 years ago
4178e4f9bc
chore: partial sandbox cleanup
5 years ago
b67860112f
chore: cleanup util
5 years ago
7da1f4a284
chore: cleanup softint
5 years ago
d979a74986
chore: better organize module
5 years ago
28ab7d43c4
chore: refactor module_database into distinct file
5 years ago
71a6ee1633
chore: cleanup http namespace
5 years ago
e28947a391
refactor: namespace module functions
5 years ago
dfe5667bef
chore: resolve TODOs from Phani
5 years ago
1d724f04e8
refactor: Shift sandbox_request to new file
5 years ago
ea888ddbb3
chore: assorted refactors
5 years ago
9762477902
chore: assorted refactors
5 years ago
c1c307c390
chore: cleanup runtime
5 years ago
267a04350f
chore: complete modules cleanup
5 years ago
1f988bd113
chore: complete HTTP cleanup
5 years ago
4a80e6dd70
chore: assorted refactors
5 years ago
2220cf34a0
chore: rerun formatter
5 years ago
c4142c00f1
chore: more cleanup
5 years ago
0c85cd4102
chore: Assorted cleanup
5 years ago
862143f37a
chore: clean up interrupt logic
5 years ago
3d6266750e
chore: assorted refactors
5 years ago
69086d012d
Various refactors and end-to-end tracking of cycles
5 years ago
d058f99e0f
feat: Assign start_time to sandbox
5 years ago
b0434ac941
build: remove STANDALONE, SBOX_SCALE_ALLOC, USE_LIBUV flags
5 years ago
ae93435e2a
refactor: Assorted refactors and add start_time to request
5 years ago
6946b08644
refactor: modularize and rename things
5 years ago
b5e9abced5
chore: Assorted cleanup
5 years ago
9185852236
docs: Add documentation to code ( #7 )
5 years ago
e61be257f9
chore: add clang-format from Composite ( #5 )
...
* chore: add clang-format from Composite
* chore: cleanup JSON
* chore: add clang-format from Composite
* chore: stylistic corrections
* chore: ignore swap files and vscode conf
* chore: check semver of clang-format and require 9
5 years ago
0c92419978
fixed syscall based sync http-req/resp
5 years ago
9528f65b32
Synchronous I/O for http request/response fixes 99%tile latencies
...
* Async I/O is being used for reading and writing http request and
response respectively. This causes the worker core to steal new tasks as
when one sandbox blocks on "read" or "write". This causes true
round-robin on timer interrupts, leading to those high latencies.
* Ideally, the request/response should be synchronous I belive because
we are expected to have "low"/near-realtime latencies and the read/writes
are only performed when a client connects, so ideally not block!
Plus, we expect only small data transfers (in KBs) so that should also
support synchronous request/response processing.
5 years ago
645d138787
for runtime with multi-sandboxing, globals are to be populated per sandbox, that was what causing random crashes!
5 years ago
69b1f94fe8
scalable sandbox creation in each runtime core
5 years ago
576bc4b086
sandbox alloc on each core, for scalability
5 years ago
affe5fbc35
read() chunks fix, other standalone compilation fixes
5 years ago
611ec2257a
keep empty and add work program
5 years ago
ae392fdfe3
read from stdin (http req body), write to stdout (http resp body), bug fixes in http parsing
5 years ago
f019193952
read() to read from request body!
5 years ago
aa0017f4b0
http request response using uv
5 years ago
8a3e050282
Support TCP (TODO: http parsing based on module specification)
...
* Major:
- Moved sandbox data struct into linear memory of a sandbox.
- (Should work well with other sandboxing mechanisms).
- Removed all mallocs from within uv usage, using a pre-allocated
memory within sandbox data-struct for read/write.
- TODO: convert prints on stdout to a string and send it out with
function response body.
- TODO: for each function loaded, what is the request and response
http header/body specification.
To start, keep headers minimal.
body either: json, plain.
- TODO: track TIMEOUTS. If we go beyond that, return a HTTP 408?
5 years ago
9376453058
uvio for sandbox response.
5 years ago
95bf6fc1a9
udp response (return value of main) and multi-threaded udp client
5 years ago
eb8fcf00c4
Work-stealing deque for global request queue
...
* all cores steal from that queue.
* other bug fixes
* tested with NCORES = 2 and 4.
5 years ago
9b0ec6f7dc
Changed directory structure
...
* silverfish is a submodule now
* memory modules from silverfish runtime is copied in to the aWsm runtime.
* runtime/tests/Makefile compiles different tests and silverfish/code_benches..
6 years ago
Sean McBride
phani