878b8e6321
ck_ring: Correct CK_RING_SPMC_ENQUEUE_SIZE typo.
12 years ago
67381af3c5
ck_ring: Expose *_size variants to type-specialized ck_ring.
...
Added:
- CK_RING_ENQUEUE_SPSC_SIZE
- CK_RING_ENQUEUE_SPMC_SIZE
12 years ago
45f648bd33
ck_ring: Add *_size_* ck_ring enqueue operations.
...
These variants of ck_ring_enqueue_* return the snapshot of queue
length with respect to the linearization point. This can be used to
extract ring size without incurring additional cacheline invalidation
overhead from the writer.
12 years ago
86884ed574
ck_fifo_mpmc: Fix NULL deference when re-using nodes.
...
If a FIFO entry is being re-used, it is possible for NULL
assignment to be triggered due to race with enqueue.
12 years ago
c4e50a193a
ck_fifo: Style fixes.
12 years ago
4b9badd440
ck_cohort: Remove unnecessary whitespace.
12 years ago
62c121f500
ck_cohort: Added example code to man page
12 years ago
c393a97cb7
ck_pflock: Fix Copyright typo from original patch.
12 years ago
f6a53fd9de
ck_cohort: First-cut implementation of generalized cohort interface.
...
This work was contributed by Brendon Scheinman. This work is based
off "Lock Cohorting: A General Technique for Designing NUMA Locks".
12 years ago
060b922dc2
ck_pflock: Whitespace change.
...
Move acquire semantics comment block on read_unlock beneath
exit label.
12 years ago
aec2797d27
ck_pflock: Load acquire semantics are sufficient for read_unlock.
...
Also, make sure to implement acquire semantics if there are no
contending writers.
12 years ago
54845bb8e7
ck_pflock: Phase-fair read-write lock implementation.
...
John Wittrock has contributed a phase-fair reader-writer
lock implementation. These locks allow phase fairness
guarantees between readers and writers. This work includes
additional changes and clean-up.
Follow-up work is expected.
Thanks to John Wittrock for patches and Professor Gabriel
Parmer (http://www.seas.gwu.edu/~gparmer/ ) for advising.
12 years ago
7d3fd9d227
ck_fifo: Get rid of load_depends usage for now.
...
Until a target pops up with a requirement for load_depends(),
the cost is not worth it for now.
12 years ago
b7d258b219
ck_pr/gcc: ck_pr_fence_load_depends should be heavy-weight on catch-all target.
12 years ago
d09e48daed
ck_spinlock: Only enable trylock path for TSO architectures at the moment.
12 years ago
27d454248d
ck_spinlock: Add ticket lock with trylock operation.
...
Upon popular request, added a variant of the ticket spinlock
with trylock support. This is pending additional verification
on other architectures besides x86*. It is still unclear whether
this implementation will be the default as it is has slower
fast path.
Add trylock support to the ck_spinlock validation tests.
It currently only tests ck_spinlock_ticket_t trylock
functionality if available.
12 years ago
086ebf7126
ck_pr: moving PPC32 to RMO.
...
Signed-off-by: Joao Fernandes <mail@joaofernandes.eu>
12 years ago
8c53de1e70
ck_rwlock: Add documentation on visibility semantics.
12 years ago
1ea5769fd4
ck_rwlock: Improve code legibility.
12 years ago
334b15e6e0
ck_bytelock: Acquire semantics on read.
12 years ago
038b3d816d
ck_rwlock: Forgot to add acquire on operation success.
12 years ago
0598307186
whitespace: Various style changes.
12 years ago
25658c4f5f
ck_queue: Fix CK_LIST_INSERT_HEAD.
...
CK_LIST_INSERT_HEAD was incorrectly managing prev
pointer on insertion to non-empty list. This bug
would cause erroneous behavior on CK_LIST_REMOVE
to non-head elements. Unit test will be updated
for this regression.
12 years ago
33a9222923
legal: Update Copyright statements.
12 years ago
d29ac5afdb
ck_bytelock: Fix downgrade path from writer to reader.
...
An off-by-one was introduced in downgrade path from writer.
This can cause deadlock if a writer downgrades from a write lock.
Pointed out by Jeffrey Birnbaum <jmb...@...>.
12 years ago
c4149c72b4
ck_ring: Use regular assignment in type specialized ck_ring initialization.
12 years ago
89cb712ffa
ck_ring: Memoize mask across all operations.
12 years ago
8519aaf771
ck_ring: Memoize mask for SPMC operations.
12 years ago
b54ae5c4ac
ck_ring: Add a work-around for compiler bug(s) in ck_ring_dequeue_spmc.
...
Both LLVM-backed compilers and GCC incorrectly treat
a barrier-sandwiched load as a loop invariant in dequeue_spmc.
Forcing volatile atomic load semantics generates the right
thing.
Thanks to Devon O'Dell and Abel Mathew for help in catching
this issue.
12 years ago
0631e396e0
ck_backoff: Replace ck_backoff_eb with ck_backoff_gb.
...
The distinction between additive/exponential implementation
and geometric implementation does little but confuse users.
The terminology used in ck_backoff now reflects terminology
used in literature.
ck_backoff_gb has been removed.
12 years ago
b37ce19976
ck_pr/x86_64: GCC will attempt immediate expansion on double.
...
Break out double functionality to not use immediate expansion
at all.
Pointed out by Abel Mathew <amathew@appnexus...>.
12 years ago
0c56b1b8c6
ck_epoch: Remember to mark entry availability on unregister.
...
Pointed out by Matt Johnson (johnso87@crhc....>.
12 years ago
93684f77c1
ck_pr: Use CK_CC_INLINE instead of inline keyword for ck_pr_barrier.
12 years ago
de0597d2aa
ck_bitmap: Add comment for ck_bitmap_size.
12 years ago
849f938973
ck_ring: Add parameterized version of ck_ring_trydequeue.
12 years ago
7a99585f9e
ck_ring: No need for volatile load on dequeue_spmc.
12 years ago
01dc51db65
ck_ring: Add trydequeue variant.
12 years ago
ca8be0858c
ck_pr: Re-include port selection logic.
12 years ago
1c7b8811c8
ck_pr/gcc: Remove useless assignment from volatile load.
12 years ago
a9ed19303f
ck_pr/gcc: Adopt const semantics for load/store in GCC port.
12 years ago
6de54d6aa5
ck_pr/x86_64: Use correct target for load_64_2.
12 years ago
12da4128ff
ck_pr: Adopt const qualifer for load/store.
...
We will adopt these semantics for the rest of _ptr
family at some point in the future as well.
12 years ago
055a7fd5db
ck_ring: Add wrapper functions for parameterized SPMC ring.
12 years ago
68b33e56d8
ck_ring: Add parameterized version of SPMC ring.
12 years ago
7f35cbee1b
ck_ring: Use SPSC enqueue as SPMC enqueue.
12 years ago
5d1d850f44
ck_ring: Adopt semantics identical to spmc counter semantics.
12 years ago
77a3bd3126
ck_ring: Move overflow check to producer side.
...
unsigned int-sized counters will be used on producer
and consumer side. This is necessary to allow a ring
to be used on multiple workloads.
12 years ago
d595bafea7
ck_ring: Serialize producer snapshot with respect to consumer.
12 years ago
d705e02b76
ck_ring: Replace MPMC variant with SPMC variant for starters.
...
Immediate use-case is SPMC. Next is MPSC, then I will generalize
to MPMC (unfortunately, I don't have an algorithm that avoids CAS2
yet for MPMC).
12 years ago
bb48f602ff
ck_ring: Add note regarding correctness so people don't both verifying it.
...
Original version is susceptible to several problems, it is whack.
12 years ago
Samy Al Bahra
Samy Al Bahra
Brendon Scheinman
Joao Fernandes
Abel Mathew