086ebf7126
ck_pr: moving PPC32 to RMO.
...
Signed-off-by: Joao Fernandes <mail@joaofernandes.eu>
12 years ago
8c53de1e70
ck_rwlock: Add documentation on visibility semantics.
12 years ago
1ea5769fd4
ck_rwlock: Improve code legibility.
12 years ago
334b15e6e0
ck_bytelock: Acquire semantics on read.
12 years ago
038b3d816d
ck_rwlock: Forgot to add acquire on operation success.
12 years ago
0598307186
whitespace: Various style changes.
12 years ago
25658c4f5f
ck_queue: Fix CK_LIST_INSERT_HEAD.
...
CK_LIST_INSERT_HEAD was incorrectly managing prev
pointer on insertion to non-empty list. This bug
would cause erroneous behavior on CK_LIST_REMOVE
to non-head elements. Unit test will be updated
for this regression.
12 years ago
33a9222923
legal: Update Copyright statements.
12 years ago
d29ac5afdb
ck_bytelock: Fix downgrade path from writer to reader.
...
An off-by-one was introduced in downgrade path from writer.
This can cause deadlock if a writer downgrades from a write lock.
Pointed out by Jeffrey Birnbaum <jmb...@...>.
12 years ago
c4149c72b4
ck_ring: Use regular assignment in type specialized ck_ring initialization.
12 years ago
89cb712ffa
ck_ring: Memoize mask across all operations.
12 years ago
8519aaf771
ck_ring: Memoize mask for SPMC operations.
12 years ago
b54ae5c4ac
ck_ring: Add a work-around for compiler bug(s) in ck_ring_dequeue_spmc.
...
Both LLVM-backed compilers and GCC incorrectly treat
a barrier-sandwiched load as a loop invariant in dequeue_spmc.
Forcing volatile atomic load semantics generates the right
thing.
Thanks to Devon O'Dell and Abel Mathew for help in catching
this issue.
12 years ago
0631e396e0
ck_backoff: Replace ck_backoff_eb with ck_backoff_gb.
...
The distinction between additive/exponential implementation
and geometric implementation does little but confuse users.
The terminology used in ck_backoff now reflects terminology
used in literature.
ck_backoff_gb has been removed.
12 years ago
b37ce19976
ck_pr/x86_64: GCC will attempt immediate expansion on double.
...
Break out double functionality to not use immediate expansion
at all.
Pointed out by Abel Mathew <amathew@appnexus...>.
12 years ago
0c56b1b8c6
ck_epoch: Remember to mark entry availability on unregister.
...
Pointed out by Matt Johnson (johnso87@crhc....>.
12 years ago
93684f77c1
ck_pr: Use CK_CC_INLINE instead of inline keyword for ck_pr_barrier.
12 years ago
de0597d2aa
ck_bitmap: Add comment for ck_bitmap_size.
12 years ago
849f938973
ck_ring: Add parameterized version of ck_ring_trydequeue.
12 years ago
7a99585f9e
ck_ring: No need for volatile load on dequeue_spmc.
12 years ago
01dc51db65
ck_ring: Add trydequeue variant.
12 years ago
ca8be0858c
ck_pr: Re-include port selection logic.
12 years ago
1c7b8811c8
ck_pr/gcc: Remove useless assignment from volatile load.
12 years ago
a9ed19303f
ck_pr/gcc: Adopt const semantics for load/store in GCC port.
12 years ago
6de54d6aa5
ck_pr/x86_64: Use correct target for load_64_2.
12 years ago
12da4128ff
ck_pr: Adopt const qualifer for load/store.
...
We will adopt these semantics for the rest of _ptr
family at some point in the future as well.
12 years ago
055a7fd5db
ck_ring: Add wrapper functions for parameterized SPMC ring.
12 years ago
68b33e56d8
ck_ring: Add parameterized version of SPMC ring.
12 years ago
7f35cbee1b
ck_ring: Use SPSC enqueue as SPMC enqueue.
12 years ago
5d1d850f44
ck_ring: Adopt semantics identical to spmc counter semantics.
12 years ago
77a3bd3126
ck_ring: Move overflow check to producer side.
...
unsigned int-sized counters will be used on producer
and consumer side. This is necessary to allow a ring
to be used on multiple workloads.
12 years ago
d595bafea7
ck_ring: Serialize producer snapshot with respect to consumer.
12 years ago
d705e02b76
ck_ring: Replace MPMC variant with SPMC variant for starters.
...
Immediate use-case is SPMC. Next is MPSC, then I will generalize
to MPMC (unfortunately, I don't have an algorithm that avoids CAS2
yet for MPMC).
12 years ago
bb48f602ff
ck_ring: Add note regarding correctness so people don't both verifying it.
...
Original version is susceptible to several problems, it is whack.
12 years ago
68e6752e53
ck_ring: Due to popular request, add MPMC variants of enqueue/dequeue.
...
Fencing semantics are heavier-weight than they need to be.
12 years ago
957e4aec5d
ck_brlock: Fix typo.
12 years ago
b631e3aa23
ck_brlock: Enable FAS serialization only on x86.
...
Other architectures, even TSO ones, pay a heavier flush
cost.
12 years ago
2bdc231288
ck_brlock: Serialize on atomic operation on read acquisition.
...
10% improvement for reader acquisition latency on TSO architectures
implementing wait-free FAS.
12 years ago
cb1c72d36b
ck_queue: Add CK_?LIST_MOVE operation.
...
This operation is of format:
CK_S*LIST_MOVE(a, b, linkage) and is equivalent to intializing
a with the contents of b. This is done in a manner that is atomic
with respect to readers. Read-only operations are still valid in
b, but behavior is undefined for write-side operations on b after
a MOVE operation.
12 years ago
5df8882840
ck_bytelock: Switch to full semantics on unlock.
...
RW semantics may be used for shared write-side.
12 years ago
a06f28b77c
ck_ring: Remove useless comment.
12 years ago
f3111b006b
ck_fifo: SPSC FIFO dequeue only requires load depends barrier.
12 years ago
bf30d3439c
ck_rwlock: Remove unncessary load fences, switch to full semantics on read unlock.
...
rwlock may also be used in SPMC workloads.
12 years ago
65ebf86799
ck_spinlock: Switch to full semantics across all implementations.
...
More importantly, trylock previously didn't have full semantics.
12 years ago
e40521d1aa
ck_pr/ppc64: Switch to RMO model for atomic operations.
...
Signed-off-by: Samy Al Bahra <sbahra@repnop.org>
12 years ago
6be03bb450
ck_bytelock: Remove unnecessary load barrier on unslotted read acquisition.
...
Signed-off-by: Samy Al Bahra <sbahra@repnop.org>
12 years ago
52ca64b2b7
ck_pr/sparcv9: MemIssue is overly heavyweight.
...
Signed-off-by: Samy Al Bahra <sbahra@repnop.org>
12 years ago
3f217c9789
ck_pr: Fallback to RMO for PSO for this release.
...
Barriers can be rejiggered next release.
12 years ago
a1dc38f20e
build/ck_pr: Add configurable memory models.
12 years ago
fedc2f6e47
ck_pr/sparcv9: Assume TSO by default.
12 years ago
Joao Fernandes
Samy Al Bahra
Abel Mathew
Samy Al Bahra