JCH - Jump Consistent Hash Library for Javascript in Deno.

A Fast, Minimal Memory, Consistent Hash Algorithm.

We present jump consistent hash, a fast, minimal memory, consistent hash algorithm that can be expressed in about 5 lines of code. In comparison to the algorithm of Karger et al., jump consistent hash requires no storage, is faster, and does a better job of evenly dividing the key space among the buckets and of evenly dividing the workload when the number of buckets changes. Its main limitation is that the buckets must be numbered sequentially, which makes it more suitable for data storage applications than for distributed web caching.

Paper: https://arxiv.org/abs/1406.2294

Usage

const a = ch(286293355577, 500000) // support TS type Number. Since all JS numbers are 64 bits floating number.
const b = ch("127.0.0.1", 1073741824) // currently not support type String yet. Maybe can port outputs to crc32 or bkdr in the future.

or check example code located at ./ex/01.ts.

The algorithm works by using a hash of the key as the seed for a random number generator. It then uses the random numbers to “jump forward” in the list of buckets until it falls off the end. The last bucket it lands in is the result. The paper has a more complete explanation of how it works and a derivation of this optimized loop.

While evenly divide keys into buckets uniformly, we can change total bucket amount(add/remove buckets) but still remain the old key values as possible.

You may see results like this:

┌────────────┬─────┬────────┐
│ (iter idx) │ Key │ Values │
├────────────┼─────┼────────┤
│          0 │   1 │   7208 │
│          1 │   2 │   7198 │
│          2 │   9 │   7158 │
│          3 │   8 │   7352 │
│          4 │   0 │   7156 │
│          5 │   7 │   7257 │
│          6 │   5 │   7217 │
│          7 │   3 │   7103 │
│          8 │   6 │   7199 │
│          9 │   4 │   7152 │
└────────────┴─────┴────────┘
buckets after add two nodes:
┌────────────┬─────┬────────┐
│ (iter idx) │ Key │ Values │
├────────────┼─────┼────────┤
│          0 │   1 │   6045 │
│          1 │   2 │   5946 │
│          2 │   9 │   5997 │
│          3 │   8 │   6137 │
│          4 │   0 │   5918 │
│          5 │   7 │   6055 │
│          6 │   5 │   6124 │
│          7 │   3 │   5875 │
│          8 │   6 │   5968 │
│          9 │   4 │   5893 │
│         10 │  10 │   6057 │
│         11 │  11 │   6139 │
└────────────┴─────┴────────┘

Jump Hash addresses the two disadvantages of ring hashes: it has no memory overhead and virtually perfect key distribution. (The standard deviation of buckets is 0.000000764%, giving a 99% confidence interval of 0.99999998 to1.00000002).

Jump Hash is also fast. The loop executes O(ln n) times, faster by a constant amount than the O(log n) binary search for Ring Hash, and made faster even still by the fact that the computation is done entirely in a few registers and doesn’t pay the overhead of cache misses.