mirror of
https://github.com/Zygo/bees.git
synced 2025-08-02 22:03:29 +02:00
hash: reduce hash table extent size to 128KB
The 16MB hash table extent size did not serve any useful defragmentation or compression purpose, and for very small filesystems (under 100GB), 16MB is much larger than necessary. Signed-off-by: Zygo Blaxell <bees@furryterror.org>
This commit is contained in:
@@ -16,7 +16,7 @@ be stored on a different btrfs filesystem, ext4, or even CIFS.
|
||||
bees uses a persistent dedupe hash table with a fixed size configured
|
||||
by the user. Any size of hash table can be dedicated to dedupe. If a
|
||||
fast dedupe with low hit rate is desired, bees can use a hash table as
|
||||
small as 16MB.
|
||||
small as 128KB.
|
||||
|
||||
The bees hash table is loaded into RAM at startup and `mlock`ed so it
|
||||
will not be swapped out by the kernel (if swap is permitted, performance
|
||||
|
@@ -13,7 +13,7 @@ Create a directory for bees state files:
|
||||
mkdir -p "$BEESHOME"
|
||||
|
||||
Create an empty hash table ([your choice of size](config.md), but it
|
||||
must be a multiple of 16MB). This example creates a 1GB hash table:
|
||||
must be a multiple of 128KB). This example creates a 1GB hash table:
|
||||
|
||||
truncate -s 1g "$BEESHOME/beeshash.dat"
|
||||
chmod 700 "$BEESHOME/beeshash.dat"
|
||||
@@ -50,7 +50,7 @@ Configuration
|
||||
There are some runtime configurable options using environment variables:
|
||||
|
||||
* BEESHOME: Directory containing bees state files:
|
||||
* beeshash.dat | persistent hash table. Must be a multiple of 16MB, and must be created before bees starts.
|
||||
* beeshash.dat | persistent hash table. Must be a multiple of 128KB, and must be created before bees starts.
|
||||
* beescrawl.dat | state of SEARCH_V2 crawlers. ASCII text. bees will create this.
|
||||
* beesstats.txt | statistics and performance counters. ASCII text. bees will create this.
|
||||
* BEESSTATUS: File containing a snapshot of current bees state: performance
|
||||
|
Reference in New Issue
Block a user