[Nix-dev] Deduplication

[Vladimír Čunát]

On 04/14/2014 09:51 AM, Mathijs Kwik wrote:
> But it's still whole-file based. btrfs is internally able to support
> block-level deduplication, which is very cool for making copies of
> things like database copies and virtualization images. Of course these
> cases are already served by snapshot volumes, but still it would be nice
> to see the full power exposed someday:)

It should be relatively easy, because in most our updates the changes to 
files are small and block-aligned (when name lengths don't change; 
mostly just path references change on re-builds), moreover in most cases 
one can easily guess which file pairs can have duplicate parts (even 
without any advanced schemes like rolling hashes).


Vlada



-------------- next part --------------
A non-text attachment was scrubbed...
Name: smime.p7s
Type: application/pkcs7-signature
Size: 3251 bytes
Desc: S/MIME Cryptographic Signature
Url : http://lists.science.uu.nl/pipermail/nix-dev/attachments/20140414/e62e96ad/attachment-0001.bin