incremental checksum for local remotes
authorJoey Hess <joeyh@joeyh.name>
Wed, 10 Feb 2021 20:05:24 +0000 (16:05 -0400)
committerJoey Hess <joeyh@joeyh.name>
Wed, 10 Feb 2021 20:05:24 +0000 (16:05 -0400)
commitf44d4704c638e2fdb48dd0667809b16fac377b5b
tree812f32fad2a2e64c6fef09ac21d1193b7ceeb4fe
parent48f63c27986cdca5e1292b35d5db9268021193e3
incremental checksum for local remotes

This benchmarks only slightly faster than the old git-annex. Eg, for a 1
gb file, 14.56s vs 15.57s. (On a ram disk; there would certianly be
more of an effect if the file was written to disk and didn't stay in
cache.)

Commenting out the updateIncremental calls make the same run in 6.31s.
May be that overhead in the implementation, other than the actual
checksumming, is slowing it down. Eg, MVar access.

(I also tried using 10x larger chunks, which did not change the speed.)
CHANGELOG
Remote/Git.hs
doc/todo/OPT__58_____34__bundle__34___get_+_check___40__of_checksum__41___in_a_single_operation/comment_10_695d1269ab20c66630ddfa2d8cbabbef._comment [new file with mode: 0644]
doc/todo/OPT__58_____34__bundle__34___get_+_check___40__of_checksum__41___in_a_single_operation/comment_9_4f4f4a42adafe52207ed32a5d20e94be._comment