From 6eacb3e1707fc43537db4905f1824530155d0b4a Mon Sep 17 00:00:00 2001 From: thk Date: Tue, 17 Mar 2020 20:45:59 +0000 Subject: [PATCH] --- ..._export_slow__44___does_not_reuse_connections.mdwn | 11 +++++++++++ 1 file changed, 11 insertions(+) create mode 100644 doc/bugs/webdav_export_slow__44___does_not_reuse_connections.mdwn diff --git a/doc/bugs/webdav_export_slow__44___does_not_reuse_connections.mdwn b/doc/bugs/webdav_export_slow__44___does_not_reuse_connections.mdwn new file mode 100644 index 0000000000..2212bcaaea --- /dev/null +++ b/doc/bugs/webdav_export_slow__44___does_not_reuse_connections.mdwn @@ -0,0 +1,11 @@ +### Please describe the problem. + +I am running an initial export to my NAS over WebDAV. The repo contains many small files and it already runs for a day. Even the smallest file takes around a second to upload. + +Looking at strace and the code, it seems that for each file, git annex not only establishes a complete new TCP connection, it even also reads the credentials from .git/annex/creds for each file. + +Are there ways to make WebDAV faster? +Could http connections be reused? +Could multiple files be uploaded in parallel? + +Apparently files are also upload to a temporary location and renamed after successful upload. This adds additional latency and thus parallel uploads could provide a speed up? -- 2.30.2