confirmed, and open todo for something mentioned in this bug
authorJoey Hess <joeyh@joeyh.name>
Fri, 20 Mar 2020 16:00:07 +0000 (12:00 -0400)
committerJoey Hess <joeyh@joeyh.name>
Fri, 20 Mar 2020 16:00:07 +0000 (12:00 -0400)
doc/bugs/webdav_export_slow__44___does_not_reuse_connections.mdwn
doc/bugs/webdav_export_slow__44___does_not_reuse_connections/comment_1_878309c705dd9ff06c89b9559b54bd40._comment [new file with mode: 0644]
doc/todo/support_concurrency_for_export.mdwn [new file with mode: 0644]

index 2212bcaaea596a521c0dc1583c170531d018e511..fd2f152f72d98c02b284a371f6e3f93b206a8359 100644 (file)
@@ -9,3 +9,5 @@ Could http connections be reused?
 Could multiple files be uploaded in parallel?
 
 Apparently files are also upload to a temporary location and renamed after successful upload. This adds additional latency and thus parallel uploads could provide a speed up?
+
+[[!tag confirmed]]
diff --git a/doc/bugs/webdav_export_slow__44___does_not_reuse_connections/comment_1_878309c705dd9ff06c89b9559b54bd40._comment b/doc/bugs/webdav_export_slow__44___does_not_reuse_connections/comment_1_878309c705dd9ff06c89b9559b54bd40._comment
new file mode 100644 (file)
index 0000000..14cbeb9
--- /dev/null
@@ -0,0 +1,20 @@
+[[!comment format=mdwn
+ username="joey"
+ subject="""comment 1"""
+ date="2020-03-20T15:48:35Z"
+ content="""
+Indeed, regular webdav special remote uses prepareDav
+which sets up a single DAV context that is used for all stores,
+but export does not and so creates a new context each time.
+
+S3 gets around this using an MVar that contains the S3 handle.
+Webdav should be able to do the same.
+
+(The upload to a temp location is necessary, otherwise resuming an
+interrupted upload would not be able to check which files had been fully
+uploaded yet in some situations. Or something like that. I forget the exact
+circumstances, but it's documented in a comment where storeExport is defined
+in Types.Remote.)
+
+(Opened [[todo/support_concurrency_for_export]].)
+"""]]
diff --git a/doc/todo/support_concurrency_for_export.mdwn b/doc/todo/support_concurrency_for_export.mdwn
new file mode 100644 (file)
index 0000000..daac154
--- /dev/null
@@ -0,0 +1,2 @@
+Making git-annex export support -J should be doable and could speed up
+exports a lot with some remotes. --[[Joey]]