From: Joey Hess Date: Tue, 15 Sep 2020 00:00:54 +0000 (-0400) Subject: few more details X-Git-Tag: archive/raspbian/10.20250416-2+rpi1~1^2~112^2~114 X-Git-Url: https://dgit.raspbian.org/?a=commitdiff_plain;h=a5d5935c0e7c7a35e11052f79e2dd18aa2289db9;p=git-annex.git few more details --- diff --git a/doc/bugs/concurrent_git-annex-copy_to_s3_special_remote_fails/comment_5_8ea6aacd9aa428725425d0a4cf5d4c89._comment b/doc/bugs/concurrent_git-annex-copy_to_s3_special_remote_fails/comment_5_8ea6aacd9aa428725425d0a4cf5d4c89._comment index b9571afb91..fd73972cbc 100644 --- a/doc/bugs/concurrent_git-annex-copy_to_s3_special_remote_fails/comment_5_8ea6aacd9aa428725425d0a4cf5d4c89._comment +++ b/doc/bugs/concurrent_git-annex-copy_to_s3_special_remote_fails/comment_5_8ea6aacd9aa428725425d0a4cf5d4c89._comment @@ -3,7 +3,7 @@ subject="""comment 5""" date="2020-09-14T23:43:03Z" content=""" -git-annex copy --to S3 -J40 hangs reproductibly for phibs (on irc). +git-annex copy -A --to S3 -J40 hangs reproductibly for phibs (on irc). When it hangs, at least one job is stuck at 100%, and often several, though some other jobs are hung at smaller percent. @@ -11,14 +11,16 @@ though some other jobs are hung at smaller percent. Without -J, it did not seem to hang. It also may have not been hung with -J2 (was interrupted before finishing). -One attempt (with --json) had two other interesting messages: +One attempt (with --json) had this message: magicFile: got error code but no error message +Two attempts had this: + Missing root element -The latter just before the hang, one file transferred successfully after -that and then it hung. That message coes from Text.XML apparently, +One time just before the hang, the other time 20+ files before the hang. +That message coes from Text.XML apparently, which I think points to this being the same bug. phibs tried a similar copy to a directory special remote, did not hang. @@ -28,4 +30,7 @@ I think that pretty much rules out any problem in git-annex's code, the problem is probably in the aws library or the http stack. The S3 remote has chunking (10 mb) and no encryption, and is on AWS. + +Some file sizes of files that hung at 100%: 64083380, 7668, 72792, 6952, +9584456, 21050948. """]]