From a5d5935c0e7c7a35e11052f79e2dd18aa2289db9 Mon Sep 17 00:00:00 2001 From: Joey Hess Date: Mon, 14 Sep 2020 20:00:54 -0400 Subject: [PATCH] few more details --- ...ment_5_8ea6aacd9aa428725425d0a4cf5d4c89._comment | 13 +++++++++---- 1 file changed, 9 insertions(+), 4 deletions(-) diff --git a/doc/bugs/concurrent_git-annex-copy_to_s3_special_remote_fails/comment_5_8ea6aacd9aa428725425d0a4cf5d4c89._comment b/doc/bugs/concurrent_git-annex-copy_to_s3_special_remote_fails/comment_5_8ea6aacd9aa428725425d0a4cf5d4c89._comment index b9571afb91..fd73972cbc 100644 --- a/doc/bugs/concurrent_git-annex-copy_to_s3_special_remote_fails/comment_5_8ea6aacd9aa428725425d0a4cf5d4c89._comment +++ b/doc/bugs/concurrent_git-annex-copy_to_s3_special_remote_fails/comment_5_8ea6aacd9aa428725425d0a4cf5d4c89._comment @@ -3,7 +3,7 @@ subject="""comment 5""" date="2020-09-14T23:43:03Z" content=""" -git-annex copy --to S3 -J40 hangs reproductibly for phibs (on irc). +git-annex copy -A --to S3 -J40 hangs reproductibly for phibs (on irc). When it hangs, at least one job is stuck at 100%, and often several, though some other jobs are hung at smaller percent. @@ -11,14 +11,16 @@ though some other jobs are hung at smaller percent. Without -J, it did not seem to hang. It also may have not been hung with -J2 (was interrupted before finishing). -One attempt (with --json) had two other interesting messages: +One attempt (with --json) had this message: magicFile: got error code but no error message +Two attempts had this: + Missing root element -The latter just before the hang, one file transferred successfully after -that and then it hung. That message coes from Text.XML apparently, +One time just before the hang, the other time 20+ files before the hang. +That message coes from Text.XML apparently, which I think points to this being the same bug. phibs tried a similar copy to a directory special remote, did not hang. @@ -28,4 +30,7 @@ I think that pretty much rules out any problem in git-annex's code, the problem is probably in the aws library or the http stack. The S3 remote has chunking (10 mb) and no encryption, and is on AWS. + +Some file sizes of files that hung at 100%: 64083380, 7668, 72792, 6952, +9584456, 21050948. """]] -- 2.30.2