From 0736508b62ca6ece2aeabb22835cb928cf20d573 Mon Sep 17 00:00:00 2001 From: Joey Hess Date: Mon, 16 Mar 2020 12:28:08 -0400 Subject: [PATCH] comment --- ..._5f9e9600d65c1270b479cc8910d507d0._comment | 26 +++++++++++++++++++ 1 file changed, 26 insertions(+) create mode 100644 doc/bugs/get_-J8_on_OSX_leads_to_git-annex__58___git__58___createProcess__58___runInteractiveProcess__58___pipe__58___resource_exhausted___40__Too_many_open_files__41__/comment_1_5f9e9600d65c1270b479cc8910d507d0._comment diff --git a/doc/bugs/get_-J8_on_OSX_leads_to_git-annex__58___git__58___createProcess__58___runInteractiveProcess__58___pipe__58___resource_exhausted___40__Too_many_open_files__41__/comment_1_5f9e9600d65c1270b479cc8910d507d0._comment b/doc/bugs/get_-J8_on_OSX_leads_to_git-annex__58___git__58___createProcess__58___runInteractiveProcess__58___pipe__58___resource_exhausted___40__Too_many_open_files__41__/comment_1_5f9e9600d65c1270b479cc8910d507d0._comment new file mode 100644 index 0000000000..7bdde7d8e0 --- /dev/null +++ b/doc/bugs/get_-J8_on_OSX_leads_to_git-annex__58___git__58___createProcess__58___runInteractiveProcess__58___pipe__58___resource_exhausted___40__Too_many_open_files__41__/comment_1_5f9e9600d65c1270b479cc8910d507d0._comment @@ -0,0 +1,26 @@ +[[!comment format=mdwn + username="joey" + subject="""comment 1""" + date="2020-03-16T16:13:00Z" + content=""" +The obvious question to ask, which I can't really imagine making any +progress without an answer to: What files did git-annex have open? + +I did notice that of the two git-annex logs, one got 19 files before +failing, while the other got 27. It seems unlikely that, if git-annex, or +an external remote, or git, or whatever is somehow leaking file handles, +it would leak different numbers at different times. Which leads to the +second question: What else on the system has files open and how many? + +OSX has a global limit of 12k open files, and a per process limit of 10k. + +`git-annex get` on linux needs to open around 16 files per file it +downloads. So if git-annex were somehow leaking every single open FD, +it would successfully download over 600 files before hitting the +per-process limit. If every subprocess git-annex forks also leaked every +open FD, it would of course vary by remote, but with a regular git clone +on the local filesystem, the number of files opened per get is still only +62, so still over an order of magnitude less. + +Seems much more likely that the system is unhappy for some other reason. +"""]] -- 2.30.2