Joey Hess [Mon, 24 Aug 2020 18:11:37 +0000 (14:11 -0400)]
stack.yaml: Updated to lts-16.10
Needs stack version 2.3 to build, which has only recently made it into
debian unstable.
This commit was sponsored by Jake Vosloo on Patreon.
kyle [Thu, 20 Aug 2020 20:34:26 +0000 (20:34 +0000)]
Added a comment
cardoso-neto [Thu, 20 Aug 2020 20:08:07 +0000 (20:08 +0000)]
Added a comment
cardoso-neto [Thu, 20 Aug 2020 18:36:47 +0000 (18:36 +0000)]
Added a comment: Rationale behind deleting and readding the symlinks on a move or rename
kyle [Wed, 19 Aug 2020 17:54:11 +0000 (17:54 +0000)]
Added a comment: thanks
Joey Hess [Wed, 19 Aug 2020 16:20:07 +0000 (12:20 -0400)]
fix hang if external program is not available
startExternal' throws an exception, which left the externalAsync TMVar
empty, so the next try to use it would hang.
Joey Hess [Tue, 18 Aug 2020 19:47:49 +0000 (15:47 -0400)]
Merge branch 'master' of ssh://git-annex.branchable.com
kyle [Tue, 18 Aug 2020 17:44:01 +0000 (17:44 +0000)]
Joey Hess [Sat, 15 Aug 2020 19:53:35 +0000 (15:53 -0400)]
avoid using MonadFail in ParseDuration
There's no instance for Either String, so that makes it not as useful as
it could be, so instead just return an Either String.
Joey Hess [Sat, 15 Aug 2020 18:33:18 +0000 (14:33 -0400)]
fix some warnings
Joey Hess [Fri, 14 Aug 2020 20:01:39 +0000 (16:01 -0400)]
Merge branch 'master' of ssh://git-annex.branchable.com
Joey Hess [Fri, 14 Aug 2020 20:00:49 +0000 (16:00 -0400)]
Merge branch 'asyncexternal'
Joey Hess [Fri, 14 Aug 2020 19:38:31 +0000 (15:38 -0400)]
Display warning when external special remote does not start up properly, or is not usable
I'm sure this used to work, but somewhere along the line something or
things (getCost and getAvailability I think, probably others)
started catching the exception and not displaying it. So, show warnings.
Joey Hess [Fri, 14 Aug 2020 19:24:34 +0000 (15:24 -0400)]
async extension done
cardoso-neto [Fri, 14 Aug 2020 18:55:18 +0000 (18:55 +0000)]
Added a comment: Having cutting edge packages with conda is not that straighforward.
Joey Hess [Fri, 14 Aug 2020 18:40:30 +0000 (14:40 -0400)]
switch to TMVars for thread safety when using the async extension
TVars were not updated atomically, which was ok when each thread got its
own External that was the only thing using these TVars. But, with the
async extension, several External instances can share the same var, so
it needs to be a TMVar to avoid read/write conflicts.
In particular, this makes PREPARE only be sent once.
Joey Hess [Fri, 14 Aug 2020 18:24:46 +0000 (14:24 -0400)]
one jobid per thread
And, relay ERROR on to all listening threads.
Ilya_Shlyakhter [Fri, 14 Aug 2020 02:59:12 +0000 (02:59 +0000)]
Added a comment
Joey Hess [Fri, 14 Aug 2020 00:18:06 +0000 (20:18 -0400)]
rethought the async protocol some more
Moving jobid generation to the git-annex side lets it be simplified a
lot.
Note that it will also be possible to generate one jobid per connection,
rather than a new job per request. That will make overflow not an issue,
and will avoid some work, and will simplify some of the code.
cardoso-neto [Fri, 14 Aug 2020 00:08:29 +0000 (00:08 +0000)]
Added a comment: Ugly message when installing git-annex through conda
Joey Hess [Thu, 13 Aug 2020 20:11:38 +0000 (16:11 -0400)]
async proto fully tested and working
Including with a concurrent capable remote program.
However, this is not quite ready to merge, there's a TODO in the code.
Joey Hess [Thu, 13 Aug 2020 19:49:43 +0000 (15:49 -0400)]
async proto basically working
Simplified the protocol by removing END-ASYNC.
There's a STM crash when a non-async protocol message is sent, which
needs to be fixed.
Joey Hess [Wed, 12 Aug 2020 20:27:40 +0000 (16:27 -0400)]
Merge branch 'master' of ssh://git-annex.branchable.com
Joey Hess [Wed, 12 Aug 2020 20:27:02 +0000 (16:27 -0400)]
branch
Joey Hess [Wed, 12 Aug 2020 20:25:53 +0000 (16:25 -0400)]
further work on external async relay
Joey Hess [Wed, 12 Aug 2020 19:54:30 +0000 (15:54 -0400)]
relayer receive loop is done
Receive loop looks right. Still need the send loop.
And, a complication is that some messages git-annex
sends need to be wrapped in REPLY_ASYNC, while others
do not. So will probably need to split externalSend
into two.
Joey Hess [Wed, 12 Aug 2020 19:17:53 +0000 (15:17 -0400)]
wip external remote async protocol extension
Joey Hess [Wed, 12 Aug 2020 19:12:09 +0000 (15:12 -0400)]
rethought this protocol again
Now that I've started implementation, I see it's really necessary that
every message the special remote sends use the protocol, otherwise
nasty edge cases abound.
Joey Hess [Wed, 12 Aug 2020 16:30:45 +0000 (12:30 -0400)]
generalized ExternalState to not be limited to a ExternalAddonProcess
Idea is for ASYNC extension, it will instead contain methods that communicate
with the thread that handles all communication with the external process.
Joey Hess [Wed, 12 Aug 2020 16:04:12 +0000 (12:04 -0400)]
types for async protocol extension
renamed AsyncMessage to ExceptionalMessage to make way for this new
extension.
Bug: addurl --file not working as expected with youtube-dl
raf@4b53f20230978a98fc814b6e5565d9a30567a4f8 [Wed, 12 Aug 2020 12:54:46 +0000 (12:54 +0000)]
removed
raf@4b53f20230978a98fc814b6e5565d9a30567a4f8 [Wed, 12 Aug 2020 12:47:19 +0000 (12:47 +0000)]
cardoso-neto [Tue, 11 Aug 2020 22:10:27 +0000 (22:10 +0000)]
Added a comment
Joey Hess [Tue, 11 Aug 2020 20:42:37 +0000 (16:42 -0400)]
Merge branch 'master' of ssh://git-annex.branchable.com
Joey Hess [Tue, 11 Aug 2020 20:42:09 +0000 (16:42 -0400)]
draft async extension
cardoso-neto [Tue, 11 Aug 2020 20:23:25 +0000 (20:23 +0000)]
Ilya_Shlyakhter [Tue, 11 Aug 2020 20:19:49 +0000 (20:19 +0000)]
Added a comment: strange conda install behavior
cardoso-neto [Tue, 11 Aug 2020 19:57:06 +0000 (19:57 +0000)]
Added a comment
Joey Hess [Tue, 11 Aug 2020 18:01:22 +0000 (14:01 -0400)]
close
Ilya_Shlyakhter [Tue, 11 Aug 2020 16:03:40 +0000 (16:03 +0000)]
added note on installing the standalone git-annex distribution with conda
Ilya_Shlyakhter [Tue, 11 Aug 2020 15:51:28 +0000 (15:51 +0000)]
Added a comment: checking the conda-forge recipe
cardoso-neto [Tue, 11 Aug 2020 13:23:00 +0000 (13:23 +0000)]
Added a comment: Great tip about conda.
Ilya_Shlyakhter [Tue, 11 Aug 2020 00:43:51 +0000 (00:43 +0000)]
Added a comment: please keep the hackage tarballs
Joey Hess [Mon, 10 Aug 2020 23:22:55 +0000 (19:22 -0400)]
add news item for git-annex 8.
20200810
Joey Hess [Mon, 10 Aug 2020 22:46:44 +0000 (18:46 -0400)]
comment
Joey Hess [Mon, 10 Aug 2020 22:42:00 +0000 (18:42 -0400)]
Merge branch 'master' of ssh://git-annex.branchable.com
Joey Hess [Mon, 10 Aug 2020 22:41:02 +0000 (18:41 -0400)]
fix osxapp build issue
need to build git-annex 1st, otherwise otool can't run
Ilya_Shlyakhter [Mon, 10 Aug 2020 21:52:32 +0000 (21:52 +0000)]
Added a comment
kyle [Mon, 10 Aug 2020 21:34:46 +0000 (21:34 +0000)]
Added a comment
Ilya_Shlyakhter [Mon, 10 Aug 2020 21:14:05 +0000 (21:14 +0000)]
Added a comment: full source tarballs for specific releases?
Joey Hess [Mon, 10 Aug 2020 20:49:09 +0000 (16:49 -0400)]
fix build failure on i386-ancient
Standalone: tmp/git-annex.linux/usr/lib/i386-linux-gnu/i686: renameFile: inappropriate type (is a directory)
Joey Hess [Mon, 10 Aug 2020 20:33:58 +0000 (16:33 -0400)]
improve slightly
This probably avoids the situation that caused the exception to be
thrown. It also makes sure that both threads end up canceled in the end,
while before the exception from wait outt could have caused errt to
never be waited on.
Joey Hess [Mon, 10 Aug 2020 20:18:47 +0000 (16:18 -0400)]
discard any exception thrown while trying to kill worker threads
Since there's a race here, and since Kyle saw an exception leak out,
which I have not been able to reproduce that. See my comment for what
I think might be going on.
Note that, I used tryNonAsync, because it seems a later tryNonAsync
caught the exception. I don't actually understand how it did, as I
understand exception classification, it's the data type, not the way it
was thrown. One possibility is that the async exception may have been wrapped
in some other, non-async exception, and Show displayed it the same way.
Joey Hess [Mon, 10 Aug 2020 20:18:35 +0000 (16:18 -0400)]
reorder
Joey Hess [Mon, 10 Aug 2020 20:03:59 +0000 (16:03 -0400)]
Merge branch 'master' of ssh://git-annex.branchable.com
Joey Hess [Mon, 10 Aug 2020 20:03:46 +0000 (16:03 -0400)]
comment
kyle [Mon, 10 Aug 2020 19:48:03 +0000 (19:48 +0000)]
Added a comment
Joey Hess [Mon, 10 Aug 2020 19:38:31 +0000 (15:38 -0400)]
fix order
Joey Hess [Mon, 10 Aug 2020 19:37:54 +0000 (15:37 -0400)]
Merge branch 'master' of ssh://git-annex.branchable.com
Joey Hess [Mon, 10 Aug 2020 19:37:25 +0000 (15:37 -0400)]
comment
Joey Hess [Mon, 10 Aug 2020 19:35:26 +0000 (15:35 -0400)]
document preferred content for import/export
Joey Hess [Mon, 10 Aug 2020 19:17:04 +0000 (15:17 -0400)]
document how to build standalone tarball
Joey Hess [Mon, 10 Aug 2020 19:01:36 +0000 (15:01 -0400)]
comment
kyle [Mon, 10 Aug 2020 19:01:37 +0000 (19:01 +0000)]
Added a comment
Joey Hess [Mon, 10 Aug 2020 19:00:58 +0000 (15:00 -0400)]
add missing command name
kyle [Mon, 10 Aug 2020 18:56:03 +0000 (18:56 +0000)]
Added a comment
Joey Hess [Mon, 10 Aug 2020 18:42:38 +0000 (14:42 -0400)]
comment
arnaud@c1d1cc612a3921dc06a417301be08a3e125478c4 [Mon, 10 Aug 2020 18:42:15 +0000 (18:42 +0000)]
Added a comment
Joey Hess [Mon, 10 Aug 2020 18:35:20 +0000 (14:35 -0400)]
response
Joey Hess [Mon, 10 Aug 2020 18:16:07 +0000 (14:16 -0400)]
couple more exports needed
Joey Hess [Mon, 10 Aug 2020 18:14:15 +0000 (14:14 -0400)]
comment
Joey Hess [Mon, 10 Aug 2020 18:12:07 +0000 (14:12 -0400)]
tag moreinfo
Joey Hess [Mon, 10 Aug 2020 18:09:24 +0000 (14:09 -0400)]
Merge branch 'master' of ssh://git-annex.branchable.com
Joey Hess [Mon, 10 Aug 2020 18:08:09 +0000 (14:08 -0400)]
comment
Joey Hess [Mon, 10 Aug 2020 17:52:18 +0000 (13:52 -0400)]
comment
Joey Hess [Mon, 10 Aug 2020 17:29:17 +0000 (13:29 -0400)]
one more export needed
arnaud@c1d1cc612a3921dc06a417301be08a3e125478c4 [Mon, 10 Aug 2020 17:25:11 +0000 (17:25 +0000)]
Added a comment
Joey Hess [Mon, 10 Aug 2020 17:24:31 +0000 (13:24 -0400)]
comment
Joey Hess [Mon, 10 Aug 2020 17:21:40 +0000 (13:21 -0400)]
fix build with old versions of process
Joey Hess [Mon, 10 Aug 2020 17:12:42 +0000 (13:12 -0400)]
fixed
Joey Hess [Mon, 10 Aug 2020 16:57:05 +0000 (12:57 -0400)]
comment
Joey Hess [Mon, 10 Aug 2020 16:51:17 +0000 (12:51 -0400)]
comment
Joey Hess [Mon, 10 Aug 2020 16:37:25 +0000 (12:37 -0400)]
improve docs and close bug
Joey Hess [Mon, 10 Aug 2020 16:21:45 +0000 (12:21 -0400)]
Merge branch 'master' of ssh://git-annex.branchable.com
Joey Hess [Mon, 10 Aug 2020 16:20:32 +0000 (12:20 -0400)]
make /usr/lib consolidation more robust
Directory enumeration could happen in either order, and also there could
be some other directories so the two to combine are not adjacent.
arnaud@c1d1cc612a3921dc06a417301be08a3e125478c4 [Mon, 10 Aug 2020 14:46:20 +0000 (14:46 +0000)]
Added a comment: This occurs on 9P filesystem too
Joey Hess [Fri, 7 Aug 2020 17:49:56 +0000 (13:49 -0400)]
squelch build warnings on osx
Joey Hess [Fri, 7 Aug 2020 17:30:11 +0000 (13:30 -0400)]
osx build fix
Joey Hess [Fri, 7 Aug 2020 17:15:36 +0000 (13:15 -0400)]
osx build fix
Joey Hess [Fri, 7 Aug 2020 16:59:47 +0000 (12:59 -0400)]
osx build fix
Joey Hess [Fri, 7 Aug 2020 16:39:59 +0000 (12:39 -0400)]
osx build fix
Joey Hess [Fri, 7 Aug 2020 16:14:50 +0000 (12:14 -0400)]
Merge branch 'master' of ssh://git-annex.branchable.com
Joey Hess [Fri, 7 Aug 2020 16:14:02 +0000 (12:14 -0400)]
fix osx build
cardoso-neto [Fri, 7 Aug 2020 02:41:12 +0000 (02:41 +0000)]
Added a comment: omg
cardoso-neto [Fri, 7 Aug 2020 02:24:47 +0000 (02:24 +0000)]
Added a comment: Understood.
Joey Hess [Fri, 7 Aug 2020 00:14:58 +0000 (20:14 -0400)]
Merge branch 'master' of ssh://git-annex.branchable.com