git-annex.git
5 years agostack.yaml: Updated to lts-16.10
Joey Hess [Mon, 24 Aug 2020 18:11:37 +0000 (14:11 -0400)]
stack.yaml: Updated to lts-16.10

Needs stack version 2.3 to build, which has only recently made it into
debian unstable.

This commit was sponsored by Jake Vosloo on Patreon.

5 years agoAdded a comment
kyle [Thu, 20 Aug 2020 20:34:26 +0000 (20:34 +0000)]
Added a comment

5 years agoAdded a comment
cardoso-neto [Thu, 20 Aug 2020 20:08:07 +0000 (20:08 +0000)]
Added a comment

5 years agoAdded a comment: Rationale behind deleting and readding the symlinks on a move or...
cardoso-neto [Thu, 20 Aug 2020 18:36:47 +0000 (18:36 +0000)]
Added a comment: Rationale behind deleting and readding the symlinks on a move or rename

5 years agoAdded a comment: thanks
kyle [Wed, 19 Aug 2020 17:54:11 +0000 (17:54 +0000)]
Added a comment: thanks

5 years agofix hang if external program is not available
Joey Hess [Wed, 19 Aug 2020 16:20:07 +0000 (12:20 -0400)]
fix hang if external program is not available

startExternal' throws an exception, which left the externalAsync TMVar
empty, so the next try to use it would hang.

5 years agoMerge branch 'master' of ssh://git-annex.branchable.com
Joey Hess [Tue, 18 Aug 2020 19:47:49 +0000 (15:47 -0400)]
Merge branch 'master' of ssh://git-annex.branchable.com

5 years ago(no commit message)
kyle [Tue, 18 Aug 2020 17:44:01 +0000 (17:44 +0000)]

5 years ago(no commit message)
gitannex@56d80e101087518fccc08f4420216c4f61f80b7f [Tue, 18 Aug 2020 15:10:33 +0000 (15:10 +0000)]

5 years agoavoid using MonadFail in ParseDuration
Joey Hess [Sat, 15 Aug 2020 19:53:35 +0000 (15:53 -0400)]
avoid using MonadFail in ParseDuration

There's no instance for Either String, so that makes it not as useful as
it could be, so instead just return an Either String.

5 years ago(no commit message)
michal.kotowski1@1c7e62558e00f6965c27223d9dcff021fbc44eed [Sat, 15 Aug 2020 19:01:57 +0000 (19:01 +0000)]

5 years agofix some warnings
Joey Hess [Sat, 15 Aug 2020 18:33:18 +0000 (14:33 -0400)]
fix some warnings

6 years agoMerge branch 'master' of ssh://git-annex.branchable.com
Joey Hess [Fri, 14 Aug 2020 20:01:39 +0000 (16:01 -0400)]
Merge branch 'master' of ssh://git-annex.branchable.com

6 years agoMerge branch 'asyncexternal'
Joey Hess [Fri, 14 Aug 2020 20:00:49 +0000 (16:00 -0400)]
Merge branch 'asyncexternal'

6 years agoDisplay warning when external special remote does not start up properly, or is not...
Joey Hess [Fri, 14 Aug 2020 19:38:31 +0000 (15:38 -0400)]
Display warning when external special remote does not start up properly, or is not usable

I'm sure this used to work, but somewhere along the line something or
things (getCost and getAvailability I think, probably others)
started catching the exception and not displaying it. So, show warnings.

6 years agoasync extension done
Joey Hess [Fri, 14 Aug 2020 19:24:34 +0000 (15:24 -0400)]
async extension done

6 years agoAdded a comment: Having cutting edge packages with conda is not that straighforward.
cardoso-neto [Fri, 14 Aug 2020 18:55:18 +0000 (18:55 +0000)]
Added a comment: Having cutting edge packages with conda is not that straighforward.

6 years agoswitch to TMVars for thread safety when using the async extension
Joey Hess [Fri, 14 Aug 2020 18:40:30 +0000 (14:40 -0400)]
switch to TMVars for thread safety when using the async extension

TVars were not updated atomically, which was ok when each thread got its
own External that was the only thing using these TVars. But, with the
async extension, several External instances can share the same var, so
it needs to be a TMVar to avoid read/write conflicts.

In particular, this makes PREPARE only be sent once.

6 years agoone jobid per thread
Joey Hess [Fri, 14 Aug 2020 18:24:46 +0000 (14:24 -0400)]
one jobid per thread

And, relay ERROR on to all listening threads.

6 years agoAdded a comment
Ilya_Shlyakhter [Fri, 14 Aug 2020 02:59:12 +0000 (02:59 +0000)]
Added a comment

6 years agorethought the async protocol some more
Joey Hess [Fri, 14 Aug 2020 00:18:06 +0000 (20:18 -0400)]
rethought the async protocol some more

Moving jobid generation to the git-annex side lets it be simplified a
lot.

Note that it will also be possible to generate one jobid per connection,
rather than a new job per request. That will make overflow not an issue,
and will avoid some work, and will simplify some of the code.

6 years agoAdded a comment: Ugly message when installing git-annex through conda
cardoso-neto [Fri, 14 Aug 2020 00:08:29 +0000 (00:08 +0000)]
Added a comment: Ugly message when installing git-annex through conda

6 years agoasync proto fully tested and working
Joey Hess [Thu, 13 Aug 2020 20:11:38 +0000 (16:11 -0400)]
async proto fully tested and working

Including with a concurrent capable remote program.

However, this is not quite ready to merge, there's a TODO in the code.

6 years agoasync proto basically working
Joey Hess [Thu, 13 Aug 2020 19:49:43 +0000 (15:49 -0400)]
async proto basically working

Simplified the protocol by removing END-ASYNC.

There's a STM crash when a non-async protocol message is sent, which
needs to be fixed.

6 years agoMerge branch 'master' of ssh://git-annex.branchable.com
Joey Hess [Wed, 12 Aug 2020 20:27:40 +0000 (16:27 -0400)]
Merge branch 'master' of ssh://git-annex.branchable.com

6 years agobranch
Joey Hess [Wed, 12 Aug 2020 20:27:02 +0000 (16:27 -0400)]
branch

6 years agofurther work on external async relay
Joey Hess [Wed, 12 Aug 2020 20:25:53 +0000 (16:25 -0400)]
further work on external async relay

6 years agorelayer receive loop is done
Joey Hess [Wed, 12 Aug 2020 19:54:30 +0000 (15:54 -0400)]
relayer receive loop is done

Receive loop looks right. Still need the send loop.

And, a complication is that some messages git-annex
sends need to be wrapped in REPLY_ASYNC, while others
do not. So will probably need to split externalSend
into two.

6 years agowip external remote async protocol extension
Joey Hess [Wed, 12 Aug 2020 19:17:53 +0000 (15:17 -0400)]
wip external remote async protocol extension

6 years agorethought this protocol again
Joey Hess [Wed, 12 Aug 2020 19:12:09 +0000 (15:12 -0400)]
rethought this protocol again

Now that I've started implementation, I see it's really necessary that
every message the special remote sends use the protocol, otherwise
nasty edge cases abound.

6 years agogeneralized ExternalState to not be limited to a ExternalAddonProcess
Joey Hess [Wed, 12 Aug 2020 16:30:45 +0000 (12:30 -0400)]
generalized ExternalState to not be limited to a ExternalAddonProcess

Idea is for ASYNC extension, it will instead contain methods that communicate
with the thread that handles all communication with the external process.

6 years agotypes for async protocol extension
Joey Hess [Wed, 12 Aug 2020 16:04:12 +0000 (12:04 -0400)]
types for async protocol extension

renamed AsyncMessage to ExceptionalMessage to make way for this new
extension.

6 years agoBug: addurl --file not working as expected with youtube-dl
git-annex@32dadd8082caa7c4ec9b28cf7dcf78e0d9fe58a8 [Wed, 12 Aug 2020 13:09:02 +0000 (13:09 +0000)]
Bug: addurl --file not working as expected with youtube-dl

6 years agoremoved
raf@4b53f20230978a98fc814b6e5565d9a30567a4f8 [Wed, 12 Aug 2020 12:54:46 +0000 (12:54 +0000)]
removed

6 years ago(no commit message)
raf@4b53f20230978a98fc814b6e5565d9a30567a4f8 [Wed, 12 Aug 2020 12:47:19 +0000 (12:47 +0000)]

6 years agoAdded a comment
cardoso-neto [Tue, 11 Aug 2020 22:10:27 +0000 (22:10 +0000)]
Added a comment

6 years agoMerge branch 'master' of ssh://git-annex.branchable.com
Joey Hess [Tue, 11 Aug 2020 20:42:37 +0000 (16:42 -0400)]
Merge branch 'master' of ssh://git-annex.branchable.com

6 years agodraft async extension
Joey Hess [Tue, 11 Aug 2020 20:42:09 +0000 (16:42 -0400)]
draft async extension

6 years ago(no commit message)
cardoso-neto [Tue, 11 Aug 2020 20:23:25 +0000 (20:23 +0000)]

6 years agoAdded a comment: strange conda install behavior
Ilya_Shlyakhter [Tue, 11 Aug 2020 20:19:49 +0000 (20:19 +0000)]
Added a comment: strange conda install behavior

6 years agoAdded a comment
cardoso-neto [Tue, 11 Aug 2020 19:57:06 +0000 (19:57 +0000)]
Added a comment

6 years agoclose
Joey Hess [Tue, 11 Aug 2020 18:01:22 +0000 (14:01 -0400)]
close

6 years agoadded note on installing the standalone git-annex distribution with conda
Ilya_Shlyakhter [Tue, 11 Aug 2020 16:03:40 +0000 (16:03 +0000)]
added note on installing the standalone git-annex distribution with conda

6 years agoAdded a comment: checking the conda-forge recipe
Ilya_Shlyakhter [Tue, 11 Aug 2020 15:51:28 +0000 (15:51 +0000)]
Added a comment: checking the conda-forge recipe

6 years agoAdded a comment: Great tip about conda.
cardoso-neto [Tue, 11 Aug 2020 13:23:00 +0000 (13:23 +0000)]
Added a comment: Great tip about conda.

6 years agoAdded a comment: please keep the hackage tarballs
Ilya_Shlyakhter [Tue, 11 Aug 2020 00:43:51 +0000 (00:43 +0000)]
Added a comment: please keep the hackage tarballs

6 years agoadd news item for git-annex 8.20200810
Joey Hess [Mon, 10 Aug 2020 23:22:55 +0000 (19:22 -0400)]
add news item for git-annex 8.20200810

6 years agocomment
Joey Hess [Mon, 10 Aug 2020 22:46:44 +0000 (18:46 -0400)]
comment

6 years agoMerge branch 'master' of ssh://git-annex.branchable.com
Joey Hess [Mon, 10 Aug 2020 22:42:00 +0000 (18:42 -0400)]
Merge branch 'master' of ssh://git-annex.branchable.com

6 years agofix osxapp build issue
Joey Hess [Mon, 10 Aug 2020 22:41:02 +0000 (18:41 -0400)]
fix osxapp build issue

need to build git-annex 1st, otherwise otool can't run

6 years agoAdded a comment
Ilya_Shlyakhter [Mon, 10 Aug 2020 21:52:32 +0000 (21:52 +0000)]
Added a comment

6 years agoAdded a comment
kyle [Mon, 10 Aug 2020 21:34:46 +0000 (21:34 +0000)]
Added a comment

6 years agoAdded a comment: full source tarballs for specific releases?
Ilya_Shlyakhter [Mon, 10 Aug 2020 21:14:05 +0000 (21:14 +0000)]
Added a comment: full source tarballs for specific releases?

6 years agofix build failure on i386-ancient
Joey Hess [Mon, 10 Aug 2020 20:49:09 +0000 (16:49 -0400)]
fix build failure on i386-ancient

Standalone: tmp/git-annex.linux/usr/lib/i386-linux-gnu/i686: renameFile: inappropriate type (is a directory)

6 years agoimprove slightly
Joey Hess [Mon, 10 Aug 2020 20:33:58 +0000 (16:33 -0400)]
improve slightly

This probably avoids the situation that caused the exception to be
thrown. It also makes sure that both threads end up canceled in the end,
while before the exception from wait outt could have caused errt to
never be waited on.

6 years agodiscard any exception thrown while trying to kill worker threads
Joey Hess [Mon, 10 Aug 2020 20:18:47 +0000 (16:18 -0400)]
discard any exception thrown while trying to kill worker threads

Since there's a race here, and since Kyle saw an exception leak out,
which I have not been able to reproduce that. See my comment for what
I think might be going on.

Note that, I used tryNonAsync, because it seems a later tryNonAsync
caught the exception. I don't actually understand how it did, as I
understand exception classification, it's the data type, not the way it
was thrown. One possibility is that the async exception may have been wrapped
in some other, non-async exception, and Show displayed it the same way.

6 years agoreorder
Joey Hess [Mon, 10 Aug 2020 20:18:35 +0000 (16:18 -0400)]
reorder

6 years agoMerge branch 'master' of ssh://git-annex.branchable.com
Joey Hess [Mon, 10 Aug 2020 20:03:59 +0000 (16:03 -0400)]
Merge branch 'master' of ssh://git-annex.branchable.com

6 years agocomment
Joey Hess [Mon, 10 Aug 2020 20:03:46 +0000 (16:03 -0400)]
comment

6 years agoAdded a comment
kyle [Mon, 10 Aug 2020 19:48:03 +0000 (19:48 +0000)]
Added a comment

6 years agofix order
Joey Hess [Mon, 10 Aug 2020 19:38:31 +0000 (15:38 -0400)]
fix order

6 years agoMerge branch 'master' of ssh://git-annex.branchable.com
Joey Hess [Mon, 10 Aug 2020 19:37:54 +0000 (15:37 -0400)]
Merge branch 'master' of ssh://git-annex.branchable.com

6 years agocomment
Joey Hess [Mon, 10 Aug 2020 19:37:25 +0000 (15:37 -0400)]
comment

6 years agodocument preferred content for import/export
Joey Hess [Mon, 10 Aug 2020 19:35:26 +0000 (15:35 -0400)]
document preferred content for import/export

6 years agodocument how to build standalone tarball
Joey Hess [Mon, 10 Aug 2020 19:17:04 +0000 (15:17 -0400)]
document how to build standalone tarball

6 years agocomment
Joey Hess [Mon, 10 Aug 2020 19:01:36 +0000 (15:01 -0400)]
comment

6 years agoAdded a comment
kyle [Mon, 10 Aug 2020 19:01:37 +0000 (19:01 +0000)]
Added a comment

6 years agoadd missing command name
Joey Hess [Mon, 10 Aug 2020 19:00:58 +0000 (15:00 -0400)]
add missing command name

6 years agoAdded a comment
kyle [Mon, 10 Aug 2020 18:56:03 +0000 (18:56 +0000)]
Added a comment

6 years agocomment
Joey Hess [Mon, 10 Aug 2020 18:42:38 +0000 (14:42 -0400)]
comment

6 years agoAdded a comment
arnaud@c1d1cc612a3921dc06a417301be08a3e125478c4 [Mon, 10 Aug 2020 18:42:15 +0000 (18:42 +0000)]
Added a comment

6 years agoresponse
Joey Hess [Mon, 10 Aug 2020 18:35:20 +0000 (14:35 -0400)]
response

6 years agocouple more exports needed
Joey Hess [Mon, 10 Aug 2020 18:16:07 +0000 (14:16 -0400)]
couple more exports needed

6 years agocomment
Joey Hess [Mon, 10 Aug 2020 18:14:15 +0000 (14:14 -0400)]
comment

6 years agotag moreinfo
Joey Hess [Mon, 10 Aug 2020 18:12:07 +0000 (14:12 -0400)]
tag moreinfo

6 years agoMerge branch 'master' of ssh://git-annex.branchable.com
Joey Hess [Mon, 10 Aug 2020 18:09:24 +0000 (14:09 -0400)]
Merge branch 'master' of ssh://git-annex.branchable.com

6 years agocomment
Joey Hess [Mon, 10 Aug 2020 18:08:09 +0000 (14:08 -0400)]
comment

6 years agocomment
Joey Hess [Mon, 10 Aug 2020 17:52:18 +0000 (13:52 -0400)]
comment

6 years agoone more export needed
Joey Hess [Mon, 10 Aug 2020 17:29:17 +0000 (13:29 -0400)]
one more export needed

6 years agoAdded a comment
arnaud@c1d1cc612a3921dc06a417301be08a3e125478c4 [Mon, 10 Aug 2020 17:25:11 +0000 (17:25 +0000)]
Added a comment

6 years agocomment
Joey Hess [Mon, 10 Aug 2020 17:24:31 +0000 (13:24 -0400)]
comment

6 years agofix build with old versions of process
Joey Hess [Mon, 10 Aug 2020 17:21:40 +0000 (13:21 -0400)]
fix build with old versions of process

6 years agofixed
Joey Hess [Mon, 10 Aug 2020 17:12:42 +0000 (13:12 -0400)]
fixed

6 years agocomment
Joey Hess [Mon, 10 Aug 2020 16:57:05 +0000 (12:57 -0400)]
comment

6 years agocomment
Joey Hess [Mon, 10 Aug 2020 16:51:17 +0000 (12:51 -0400)]
comment

6 years agoimprove docs and close bug
Joey Hess [Mon, 10 Aug 2020 16:37:25 +0000 (12:37 -0400)]
improve docs and close bug

6 years agoMerge branch 'master' of ssh://git-annex.branchable.com
Joey Hess [Mon, 10 Aug 2020 16:21:45 +0000 (12:21 -0400)]
Merge branch 'master' of ssh://git-annex.branchable.com

6 years agomake /usr/lib consolidation more robust
Joey Hess [Mon, 10 Aug 2020 16:20:32 +0000 (12:20 -0400)]
make /usr/lib consolidation more robust

Directory enumeration could happen in either order, and also there could
be some other directories so the two to combine are not adjacent.

6 years ago(no commit message)
arnaud@c1d1cc612a3921dc06a417301be08a3e125478c4 [Mon, 10 Aug 2020 14:46:20 +0000 (14:46 +0000)]

6 years agoAdded a comment: This occurs on 9P filesystem too
hdclark@be373988ada6dc692f87a8eefdd600432e54f7d4 [Fri, 7 Aug 2020 20:41:10 +0000 (20:41 +0000)]
Added a comment: This occurs on 9P filesystem too

6 years agosquelch build warnings on osx
Joey Hess [Fri, 7 Aug 2020 17:49:56 +0000 (13:49 -0400)]
squelch build warnings on osx

6 years agoosx build fix
Joey Hess [Fri, 7 Aug 2020 17:30:11 +0000 (13:30 -0400)]
osx build fix

6 years agoosx build fix
Joey Hess [Fri, 7 Aug 2020 17:15:36 +0000 (13:15 -0400)]
osx build fix

6 years agoosx build fix
Joey Hess [Fri, 7 Aug 2020 16:59:47 +0000 (12:59 -0400)]
osx build fix

6 years agoosx build fix
Joey Hess [Fri, 7 Aug 2020 16:39:59 +0000 (12:39 -0400)]
osx build fix

6 years agoMerge branch 'master' of ssh://git-annex.branchable.com
Joey Hess [Fri, 7 Aug 2020 16:14:50 +0000 (12:14 -0400)]
Merge branch 'master' of ssh://git-annex.branchable.com

6 years agofix osx build
Joey Hess [Fri, 7 Aug 2020 16:14:02 +0000 (12:14 -0400)]
fix osx build

6 years agoAdded a comment: omg
cardoso-neto [Fri, 7 Aug 2020 02:41:12 +0000 (02:41 +0000)]
Added a comment: omg

6 years agoAdded a comment: Understood.
cardoso-neto [Fri, 7 Aug 2020 02:24:47 +0000 (02:24 +0000)]
Added a comment: Understood.

6 years agoMerge branch 'master' of ssh://git-annex.branchable.com
Joey Hess [Fri, 7 Aug 2020 00:14:58 +0000 (20:14 -0400)]
Merge branch 'master' of ssh://git-annex.branchable.com