Joey Hess [Sat, 21 Nov 2020 16:24:41 +0000 (12:24 -0400)]
fix format
Joey Hess [Fri, 20 Nov 2020 16:53:25 +0000 (12:53 -0400)]
fix build on windows
Joey Hess [Fri, 20 Nov 2020 16:53:13 +0000 (12:53 -0400)]
done
gueux [Thu, 19 Nov 2020 22:15:58 +0000 (22:15 +0000)]
gueux [Thu, 19 Nov 2020 22:14:24 +0000 (22:14 +0000)]
rename bugs/adjust_--unlock_implies_all_files_set_as_modified.mdwn to bugs/after_adjust_--unlock_implies__44___a_lot_of_files_are_reported_as_modified.mdwn
gueux [Thu, 19 Nov 2020 22:09:23 +0000 (22:09 +0000)]
jwodder [Thu, 19 Nov 2020 21:15:42 +0000 (21:15 +0000)]
Joey Hess [Thu, 19 Nov 2020 20:38:51 +0000 (16:38 -0400)]
done
Joey Hess [Thu, 19 Nov 2020 20:36:37 +0000 (16:36 -0400)]
convert processTranscript to use hGetLineUntilExitOrEOF
It does use it on both stdout and stderr. It seems unlikely the problem
could really affect stdout, but the unix implementation of it combines
both into a single handle in any case.
Joey Hess [Thu, 19 Nov 2020 20:21:17 +0000 (16:21 -0400)]
converted reads from stderr to use hGetLineUntilExitOrEOF
These are all unlikely to suffer from the inherited stderr fd problem,
but who knows, it could happen.
Joey Hess [Thu, 19 Nov 2020 20:13:31 +0000 (16:13 -0400)]
convert to use hGetLineUntilExitOrEOF
It looks to me like the old code would have already dealt with the case
of ssh starting a ssh daemon that inherits stderr and keeps it open.
The ender thread closed the handle, which would unblock the other thread
and let it exit. Using hGetLineUntilExitOrEOF makes this more explicit
that it's dealt with and simplifies the code.
Joey Hess [Thu, 19 Nov 2020 19:34:26 +0000 (15:34 -0400)]
convert git config reading to use hGetLineUntilExitOrEOF
Much nicer than the old hack of waiting for a few seconds for stderr to be read.
Joey Hess [Thu, 19 Nov 2020 18:46:54 +0000 (14:46 -0400)]
changelog
Kyle Meyer [Thu, 19 Nov 2020 17:14:22 +0000 (12:14 -0500)]
BitTorrent: Fix build for "no torrent" code path
The RawFilePath conversions missed a spot in the else arm of "#ifdef
WITH_TORRENTPARSER".
Joey Hess [Thu, 19 Nov 2020 18:41:33 +0000 (14:41 -0400)]
preserve other headers when adding resume header
It had lost the hAcceptEncoding header that is set as part of the
overriding of http-client's default decompression of compressed files.
Seems likely that would have caused resuming of compressed files to fail
in some cases.
This commit was sponsored by Brett Eisenberg on Patreon.
Joey Hess [Thu, 19 Nov 2020 18:03:00 +0000 (14:03 -0400)]
don't rely on exception for http 416
Fix a bug that could make resuming a download from the web fail when the
entire content of the file is actually already present locally.
What a mess that Request can throw exceptions or not, depending on how
it's configured. Makes it very hard if you need to handle some specific
http status codes in a function like this! Implementing everything two
ways did not seem appealing, if possible at all, so I decided to
override the Request if it did come configured to throw exception on
non-2xx http status. Other exceptions, like from http-client-restricted,
or due to a redirect to a non-http url, still get thrown.
This commit was sponsored by Luke Shumaker on Patreon.
Joey Hess [Thu, 19 Nov 2020 17:02:23 +0000 (13:02 -0400)]
comment
Joey Hess [Thu, 19 Nov 2020 17:02:17 +0000 (13:02 -0400)]
comment
Joey Hess [Thu, 19 Nov 2020 16:50:25 +0000 (12:50 -0400)]
fix windows assistant upgrade glitch
Prevent windows assistant from trying (and failing) to upgrade itself,
which has never been supported on windows.
The new windows build is made with UPGRADE_LOCATION set, which enabled this
code path that had never run on windows before, and doesn't work. I don't
want to try to support self-upgrade on windows, or generally on other OS's
than the ones where its working, so added a check for that. This way the
build can keep setting UPGRADE_LOCATION and if some later git-annex does
learn how to upgrade itself on some OS, it won't need changing the build
setup.
Joey Hess [Thu, 19 Nov 2020 16:33:00 +0000 (12:33 -0400)]
Fix build on Windows
Thanks to bug reporter for the patch.
Joey Hess [Thu, 19 Nov 2020 16:20:18 +0000 (12:20 -0400)]
fix removeLink on windows
This removeLink was introduced in commit
e505c03bccdc6567cd517a6ddaf70a411489473d, which replaced code
that used removeFile on Windows. So, I know git-annex did not used to do
anything other than removeFile on Windows. If there were symlinks it
wanted to remove, this would not work on windows, but of course it does
not use symlinks on windows.
Joey Hess [Thu, 19 Nov 2020 16:08:06 +0000 (12:08 -0400)]
close
kyle [Thu, 19 Nov 2020 15:35:00 +0000 (15:35 +0000)]
Added a comment
jkniiv@b330fc3a602d36a37a67b2a2d99d4bed3bb653cb [Thu, 19 Nov 2020 05:12:06 +0000 (05:12 +0000)]
added version info as reported by `git-annex version`
jkniiv@b330fc3a602d36a37a67b2a2d99d4bed3bb653cb [Thu, 19 Nov 2020 05:00:25 +0000 (05:00 +0000)]
wting [Thu, 19 Nov 2020 03:12:37 +0000 (03:12 +0000)]
Added a comment
eric.w@eee65cd362d995ced72640c7cfae388ae93a4234 [Wed, 18 Nov 2020 19:28:51 +0000 (19:28 +0000)]
Added a comment
eric.w@eee65cd362d995ced72640c7cfae388ae93a4234 [Wed, 18 Nov 2020 19:26:33 +0000 (19:26 +0000)]
removed
Joey Hess [Wed, 18 Nov 2020 19:17:58 +0000 (15:17 -0400)]
Merge branch 'master' of ssh://git-annex.branchable.com
Joey Hess [Wed, 18 Nov 2020 19:17:05 +0000 (15:17 -0400)]
Merge branch 'ssh-hates-me'
Joey Hess [Wed, 18 Nov 2020 19:16:49 +0000 (15:16 -0400)]
update
Joey Hess [Wed, 18 Nov 2020 19:10:35 +0000 (15:10 -0400)]
avoid throwing exception when the handle is closed
The handle could get closed eg, by cleanupProcess being called,
which forces the process to exit and closes all its handles.
At this point, the test case in https://git-annex.branchable.com/bugs/Buggy_external_special_remote_stalls_after_7245a9e/
is fixed.
Joey Hess [Wed, 18 Nov 2020 19:03:30 +0000 (15:03 -0400)]
avoid crash on EOF at end
eric.w@eee65cd362d995ced72640c7cfae388ae93a4234 [Wed, 18 Nov 2020 18:59:49 +0000 (18:59 +0000)]
removed
eric.w@eee65cd362d995ced72640c7cfae388ae93a4234 [Wed, 18 Nov 2020 18:54:31 +0000 (18:54 +0000)]
Added a comment: how to convert existing repo to new backend?
Joey Hess [Wed, 18 Nov 2020 18:54:02 +0000 (14:54 -0400)]
finish conversion to hGetLineUntilExitOrEOF
started in
aafae46bcbb2a9533364b65be5fc05b379898aa1
Joey Hess [Wed, 18 Nov 2020 18:25:19 +0000 (14:25 -0400)]
remove bench test
Joey Hess [Wed, 18 Nov 2020 18:48:50 +0000 (14:48 -0400)]
newline mode (mis)handling for windows
Unfortunately, there is no hGetNewLineMode. This seems like an oversight
that should be fixed in ghc, but for now, I paper over it with a windows
hack.
Joey Hess [Wed, 18 Nov 2020 18:21:47 +0000 (14:21 -0400)]
working hGetLineUntilExitOrEOF
The problem with the old version seemed to be that hWaitForInput blocks
rather than timing out when being run concurrently with hGetLine on the
same handle.
This passes the bench test, and also works when run concurrently on
different handles.
eric.w@eee65cd362d995ced72640c7cfae388ae93a4234 [Wed, 18 Nov 2020 17:59:54 +0000 (17:59 +0000)]
removed
eric.w@eee65cd362d995ced72640c7cfae388ae93a4234 [Wed, 18 Nov 2020 17:54:49 +0000 (17:54 +0000)]
eric.w@eee65cd362d995ced72640c7cfae388ae93a4234 [Wed, 18 Nov 2020 17:52:22 +0000 (17:52 +0000)]
eric.w@eee65cd362d995ced72640c7cfae388ae93a4234 [Wed, 18 Nov 2020 17:51:31 +0000 (17:51 +0000)]
Joey Hess [Wed, 18 Nov 2020 16:53:41 +0000 (12:53 -0400)]
Merge branch 'master' of ssh://git-annex.branchable.com
Joey Hess [Wed, 18 Nov 2020 16:52:14 +0000 (12:52 -0400)]
followup
Joey Hess [Wed, 18 Nov 2020 16:23:15 +0000 (12:23 -0400)]
bench test for hGetLineUntilExitOrEOF
This seems to show that hWaitForInput does not seem to behave as
documented. It does not time out, so blocks forever in this situation.
This is with a 0 timeout and with larger timeouts. Unsure why, it looked
like it should work.
kyle [Wed, 18 Nov 2020 15:30:07 +0000 (15:30 +0000)]
Added a comment
https://ro-che.info/ [Wed, 18 Nov 2020 13:46:25 +0000 (13:46 +0000)]
alex@3cb1cc0c80ffb2137f36155c5caa581605c3767b [Wed, 18 Nov 2020 12:09:08 +0000 (12:09 +0000)]
alex@3cb1cc0c80ffb2137f36155c5caa581605c3767b [Wed, 18 Nov 2020 12:08:08 +0000 (12:08 +0000)]
gueux [Wed, 18 Nov 2020 10:54:56 +0000 (10:54 +0000)]
Added a comment
Joey Hess [Tue, 17 Nov 2020 21:31:08 +0000 (17:31 -0400)]
WIP
for https://git-annex.branchable.com/bugs/Buggy_external_special_remote_stalls_after_7245a9e/
Joey Hess [Tue, 17 Nov 2020 21:30:43 +0000 (17:30 -0400)]
comment
Joey Hess [Tue, 17 Nov 2020 17:31:12 +0000 (13:31 -0400)]
init: When writing hook scripts, set all execute bits, not only the user execute bit
Joey Hess [Tue, 17 Nov 2020 17:20:54 +0000 (13:20 -0400)]
comment
Joey Hess [Tue, 17 Nov 2020 16:00:03 +0000 (12:00 -0400)]
fix typo closing
Joey Hess [Tue, 17 Nov 2020 15:59:06 +0000 (11:59 -0400)]
Merge branch 'master' of ssh://git-annex.branchable.com
Joey Hess [Tue, 17 Nov 2020 15:58:45 +0000 (11:58 -0400)]
fix build on windows
gueux [Tue, 17 Nov 2020 11:21:56 +0000 (11:21 +0000)]
Joey Hess [Mon, 16 Nov 2020 19:17:48 +0000 (15:17 -0400)]
retitle
Joey Hess [Mon, 16 Nov 2020 19:15:07 +0000 (15:15 -0400)]
Merge branch 'master' of ssh://git-annex.branchable.com
Joey Hess [Mon, 16 Nov 2020 19:13:48 +0000 (15:13 -0400)]
avoid redundant adjusted branch update in sync
sync still does update it if the config would otherwise not, since it
already did.
Joey Hess [Mon, 16 Nov 2020 18:57:51 +0000 (14:57 -0400)]
bug fix
really innefficient but it does solve dropping
Joey Hess [Mon, 16 Nov 2020 18:31:02 +0000 (14:31 -0400)]
avoid spurious blank line when updating adjusted branch
git checkout run with --quiet should have no output
Joey Hess [Mon, 16 Nov 2020 18:09:55 +0000 (14:09 -0400)]
annex.adjustedbranchrefresh
Added annex.adjustedbranchrefresh git config to update adjusted branches
set up by git-annex adjust --unlock-present/--hide-missing.
Note, in a few cases, I was not able to make the adjusted branch
be updated in calls to moveAnnex, because information about what
file corresponds to a key is not available. They are:
* If two files point to one file, then eg, `git annex get foo` will
update the branch to unlock foo, but will not unlock bar, because it
does not know about it. Might be fixable by making `git annex get
bar` do something besides skipping bar?
* git-annex-shell recvkey likewise (so sends over ssh from old versions
of git-annex)
* git-annex setkey
* git-annex transferkey if the user does not use --file
* git-annex multicast sends keys with no associated file info
Doing a single full refresh at the end, after any incremental refresh,
will deal with those edge cases.
kyle [Mon, 16 Nov 2020 18:22:05 +0000 (18:22 +0000)]
Added a comment
yarikoptic [Mon, 16 Nov 2020 17:44:33 +0000 (17:44 +0000)]
Added a comment
Joey Hess [Mon, 16 Nov 2020 15:21:33 +0000 (11:21 -0400)]
split out Annex.Content.Presence
This will let a module that Annex.Content imports use inAnnex.
Unsure yet if I will need that, but this split still seems to make
sense, and Annex.Content was way too long so splitting it is good.
Joey Hess [Mon, 16 Nov 2020 14:09:25 +0000 (10:09 -0400)]
support parsing numeric git configs as bool
I'm not sure if git documents it aside from 0 and 1, but any integer
can be interpreted as a bool by it. Doing the same in git-annex is good
for consistency. Also, I am planning a config that starts out as a
numeric range, but will later transition to a simple bool (hopefully),
which this interpretation supports well.
Joey Hess [Mon, 16 Nov 2020 14:03:12 +0000 (10:03 -0400)]
Merge branch 'master' into symlink-missing
Joey Hess [Mon, 16 Nov 2020 13:56:32 +0000 (09:56 -0400)]
examinekey: Added a "file" format variable
For consistency with find, and for easier scripting.
Joey Hess [Mon, 16 Nov 2020 13:56:03 +0000 (09:56 -0400)]
fix build
Joey Hess [Mon, 16 Nov 2020 13:39:06 +0000 (09:39 -0400)]
add news item for git-annex 8.
20201116
Joey Hess [Mon, 16 Nov 2020 13:38:29 +0000 (09:38 -0400)]
releasing package git-annex version 8.
20201116
Joey Hess [Mon, 16 Nov 2020 13:37:11 +0000 (09:37 -0400)]
Merge branch 'master' of ssh://git-annex.branchable.com
Joey Hess [Mon, 16 Nov 2020 13:31:45 +0000 (09:31 -0400)]
fix build on windows
yarikoptic [Sat, 14 Nov 2020 02:00:13 +0000 (02:00 +0000)]
Added a comment
wting [Fri, 13 Nov 2020 23:08:26 +0000 (23:08 +0000)]
Added a comment
Joey Hess [Fri, 13 Nov 2020 19:57:35 +0000 (15:57 -0400)]
measurement
Joey Hess [Fri, 13 Nov 2020 19:54:33 +0000 (15:54 -0400)]
close
Joey Hess [Fri, 13 Nov 2020 19:52:55 +0000 (15:52 -0400)]
comment
Joey Hess [Fri, 13 Nov 2020 19:50:35 +0000 (15:50 -0400)]
add todo
Joey Hess [Fri, 13 Nov 2020 18:58:42 +0000 (14:58 -0400)]
make sync update --unlock-present branch
Joey Hess [Fri, 13 Nov 2020 18:32:06 +0000 (14:32 -0400)]
rename to --unlock-present and better reverse adjusting
An --unlock-present branch reverses back to a branch where
all files that get modified or renamed become locked, even if they were
originally unlocked. This is the same that reversing a --unlock branch
works, and the new name makes that commonality more clear.
Joey Hess [Fri, 13 Nov 2020 18:19:45 +0000 (14:19 -0400)]
Merge branch 'master' into symlink-missing
Joey Hess [Fri, 13 Nov 2020 18:19:32 +0000 (14:19 -0400)]
move: Fix a regression in the last release that made move --to not honor numcopies settings
This commit was sponsored by Svenne Krap on Patreon.
Joey Hess [Fri, 13 Nov 2020 17:49:12 +0000 (13:49 -0400)]
add a test case that move respects numcopies
There is already one for drop, but move and drop don't handle numcopies
exactly the same, and there was recently a reversion in it checking
numcopies properly at all.
This commit was sponsored by Noam Kremen on Patreon.
Joey Hess [Fri, 13 Nov 2020 17:27:03 +0000 (13:27 -0400)]
git-annex adjust --lock-missing
Like --hide-missing the branch does not get updated when content
availability changes.
Seems to basically work, but sync does not update it yet.
Also, when a file is present and so unlocked, git mv followed by
git-annex sync results in the basis branch being updated to contain the
file with the new name, unlocked. This seems different than what
happens in an adjusted unlocked branch, where the commit propigates back
locked. Probably the reverse adjustment code needs to be improved to
handle this case.
Joey Hess [Fri, 13 Nov 2020 17:34:59 +0000 (13:34 -0400)]
Merge branch 'master' of ssh://git-annex.branchable.com
Joey Hess [Fri, 13 Nov 2020 17:34:34 +0000 (13:34 -0400)]
hush build warning on OSX
Joey Hess [Fri, 13 Nov 2020 17:34:28 +0000 (13:34 -0400)]
fix build on windows
kyle [Fri, 13 Nov 2020 16:36:46 +0000 (16:36 +0000)]
Added a comment
wting [Fri, 13 Nov 2020 06:20:27 +0000 (06:20 +0000)]
Joey Hess [Thu, 12 Nov 2020 18:11:19 +0000 (14:11 -0400)]
Merge branch 'master' of ssh://git-annex.branchable.com
Joey Hess [Thu, 12 Nov 2020 18:08:13 +0000 (14:08 -0400)]
examinekey: Added --migrate-to-backend
Note that, the way the SeekInput parser is written to support batch mode,
it's actually possible to do git-annex examinekey
"SHA1--foo foo.tar.gz" --migrate-to-backend=SHA1E
While that might be kind of useful to support multiple migrations not using
batch mode, I have not documented it. It would be better to take pairs of
key and file in that case.
kyle [Thu, 12 Nov 2020 17:13:55 +0000 (17:13 +0000)]
Joey Hess [Thu, 12 Nov 2020 17:02:31 +0000 (13:02 -0400)]
examinekey: Added two new format variables: objectpath and objectpointer
Joey Hess [Thu, 12 Nov 2020 16:59:27 +0000 (12:59 -0400)]
comment