Joey Hess [Tue, 14 Jan 2020 19:41:34 +0000 (15:41 -0400)]
ported almost all remotes, until my brain melted
external is not started yet, and S3 is part way through and not
compiling yet
Joey Hess [Tue, 14 Jan 2020 17:18:15 +0000 (13:18 -0400)]
convert configParser to Annex action and add passthrough option
Needed so Remote.External can query the external program for its
configs. When the external program does not support the query,
the passthrough option will make all input fields be available.
Joey Hess [Tue, 14 Jan 2020 17:05:38 +0000 (13:05 -0400)]
fix wrong type
Use of Typeable means the type checker can't catch this kind of mistake,
the error is deferred to runtime.
testremote now passes on a directory special remote
Joey Hess [Tue, 14 Jan 2020 16:35:08 +0000 (12:35 -0400)]
separate RemoteConfig parsing basically working
Many special remotes are not updated yet and are commented out.
Joey Hess [Mon, 13 Jan 2020 16:35:39 +0000 (12:35 -0400)]
wip separate RemoteConfig parsing
Remote now contains a ParsedRemoteConfig. The parsing happens when the
Remote is constructed, rather than when individual configs are used.
This is more efficient, and it lets initremote/enableremote
reject configs that have unknown fields or unparsable values.
It also allows for improved type safety, as shown in
Remote.Helper.Encryptable where things that used to match on string
configs now match on data types.
This is a work in progress, it does not build yet.
The main risk in this conversion is forgetting to add a field to
RemoteConfigParser. That will prevent using that field with
initremote/enableremote, and will prevent remotes that already are set
up from seeing that configuration. So will need to check carefully that
every field that getRemoteConfigValue is called on has been added to
RemoteConfigParser.
(One such case I need to remember is that credPairRemoteField needs to be
included in the RemoteConfigParser.)
Joey Hess [Fri, 10 Jan 2020 18:53:00 +0000 (14:53 -0400)]
Merge branch 'master' of ssh://git-annex.branchable.com
Joey Hess [Fri, 10 Jan 2020 18:10:20 +0000 (14:10 -0400)]
be stricter about rejecting invalid configurations for remotes
This is a first step toward that goal, using the ProposedAccepted type
in RemoteConfig lets initremote/enableremote reject bad parameters that
were passed in a remote's configuration, while avoiding enableremote
rejecting bad parameters that have already been stored in remote.log
This does not eliminate every place where a remote config is parsed and a
default value is used if the parse false. But, I did fix several
things that expected foo=yes/no and so confusingly accepted foo=true but
treated it like foo=no. There are still some fields that are parsed with
yesNo but not not checked when initializing a remote, and there are other
fields that are parsed in other ways and not checked when initializing a
remote.
This also lays groundwork for rejecting unknown/typoed config keys.
Added a comment: using hardlinks
Joey Hess [Fri, 10 Jan 2020 14:47:59 +0000 (10:47 -0400)]
2020
https://christian.amsuess.com/chrysn [Fri, 10 Jan 2020 08:41:20 +0000 (08:41 +0000)]
Added a comment: Summary; Application: shared thumbnails
Joey Hess [Thu, 9 Jan 2020 20:54:11 +0000 (16:54 -0400)]
comment
https://christian.amsuess.com/chrysn [Thu, 9 Jan 2020 13:26:09 +0000 (13:26 +0000)]
notes on my recovery from a bad merge
Joey Hess [Wed, 8 Jan 2020 18:26:48 +0000 (14:26 -0400)]
comment
Joey Hess [Wed, 8 Jan 2020 18:25:26 +0000 (14:25 -0400)]
response
Joey Hess [Wed, 8 Jan 2020 18:24:10 +0000 (14:24 -0400)]
Merge branch 'master' of ssh://git-annex.branchable.com
Ilya_Shlyakhter [Wed, 8 Jan 2020 16:16:32 +0000 (16:16 +0000)]
Added a comment: git-annex in docker on Windows
anarcat [Wed, 8 Jan 2020 15:30:51 +0000 (15:30 +0000)]
fix a transcription error - to disable a remote, we set ignore to true, not false!
Added a comment: WSL 1/2 experience
Added a comment
undral [Wed, 8 Jan 2020 00:17:47 +0000 (00:17 +0000)]
removed
undral [Wed, 8 Jan 2020 00:17:14 +0000 (00:17 +0000)]
Added a comment: hi
Joey Hess [Tue, 7 Jan 2020 20:10:57 +0000 (16:10 -0400)]
generalize docs so they will also work when git uses SHA256
Joey Hess [Tue, 7 Jan 2020 19:33:29 +0000 (15:33 -0400)]
response
Joey Hess [Tue, 7 Jan 2020 19:28:20 +0000 (15:28 -0400)]
response
Added a comment: prior research
Joey Hess [Tue, 7 Jan 2020 18:27:53 +0000 (14:27 -0400)]
plan
Joey Hess [Tue, 7 Jan 2020 17:26:14 +0000 (13:26 -0400)]
Merge branch 'master' of ssh://git-annex.branchable.com
Joey Hess [Tue, 7 Jan 2020 16:29:37 +0000 (12:29 -0400)]
use --no-abbrev instead of --abbrev=40
This avoids hardcoding the sha size, so when git uses sha256, it will
output the full sha256 and not a truncation to 40 characters.
I reviewed git's history, and while there have been some
bugs with commands not supporting --no-abbrev (eg git diff --no-index
--no-abbrev was broken in git 2.1), none of the commands git-annex
uses will be impacted by those old bugs.
Joey Hess [Tue, 7 Jan 2020 15:35:17 +0000 (11:35 -0400)]
support sha256 git repos
Git will eventually switch to sha2 and there will not be one single
shaSize anymore, but two (40 and 64).
Changed all parsers for git plumbing output to support both sizes of
shas.
One potential problem this does not deal with is, if somewhere in
git-annex it reads two shas from different sources, and compares them
to see if they're the same sha, it would fail if they're sha1 and sha256
of the same value. I don't know if that will really be a concern.
spwhitton [Tue, 7 Jan 2020 12:29:49 +0000 (12:29 +0000)]
Added a comment
Joey Hess [Mon, 6 Jan 2020 19:40:48 +0000 (15:40 -0400)]
Merge branch 'master' of ssh://git-annex.branchable.com
Joey Hess [Mon, 6 Jan 2020 19:39:50 +0000 (15:39 -0400)]
comment
Joey Hess [Mon, 6 Jan 2020 19:35:11 +0000 (15:35 -0400)]
fix typo in close
Joey Hess [Mon, 6 Jan 2020 19:33:06 +0000 (15:33 -0400)]
comment
Joey Hess [Mon, 6 Jan 2020 19:29:51 +0000 (15:29 -0400)]
comment
yarikoptic [Mon, 6 Jan 2020 19:27:23 +0000 (19:27 +0000)]
Added a comment
Joey Hess [Mon, 6 Jan 2020 18:44:37 +0000 (14:44 -0400)]
close, redundant
Joey Hess [Mon, 6 Jan 2020 18:42:40 +0000 (14:42 -0400)]
comment and close
Joey Hess [Mon, 6 Jan 2020 18:33:29 +0000 (14:33 -0400)]
comments
Joey Hess [Mon, 6 Jan 2020 18:22:22 +0000 (14:22 -0400)]
reinject --known: Fix bug that prevented it from working in a bare repo.
ifAnnexed in a bare repo passes to git cat-file :./filename , which it
refuses to do since the repo is bare.
Note that, reinject somefile someannexedfile in a bare repo silently does
nothing, because someannexedfile is never actually an annexed worktree
file, because the repo is bare.
Joey Hess [Mon, 6 Jan 2020 17:59:03 +0000 (13:59 -0400)]
comment
Joey Hess [Mon, 6 Jan 2020 17:24:39 +0000 (13:24 -0400)]
comment
Joey Hess [Mon, 6 Jan 2020 17:06:10 +0000 (13:06 -0400)]
update
Removed some encoding issues that I think are no longer a problem.
Joey Hess [Mon, 6 Jan 2020 17:06:06 +0000 (13:06 -0400)]
comment
Joey Hess [Mon, 6 Jan 2020 16:55:26 +0000 (12:55 -0400)]
Merge branch 'master' of ssh://git-annex.branchable.com
Joey Hess [Mon, 6 Jan 2020 16:53:09 +0000 (12:53 -0400)]
improve comment
Joey Hess [Mon, 6 Jan 2020 16:52:59 +0000 (12:52 -0400)]
comment
AdamSpiers [Mon, 6 Jan 2020 16:12:54 +0000 (16:12 +0000)]
Added a comment: Would you accept a patch implementing an annex.autocommit gitattribute?
AdamSpiers [Mon, 6 Jan 2020 15:47:14 +0000 (15:47 +0000)]
Joey Hess [Sun, 5 Jan 2020 00:18:40 +0000 (20:18 -0400)]
use conversion functions from filepath-bytestring (again)
This reverts commit
3a04af7927afaac9aa65e65157201c35304df964.
yarikoptic [Sat, 4 Jan 2020 04:25:48 +0000 (04:25 +0000)]
a new TODO for having windows build with MagicMime
Joey Hess [Thu, 2 Jan 2020 16:18:38 +0000 (12:18 -0400)]
simplfy unix-compat dep
Joey Hess [Wed, 1 Jan 2020 19:16:07 +0000 (15:16 -0400)]
devblog
Joey Hess [Wed, 1 Jan 2020 19:04:37 +0000 (15:04 -0400)]
comment
Joey Hess [Wed, 1 Jan 2020 19:03:01 +0000 (15:03 -0400)]
comments
Joey Hess [Wed, 1 Jan 2020 18:52:16 +0000 (14:52 -0400)]
fix comment location
Joey Hess [Wed, 1 Jan 2020 18:40:00 +0000 (14:40 -0400)]
avoid build warning on windows
Joey Hess [Wed, 1 Jan 2020 18:38:40 +0000 (14:38 -0400)]
update comments to point to conversion docs
want to avoid use of -c annex.largefiles..
Joey Hess [Wed, 1 Jan 2020 18:27:03 +0000 (14:27 -0400)]
fix windows build
Joey Hess [Wed, 1 Jan 2020 18:26:58 +0000 (14:26 -0400)]
comment
Joey Hess [Wed, 1 Jan 2020 18:03:06 +0000 (14:03 -0400)]
add --force-annex/--force-git
options make it easier to override annex.largefiles configuration
(and potentially safer as it avoids bugs like the smudge bug fixed
in the last release)
Deleted some old comments that were posted to the man page discussing such
options.
Updated docs that used -c annex.largefiles to use the options.
Note that addSmallOverridden was needed to avoid the clean filter running
on the file. It would be possible to make addFile also update the index
directly, rather than going via git add. However, it was not necessary,
and I want to avoid breaking on some edge case, particularly if the code in
addSmallOverridden has some oversight.
Also, when annex.addunlocked is set and annex.largefiles does not match a file,
git annex add --force-large works, but git status will then show the file
as added, with a unstaged modification. The unstaged modification adds the
file to git. This is identical behavior to using -c annex.largefiles=nothing
when annex.addunlocked is set. This does not prevent committing what was
intended to be added. I have not gotten to the bottom of why git thinks
the file is modified and runs it through the clean filter in this case.
Joey Hess [Wed, 1 Jan 2020 17:46:03 +0000 (13:46 -0400)]
windows build fix
Joey Hess [Wed, 1 Jan 2020 17:12:33 +0000 (13:12 -0400)]
windows build fix
Joey Hess [Wed, 1 Jan 2020 17:05:23 +0000 (13:05 -0400)]
windows build fix
Joey Hess [Wed, 1 Jan 2020 16:24:31 +0000 (12:24 -0400)]
windows build fix
Joey Hess [Tue, 31 Dec 2019 22:09:17 +0000 (18:09 -0400)]
force move
Move will fail if the file is already on website and was re-downloaded
to generate rpms with, so force makes sure it moves.
Joey Hess [Tue, 31 Dec 2019 22:01:53 +0000 (18:01 -0400)]
update for RawFilePath changes
Ilya_Shlyakhter [Tue, 31 Dec 2019 01:38:03 +0000 (01:38 +0000)]
Added a comment: named pipes and external remotes
Joey Hess [Mon, 30 Dec 2019 18:50:15 +0000 (14:50 -0400)]
add news item for git-annex 7.
20191230
Joey Hess [Mon, 30 Dec 2019 18:49:31 +0000 (14:49 -0400)]
releasing package git-annex version 7.
20191230
Joey Hess [Mon, 30 Dec 2019 18:36:04 +0000 (14:36 -0400)]
comment
Joey Hess [Mon, 30 Dec 2019 17:54:46 +0000 (13:54 -0400)]
fix quickcheck failure
prop_encode_decode_roundtrip failed on "\175" in C locale.
This may be a new problem after the switch to RawFilePath, but it
already had filtering for high chars, so changed to only test ascii
chars.
Joey Hess [Mon, 30 Dec 2019 17:06:43 +0000 (13:06 -0400)]
if hdiutil create never succeeds, fail the build
Build was succeeding despite the dmg never being created.
Joey Hess [Mon, 30 Dec 2019 16:27:45 +0000 (12:27 -0400)]
different way to avoid NUL in Arbitrary AssociatedFile
Test case has been intermittently failing, with an AssociatedFile that
somehow contains a NUL despite it being filtered out. My guess is
something to do with locales. This new approach should prevent any NUL
at all, although it does weigh the distribution a bit more toward
Nothing.
Joey Hess [Mon, 30 Dec 2019 15:43:15 +0000 (11:43 -0400)]
adjust filepath-bytestring deps
cabal needs to support the old one for debian currently, but stack can
require the newer one
sirio@84e81889437b3f6208201a26e428197c6045c337 [Sun, 29 Dec 2019 22:10:26 +0000 (22:10 +0000)]
Added a comment: Duplicate 'gcrypt-id' may be the issue?
kyle [Sat, 28 Dec 2019 21:06:46 +0000 (21:06 +0000)]
Added a comment
Joey Hess [Fri, 27 Dec 2019 23:29:09 +0000 (19:29 -0400)]
temporary revert "use conversion functions from filepath-bytestring"
This reverts commit
75c40279c1600da157c2ba0981989da9eaf1c502.
Debian unstable is one version too old, so this can be de-reverted in a
bit.
Joey Hess [Fri, 27 Dec 2019 19:20:46 +0000 (15:20 -0400)]
add filepath-bytestring
Joey Hess [Fri, 27 Dec 2019 19:10:11 +0000 (15:10 -0400)]
add libghc-filepath-bytestring-dev build dep
Debian impressively packaged my new library before anyone even asked
them to, and before git-annex needed it.
Joey Hess [Fri, 27 Dec 2019 19:08:11 +0000 (15:08 -0400)]
close
Joey Hess [Fri, 27 Dec 2019 18:58:10 +0000 (14:58 -0400)]
fix a case where file tracked by git unexpectedly becomes annex pointer file
smudge: When annex.largefiles=anything, files that were already stored in
git, and have not been modified could sometimes be converted to being
stored in the annex. Changes in 7.
20191024 made this more of a problem.
This case is now detected and prevented.
Joey Hess [Fri, 27 Dec 2019 18:52:19 +0000 (14:52 -0400)]
comment
Joey Hess [Fri, 27 Dec 2019 17:17:53 +0000 (13:17 -0400)]
update on variant
Joey Hess [Fri, 27 Dec 2019 16:47:32 +0000 (12:47 -0400)]
Merge branch 'master' of ssh://git-annex.branchable.com
Joey Hess [Fri, 27 Dec 2019 07:04:23 +0000 (03:04 -0400)]
followup
chkno@50332f55d5ef2f4b7c6bec5253b853a8f2dc770e [Fri, 27 Dec 2019 00:47:46 +0000 (00:47 +0000)]
chkno@50332f55d5ef2f4b7c6bec5253b853a8f2dc770e [Fri, 27 Dec 2019 00:47:03 +0000 (00:47 +0000)]
Joey Hess [Thu, 26 Dec 2019 20:39:27 +0000 (16:39 -0400)]
implelented in v8
Joey Hess [Thu, 26 Dec 2019 19:07:50 +0000 (15:07 -0400)]
didn't mean to commit this incomplete workaround
though I suppose it's nice to have it in the history..
Joey Hess [Thu, 26 Dec 2019 19:05:36 +0000 (15:05 -0400)]
analysis
yarikoptic [Tue, 24 Dec 2019 14:10:49 +0000 (14:10 +0000)]
added projects/datalad
https://christian.amsuess.com/chrysn [Sun, 22 Dec 2019 10:50:33 +0000 (10:50 +0000)]
Added a comment: Workaround
https://christian.amsuess.com/chrysn [Sun, 22 Dec 2019 10:02:23 +0000 (10:02 +0000)]
link from bug report to submodules to make the affecting bug visible there
spwhitton [Sat, 21 Dec 2019 23:03:46 +0000 (23:03 +0000)]
Added a comment
spwhitton [Sat, 21 Dec 2019 22:20:31 +0000 (22:20 +0000)]
add workaround