git-annex.git
4 years agothoughts
Joey Hess [Tue, 10 May 2022 17:25:38 +0000 (13:25 -0400)]
thoughts

4 years agofollowup
Joey Hess [Mon, 9 May 2022 20:10:31 +0000 (16:10 -0400)]
followup

4 years agoMerge branch 'master' of ssh://git-annex.branchable.com
Joey Hess [Mon, 9 May 2022 19:54:07 +0000 (15:54 -0400)]
Merge branch 'master' of ssh://git-annex.branchable.com

4 years agofix untrustworthiness of import/export remotes
Joey Hess [Mon, 9 May 2022 19:53:23 +0000 (15:53 -0400)]
fix untrustworthiness of import/export remotes

Commit 36133f27c0bd5ba037291420d4b66a3bd8e26308 had a boolean flip in it,
aaargh.

Special remotes with importtree=yes or exporttree=yes are once again
treated as untrusted, since files stored in them can be deleted or modified
at any time.

Sponsored-by: Kevin Mueller on Patreon
4 years agoincremental verification for retrieval from import remotes
Joey Hess [Mon, 9 May 2022 19:38:21 +0000 (15:38 -0400)]
incremental verification for retrieval from import remotes

Sponsored-by: Dartmouth College's Datalad project
4 years agoAdded a comment: interaction of out-of-tree symlinks with exporttree
Ilya_Shlyakhter [Mon, 9 May 2022 19:21:15 +0000 (19:21 +0000)]
Added a comment: interaction of out-of-tree symlinks with exporttree

4 years agoAdded a comment
lh [Mon, 9 May 2022 19:18:01 +0000 (19:18 +0000)]
Added a comment

4 years agoAdded a comment: hm...
yarikoptic [Mon, 9 May 2022 19:10:10 +0000 (19:10 +0000)]
Added a comment: hm...

4 years agoincremental verification for retrieval from all export remotes
Joey Hess [Mon, 9 May 2022 17:18:47 +0000 (13:18 -0400)]
incremental verification for retrieval from all export remotes

Only for export remotes so far, not export/import.

Sponsored-by: Dartmouth College's Datalad project
4 years agosupport incremental verification when retrieving from export/import remotes
Joey Hess [Mon, 9 May 2022 16:25:04 +0000 (12:25 -0400)]
support incremental verification when retrieving from export/import remotes

None of the special remotes do it yet, but this lays the groundwork.

Added MustFinishIncompleteVerify so that, when an incremental verify is
started but not complete, it can be forced to finish it. Otherwise, it
would have skipped doing it when verification is disabled, but
verification must always be done when retrievin from export remotes
since files can be modified during retrieval.

Note that retrieveExportWithContentIdentifier doesn't support incremental
verification yet. And I'm not sure if it can -- it doesn't know the Key
before it downloads the content. It seems a new API call would need to
be split out of that, which is provided with the key.

Sponsored-by: Dartmouth College's Datalad project
4 years agodatalad metadata
Joey Hess [Mon, 9 May 2022 15:32:29 +0000 (11:32 -0400)]
datalad metadata

4 years agocomment
Joey Hess [Mon, 9 May 2022 15:31:00 +0000 (11:31 -0400)]
comment

4 years agocomment
Joey Hess [Mon, 9 May 2022 15:19:34 +0000 (11:19 -0400)]
comment

4 years agocomment
Joey Hess [Mon, 9 May 2022 15:10:35 +0000 (11:10 -0400)]
comment

4 years agocomment
Joey Hess [Mon, 9 May 2022 15:00:13 +0000 (11:00 -0400)]
comment

4 years agoMerge branch 'master' of ssh://git-annex.branchable.com
Joey Hess [Mon, 9 May 2022 13:27:20 +0000 (09:27 -0400)]
Merge branch 'master' of ssh://git-annex.branchable.com

4 years ago(no commit message)
wzhd [Sun, 8 May 2022 23:47:39 +0000 (23:47 +0000)]

4 years agoMerge branch 'master' of ssh://git-annex.branchable.com
Joey Hess [Sat, 7 May 2022 16:30:52 +0000 (12:30 -0400)]
Merge branch 'master' of ssh://git-annex.branchable.com

4 years agoquestion/todo about migrating .git/annex/objects
yarikoptic [Fri, 6 May 2022 15:32:56 +0000 (15:32 +0000)]
question/todo about migrating .git/annex/objects

4 years agoinitial report asking to prevent adjusted branch migration or any other for that...
yarikoptic [Fri, 6 May 2022 15:25:57 +0000 (15:25 +0000)]
initial report asking to prevent adjusted branch migration or any other for that sake

4 years agoAdded a comment
mnaoumov [Thu, 5 May 2022 22:44:01 +0000 (22:44 +0000)]
Added a comment

4 years agoAdded a comment: it is still there
yarikoptic [Thu, 5 May 2022 20:22:14 +0000 (20:22 +0000)]
Added a comment: it is still there

4 years agorename memoryUnits
Joey Hess [Thu, 5 May 2022 19:35:11 +0000 (15:35 -0400)]
rename memoryUnits

It's not just used for memory sizes.

4 years agoimplement dataUnits finally
Joey Hess [Thu, 5 May 2022 19:22:11 +0000 (15:22 -0400)]
implement dataUnits finally

Added support for "megabit" and related bandwidth units in
annex.stalldetection and everywhere else that git-annex parses data units.

Note that the short form is "Mbit" not "Mb" because that differs from "MB"
only in case, and git-annex parses units case-insensitively. It would be
horrible if two different versions of git-annex parsed the same value
differently, so I don't think "Mb" can be supported.

See comment for bonus sad story from my childhood.

Sponsored-by: Nicholas Golder-Manning
4 years agoclose
Joey Hess [Thu, 5 May 2022 16:13:09 +0000 (12:13 -0400)]
close

4 years agocomment
Joey Hess [Thu, 5 May 2022 16:07:04 +0000 (12:07 -0400)]
comment

4 years agocomment
Joey Hess [Thu, 5 May 2022 14:57:17 +0000 (10:57 -0400)]
comment

4 years agoMerge branch 'master' of ssh://git-annex.branchable.com
Joey Hess [Thu, 5 May 2022 14:49:24 +0000 (10:49 -0400)]
Merge branch 'master' of ssh://git-annex.branchable.com

4 years agoupdate
Joey Hess [Thu, 5 May 2022 14:49:14 +0000 (10:49 -0400)]
update

4 years ago(no commit message)
mnaoumov [Thu, 5 May 2022 04:05:45 +0000 (04:05 +0000)]

4 years agoadd news item for git-annex 10.20220504
Joey Hess [Wed, 4 May 2022 15:48:55 +0000 (11:48 -0400)]
add news item for git-annex 10.20220504

4 years agohah, I mean 0504 of course
Joey Hess [Wed, 4 May 2022 15:47:40 +0000 (11:47 -0400)]
hah, I mean 0504 of course

4 years agoreleasing package git-annex version 10.20220404
Joey Hess [Wed, 4 May 2022 15:46:56 +0000 (11:46 -0400)]
releasing package git-annex version 10.20220404

4 years agobump year for Utility/*
Joey Hess [Wed, 4 May 2022 15:40:25 +0000 (11:40 -0400)]
bump year for Utility/*

4 years agofix git-annex repair false positive
Joey Hess [Wed, 4 May 2022 15:32:23 +0000 (11:32 -0400)]
fix git-annex repair false positive

Avoid treating refs/annex/last-index or other refs that are not commit
objects as evidence of repository corruption.

The repair code checks to find bad refs by trying to run `git log` on
them, and assumes that no output means something is broken.  But git log
on a tree object is empty.

This was worth fixing generally, not as a special case, since it's certainly
possible that other things store tree or other objects in refs.

Sponsored-by: Max Thoursie on Patreon
4 years agoAdded a comment: should import follow symlinks?
Ilya_Shlyakhter [Tue, 3 May 2022 19:36:10 +0000 (19:36 +0000)]
Added a comment: should import follow symlinks?

4 years agocomment
Joey Hess [Tue, 3 May 2022 16:26:29 +0000 (12:26 -0400)]
comment

4 years agodisable shellescape for rsync 3.2.4
Joey Hess [Tue, 3 May 2022 16:12:25 +0000 (12:12 -0400)]
disable shellescape for rsync 3.2.4

rsync 3.2.4 broke backwards-compatability by preventing exposing filenames
to the shell. Made the rsync and gcrypt special remotes detect this and
disable shellescape.

An alternative fix would have been to always set RSYNC_OLD_ARGS=1.
Which would avoid the overhead of probing rsync --help for each affected
remote. But that is really very fast to run, and it seemed better to switch
to the modern code path rather than keeping on using the bad old code path.

Sponsored-by: Tobias Ammann on Patreon
4 years agocomment
Joey Hess [Mon, 2 May 2022 18:53:47 +0000 (14:53 -0400)]
comment

4 years agocomment
Joey Hess [Mon, 2 May 2022 18:45:45 +0000 (14:45 -0400)]
comment

4 years agocomment, retitle
Joey Hess [Mon, 2 May 2022 18:35:07 +0000 (14:35 -0400)]
comment, retitle

4 years agoclose and comment
Joey Hess [Mon, 2 May 2022 18:26:22 +0000 (14:26 -0400)]
close and comment

4 years agocomment
Joey Hess [Mon, 2 May 2022 18:24:32 +0000 (14:24 -0400)]
comment

4 years agoFix a build failure with ghc 9.2.2
Joey Hess [Mon, 2 May 2022 18:21:48 +0000 (14:21 -0400)]
Fix a build failure with ghc 9.2.2

Thanks, gnezdo for the patch.

4 years agofilter out ExitSuccess
Joey Hess [Mon, 2 May 2022 18:09:37 +0000 (14:09 -0400)]
filter out ExitSuccess

This avoids displaying the unexpected exit codes message when
the list is eg [ExitSuccess, ExitFailure 1].

Sponsored-by: Dartmouth College's Datalad project
4 years agoavoid using removePathForcibly everywhere, it is unsafe
Joey Hess [Mon, 2 May 2022 18:06:20 +0000 (14:06 -0400)]
avoid using removePathForcibly everywhere, it is unsafe

If the temp directory can somehow contain a hard link, it changes the
mode, which affects all other hard linked files. So, it's too unsafe
to use everywhere in git-annex, since hard links are possible in
multiple ways and it would be very hard to prove that every place that
uses a temp directory cannot possibly put a hard link in it.

Added a call to removeDirectoryForCleanup to test_crypto, which will
fix the problem that commit 17b20a24502aee3bfc5683146c3899a233295aea
was intending to fix, with a much smaller hammer.

Sponsored-by: Dartmouth College's Datalad project
4 years agocomment
Joey Hess [Mon, 2 May 2022 17:01:37 +0000 (13:01 -0400)]
comment

4 years agoAdded a comment: Reproducible Example
Albert [Fri, 29 Apr 2022 15:57:34 +0000 (15:57 +0000)]
Added a comment: Reproducible Example

4 years agoAdded a comment: Minimal Example
Albert [Fri, 29 Apr 2022 15:14:21 +0000 (15:14 +0000)]
Added a comment: Minimal Example

4 years ago(no commit message)
kdm9 [Fri, 29 Apr 2022 07:28:46 +0000 (07:28 +0000)]

4 years agoreport about rsync test fail
yarikoptic [Thu, 28 Apr 2022 14:30:55 +0000 (14:30 +0000)]
report about rsync test fail

4 years ago(no commit message)
Albert [Tue, 26 Apr 2022 21:17:11 +0000 (21:17 +0000)]

4 years agoAdded a comment
Lukey [Mon, 25 Apr 2022 17:12:19 +0000 (17:12 +0000)]
Added a comment

4 years ago(no commit message)
gnezdo [Mon, 25 Apr 2022 16:29:11 +0000 (16:29 +0000)]

4 years agoAdded a comment: Duplicate Files
Albert [Sun, 24 Apr 2022 14:13:47 +0000 (14:13 +0000)]
Added a comment: Duplicate Files

4 years agoAdded a comment: Fixed
gnezdo [Sat, 23 Apr 2022 21:42:42 +0000 (21:42 +0000)]
Added a comment: Fixed

4 years agoAdded a comment: Clarification Example
Albert [Sat, 23 Apr 2022 12:10:36 +0000 (12:10 +0000)]
Added a comment: Clarification Example

4 years agoClarification about git assistant invariants
Albert [Sat, 23 Apr 2022 11:38:31 +0000 (11:38 +0000)]
Clarification about git assistant invariants

4 years agoAdded a comment
tanakaoji@cd5ba49c38f0a3b42b7e7bf56c4379d9024cd840 [Fri, 22 Apr 2022 20:39:30 +0000 (20:39 +0000)]
Added a comment

4 years agoAdded a comment: transitive transfers
Ilya_Shlyakhter [Fri, 22 Apr 2022 17:01:13 +0000 (17:01 +0000)]
Added a comment: transitive transfers

4 years agoAdded a comment: transitive transfers
Ilya_Shlyakhter [Fri, 22 Apr 2022 16:59:59 +0000 (16:59 +0000)]
Added a comment: transitive transfers

4 years ago(no commit message)
tanakaoji@cd5ba49c38f0a3b42b7e7bf56c4379d9024cd840 [Fri, 22 Apr 2022 03:10:19 +0000 (03:10 +0000)]

4 years agoAdded a comment
lh [Thu, 21 Apr 2022 01:18:21 +0000 (01:18 +0000)]
Added a comment

4 years agoAdded a comment: I had to come out of the rabbit hole
datamanager [Wed, 20 Apr 2022 15:28:14 +0000 (15:28 +0000)]
Added a comment: I had to come out of the rabbit hole

4 years ago(no commit message)
0nelight [Wed, 20 Apr 2022 14:50:18 +0000 (14:50 +0000)]

4 years agoAdded a comment: re: See git-annex-export.
datamanager [Wed, 20 Apr 2022 14:48:00 +0000 (14:48 +0000)]
Added a comment: re: See git-annex-export.

4 years agoAdded a comment: re: Making git-annex preserve file name, and directory
Ilya_Shlyakhter [Wed, 20 Apr 2022 04:03:46 +0000 (04:03 +0000)]
Added a comment: re: Making git-annex preserve file name, and directory

4 years agoI want to bend git-annex to my will, but I don't know how
datamanager [Wed, 20 Apr 2022 01:16:38 +0000 (01:16 +0000)]
I want to bend git-annex to my will, but I don't know how

4 years ago(no commit message)
lsmor [Tue, 19 Apr 2022 18:43:25 +0000 (18:43 +0000)]

4 years agoAdded a comment
lh [Tue, 19 Apr 2022 18:40:57 +0000 (18:40 +0000)]
Added a comment

4 years agoAdded a comment
lh [Tue, 19 Apr 2022 18:15:53 +0000 (18:15 +0000)]
Added a comment

4 years agoadded bug report for git-annex-import importing too much
Ilya_Shlyakhter [Tue, 19 Apr 2022 18:11:55 +0000 (18:11 +0000)]
added bug report for git-annex-import importing too much

4 years agocomment
Joey Hess [Tue, 19 Apr 2022 18:04:14 +0000 (14:04 -0400)]
comment

4 years agoFix test failure on NFS when cleaning up gpg temp directory
Joey Hess [Tue, 19 Apr 2022 17:33:16 +0000 (13:33 -0400)]
Fix test failure on NFS when cleaning up gpg temp directory

Using removePathForcibly avoids concurrent removal problems.

The i386ancient build still uses an old version of ghc and directory that
do not include removePathForcibly though.

Sponsored-by: Dartmouth College's Datalad project
4 years agokeep old directory support
Joey Hess [Tue, 19 Apr 2022 17:28:02 +0000 (13:28 -0400)]
keep old directory support

Still needed for i386ancient build.

4 years agoremove unused v
Joey Hess [Tue, 19 Apr 2022 17:22:32 +0000 (13:22 -0400)]
remove unused v

4 years agoremove moreinfo
Joey Hess [Tue, 19 Apr 2022 17:17:11 +0000 (13:17 -0400)]
remove moreinfo

4 years agoimprove check using nub
Joey Hess [Tue, 19 Apr 2022 17:16:01 +0000 (13:16 -0400)]
improve check using nub

This is clearer, and looks at the list content only once rather than
twice, but should have no behavior changes.

4 years agocomment
Joey Hess [Tue, 19 Apr 2022 16:40:17 +0000 (12:40 -0400)]
comment

4 years agocomment
Joey Hess [Tue, 19 Apr 2022 16:21:47 +0000 (12:21 -0400)]
comment

4 years agoremove
Joey Hess [Tue, 19 Apr 2022 16:14:27 +0000 (12:14 -0400)]
remove

4 years agocomment
Joey Hess [Tue, 19 Apr 2022 16:14:12 +0000 (12:14 -0400)]
comment

4 years agocomment
Joey Hess [Tue, 19 Apr 2022 16:08:12 +0000 (12:08 -0400)]
comment

4 years agomulticast: Support uftp 5.0 by switching from aes256-cbc to aes256-gcm
Joey Hess [Tue, 19 Apr 2022 16:02:10 +0000 (12:02 -0400)]
multicast: Support uftp 5.0 by switching from aes256-cbc to aes256-gcm

aes256-gcm is supported by both 4.x and 5.x, while 5.x dropped aes256-cbc.

Sponsored-by: Graham Spencer on Patreon
4 years agocomment
Joey Hess [Tue, 19 Apr 2022 15:56:32 +0000 (11:56 -0400)]
comment

4 years agoAdded a comment
yarikoptic [Tue, 19 Apr 2022 14:40:18 +0000 (14:40 +0000)]
Added a comment

4 years agoreport on cryto test FAIL on NFS
yarikoptic [Tue, 19 Apr 2022 14:37:43 +0000 (14:37 +0000)]
report on cryto test FAIL on NFS

4 years ago(no commit message)
lh [Tue, 19 Apr 2022 01:50:23 +0000 (01:50 +0000)]

4 years agoAdded a comment: new backends
Ilya_Shlyakhter [Sun, 17 Apr 2022 19:02:10 +0000 (19:02 +0000)]
Added a comment: new backends

4 years agoDescribe compatibility bug with uftp 5.0
david@62eef13b7e480dc51c94ea50b67ebc0181410cd1 [Sat, 16 Apr 2022 22:29:25 +0000 (22:29 +0000)]
Describe compatibility bug with uftp 5.0

4 years agoAdded a comment: The man page export seems to be broken
lh [Fri, 15 Apr 2022 12:26:20 +0000 (12:26 +0000)]
Added a comment: The man page export seems to be broken

4 years agoAdded a comment
lell [Fri, 15 Apr 2022 12:05:19 +0000 (12:05 +0000)]
Added a comment

4 years agoAdded a comment: Myself
Abdulbasi [Thu, 14 Apr 2022 00:56:59 +0000 (00:56 +0000)]
Added a comment: Myself

4 years agoAdded a comment: recording state in git
lh [Wed, 13 Apr 2022 23:56:09 +0000 (23:56 +0000)]
Added a comment: recording state in git

4 years agoAdded a comment: Discrepancy between `git add` and `git annex add` when annex.largefi...
lh [Wed, 13 Apr 2022 23:15:25 +0000 (23:15 +0000)]
Added a comment: Discrepancy between `git add` and `git annex add` when annex.largefiles is set

4 years agoAdded a comment: Improving on the WORM situation
lh [Wed, 13 Apr 2022 22:19:40 +0000 (22:19 +0000)]
Added a comment: Improving on the WORM situation

4 years agotodo
Joey Hess [Wed, 13 Apr 2022 15:08:33 +0000 (11:08 -0400)]
todo

4 years agotodo
Joey Hess [Wed, 13 Apr 2022 03:26:17 +0000 (23:26 -0400)]
todo

4 years agoAdded a comment: maxextensionlength
Ilya_Shlyakhter [Fri, 8 Apr 2022 19:13:38 +0000 (19:13 +0000)]
Added a comment: maxextensionlength

4 years agoadd easy-git-annex to related_software
Joey Hess [Wed, 6 Apr 2022 17:13:35 +0000 (13:13 -0400)]
add easy-git-annex to related_software