git-annex.git
5 years agoMerge branch 'master' of ssh://git-annex.branchable.com
Joey Hess [Fri, 21 May 2021 15:28:17 +0000 (11:28 -0400)]
Merge branch 'master' of ssh://git-annex.branchable.com

5 years agoreopen per comment
Joey Hess [Fri, 21 May 2021 15:27:13 +0000 (11:27 -0400)]
reopen per comment

5 years agotodo
Joey Hess [Thu, 20 May 2021 15:18:46 +0000 (11:18 -0400)]
todo

5 years agoAdded a comment
Nick_P [Thu, 20 May 2021 10:43:14 +0000 (10:43 +0000)]
Added a comment

5 years agoAdded a comment
Atemu [Wed, 19 May 2021 17:13:45 +0000 (17:13 +0000)]
Added a comment

5 years agoAdded a comment
Nick_P [Wed, 19 May 2021 16:59:21 +0000 (16:59 +0000)]
Added a comment

5 years agoAdded a comment
Atemu [Wed, 19 May 2021 16:54:19 +0000 (16:54 +0000)]
Added a comment

5 years agofix by improving docs
Joey Hess [Wed, 19 May 2021 15:13:53 +0000 (11:13 -0400)]
fix by improving docs

5 years agocomment
Joey Hess [Wed, 19 May 2021 15:07:02 +0000 (11:07 -0400)]
comment

5 years agocomment
Joey Hess [Wed, 19 May 2021 14:55:35 +0000 (10:55 -0400)]
comment

5 years agoAdded a comment
Nick_P [Wed, 19 May 2021 14:35:43 +0000 (14:35 +0000)]
Added a comment

5 years agoAdded a comment
Nick_P [Wed, 19 May 2021 14:29:23 +0000 (14:29 +0000)]
Added a comment

5 years agoAdded a comment
strmd [Wed, 19 May 2021 07:00:58 +0000 (07:00 +0000)]
Added a comment

5 years ago(no commit message)
strmd [Wed, 19 May 2021 06:56:34 +0000 (06:56 +0000)]

5 years agoAdded a comment
strmd [Wed, 19 May 2021 06:33:03 +0000 (06:33 +0000)]
Added a comment

5 years ago(no commit message)
Nick_P [Tue, 18 May 2021 17:35:33 +0000 (17:35 +0000)]

5 years agoremoved
Atemu [Tue, 18 May 2021 17:16:12 +0000 (17:16 +0000)]
removed

5 years agoAdded a comment
Atemu [Tue, 18 May 2021 16:23:09 +0000 (16:23 +0000)]
Added a comment

5 years agoForgot the assistant needed for repro
Atemu [Tue, 18 May 2021 16:16:56 +0000 (16:16 +0000)]
Forgot the assistant needed for repro

5 years agotodo for extra logging when content changed
yarikoptic [Tue, 18 May 2021 14:05:18 +0000 (14:05 +0000)]
todo for extra logging when content changed

5 years agoAdded a comment
Atemu [Tue, 18 May 2021 09:13:32 +0000 (09:13 +0000)]
Added a comment

5 years agoupdate for filter-branch
Joey Hess [Mon, 17 May 2021 19:03:47 +0000 (15:03 -0400)]
update for filter-branch

5 years agofilter-branch: New command, useful to produce a filtered version of the git-annex...
Joey Hess [Mon, 17 May 2021 18:16:46 +0000 (14:16 -0400)]
filter-branch: New command, useful to produce a filtered version of the git-annex branch, eg when splitting a repository

5 years agoMerge branch 'filter-branch'
Joey Hess [Mon, 17 May 2021 18:16:13 +0000 (14:16 -0400)]
Merge branch 'filter-branch'

5 years agodecided not to include export/import trees
Joey Hess [Mon, 17 May 2021 18:12:15 +0000 (14:12 -0400)]
decided not to include export/import trees

They're only needed to cover a gc edge case, and it's better someone
gets caught by that edge case than that someone who does not know about
them ends up with a filtered git-annex branch that contains such a tree
when some of the files listed in it are ones they wanted to *remove*
from the repository.

5 years agoinclude info for sameas repos
Joey Hess [Mon, 17 May 2021 18:04:14 +0000 (14:04 -0400)]
include info for sameas repos

It's not currently possible to exclude a sameas repo using its
annex-config-uuid. (Remote.nameToUUID rejects them).
Since there's no real documented way to learn those, this seems ok, at
least for now. Also it avoids the problem of someone excluding the
parent but including the sameas, which would probably make the sameas
repo not usable when using the filtered branch.

5 years agofilter-branch working aside from some edge cases
Joey Hess [Mon, 17 May 2021 17:24:58 +0000 (13:24 -0400)]
filter-branch working aside from some edge cases

Added a note to man page about what happens to information that is
recorded in the private journal. Since it uses Branch.get, that
information will be copied when options allow. It seemed better to allow
it and document it than not allow it, since the options allow excluding
repositories and so can be used to exclude private repos if desired.

5 years agoadd createMessage
Joey Hess [Mon, 17 May 2021 17:07:47 +0000 (13:07 -0400)]
add createMessage

init: When annex.commitmessage is set, use that message for the commit
that creates the git-annex branch.

This will be used by filter-branch too, and it seems to make sense to let
annex.commitmessage affect it.

5 years agoimplemented filter-branch for key info
Joey Hess [Mon, 17 May 2021 15:06:47 +0000 (11:06 -0400)]
implemented filter-branch for key info

Not tested yet but should work.

Noted a possible optimisation, which should probably be added, to
speed it up in cases where there is no uuid filtering being done.
It would need Annex.Branch to add a function like getRef that uses
catFileDetails, so the sha is also returned. The difficulty would be
making it support the precached file content; if it didn't it would
probably not be any faster and could even be slower. So probably the
precaching would need to be changed to also cache the sha.

5 years agoAdded a comment: update
https://esgf-node.llnl.gov/esgf-idp/openid/tom_clune [Mon, 17 May 2021 14:53:19 +0000 (14:53 +0000)]
Added a comment: update

5 years agoconvert formatLsTree to ByteString for speed
Joey Hess [Mon, 17 May 2021 14:46:24 +0000 (10:46 -0400)]
convert formatLsTree to ByteString for speed

5 years agoAdded a comment: I Am.
jrayguinn@616789b2aec6c923cd9897c86987f05581df3601 [Mon, 17 May 2021 09:42:32 +0000 (09:42 +0000)]
Added a comment: I Am.

5 years agoAdded a comment: I Am.
jrayguinn@616789b2aec6c923cd9897c86987f05581df3601 [Mon, 17 May 2021 09:42:12 +0000 (09:42 +0000)]
Added a comment: I Am.

5 years agoAdded a comment
Atemu [Sun, 16 May 2021 11:37:25 +0000 (11:37 +0000)]
Added a comment

5 years ago(no commit message)
Atemu [Sun, 16 May 2021 11:30:38 +0000 (11:30 +0000)]

5 years ago(no commit message)
Atemu [Sun, 16 May 2021 11:05:15 +0000 (11:05 +0000)]

5 years agoAdded a comment
Atemu [Sun, 16 May 2021 10:27:47 +0000 (10:27 +0000)]
Added a comment

5 years agoMerge branch 'master' into filter-branch
Joey Hess [Fri, 14 May 2021 18:17:31 +0000 (14:17 -0400)]
Merge branch 'master' into filter-branch

5 years agodon't implicitly include all when exclude options are used
Joey Hess [Fri, 14 May 2021 18:14:46 +0000 (14:14 -0400)]
don't implicitly include all when exclude options are used

This is less erorr-prone, and easier for the user to reason about; it
preserves the man page's promise that only explicitly included
information will be copied.

5 years agoskeleton of filter-branch command, with option parser
Joey Hess [Fri, 14 May 2021 14:59:48 +0000 (10:59 -0400)]
skeleton of filter-branch command, with option parser

5 years agobranch
Joey Hess [Thu, 13 May 2021 20:18:35 +0000 (16:18 -0400)]
branch

5 years agogit-annex-filter-branch man page
Joey Hess [Thu, 13 May 2021 20:17:45 +0000 (16:17 -0400)]
git-annex-filter-branch man page

5 years agonew name for command
Joey Hess [Thu, 13 May 2021 20:07:30 +0000 (16:07 -0400)]
new name for command

5 years agoadd some functions listing log files
Joey Hess [Thu, 13 May 2021 18:57:38 +0000 (14:57 -0400)]
add some functions listing log files

Not used yet, will be used by copy-branch to generate the list of files
to copy.

5 years agorefactoring
Joey Hess [Thu, 13 May 2021 18:43:25 +0000 (14:43 -0400)]
refactoring

filterBranch should be reusable for copy-branch command.

Changed LogVariety to differentiate between LocationLog and UrlLog;
only location logs contain uuids and need to be filtered by uuid,
while url logs do not. This does not change current behavior,
but it will let filterBranch be reused without filtering url logs
incorrectly.

5 years agoalmost have a plan
Joey Hess [Thu, 13 May 2021 18:09:06 +0000 (14:09 -0400)]
almost have a plan

5 years agoadd configLog to otherLogs
Joey Hess [Thu, 13 May 2021 16:48:56 +0000 (12:48 -0400)]
add configLog to otherLogs

This oversight didn't cause any problems because the only place that
uses the information is dropDead, which handles Nothing the same as Just
OtherLog.

5 years agocomment
Joey Hess [Thu, 13 May 2021 16:05:24 +0000 (12:05 -0400)]
comment

5 years agoMerge branch 'master' of ssh://git-annex.branchable.com
Joey Hess [Thu, 13 May 2021 15:51:31 +0000 (11:51 -0400)]
Merge branch 'master' of ssh://git-annex.branchable.com

5 years agoAdded a comment
Atemu [Thu, 13 May 2021 10:26:53 +0000 (10:26 +0000)]
Added a comment

5 years agoset cwd rarher than changing current process directory
Joey Hess [Wed, 12 May 2021 21:44:22 +0000 (17:44 -0400)]
set cwd rarher than changing current process directory

This is not actually used in git-annex though.

5 years agoMerge branch 'master' of ssh://git-annex.branchable.com
Joey Hess [Wed, 12 May 2021 19:09:35 +0000 (15:09 -0400)]
Merge branch 'master' of ssh://git-annex.branchable.com

5 years agoassistant: Fix a crash on startup by avoiding using forkProcess
Joey Hess [Wed, 12 May 2021 19:08:03 +0000 (15:08 -0400)]
assistant: Fix a crash on startup by avoiding using forkProcess

ghc 8.8.4 seems to have changed something that broke code that has been
successfully using forkProcess since 2012. Likely a change to GC internals.

Since forkProcess has never had clear documentation about how to
use it safely, avoid using it at all. Instead, when git-annex needs to
daemonize itself, re-run the git-annex command, in a new process group
and session.

This commit was sponsored by Luke Shumaker on Patreon.

5 years agocomment
Joey Hess [Wed, 12 May 2021 17:39:15 +0000 (13:39 -0400)]
comment

5 years agoremoved
https://esgf-node.llnl.gov/esgf-idp/openid/tom_clune [Wed, 12 May 2021 16:44:38 +0000 (16:44 +0000)]
removed

5 years agoAdded a comment
https://esgf-node.llnl.gov/esgf-idp/openid/tom_clune [Wed, 12 May 2021 16:41:27 +0000 (16:41 +0000)]
Added a comment

5 years agoAdded a comment
https://esgf-node.llnl.gov/esgf-idp/openid/tom_clune [Wed, 12 May 2021 16:41:07 +0000 (16:41 +0000)]
Added a comment

5 years agoalready implemented
Joey Hess [Wed, 12 May 2021 16:24:55 +0000 (12:24 -0400)]
already implemented

5 years agocomment
Joey Hess [Wed, 12 May 2021 16:22:17 +0000 (12:22 -0400)]
comment

5 years agocomment
Joey Hess [Wed, 12 May 2021 15:38:35 +0000 (11:38 -0400)]
comment

5 years agocomment
Joey Hess [Wed, 12 May 2021 15:37:36 +0000 (11:37 -0400)]
comment

5 years agocomment
Joey Hess [Wed, 12 May 2021 15:24:55 +0000 (11:24 -0400)]
comment

5 years agoMerge branch 'master' of ssh://git-annex.branchable.com
Joey Hess [Wed, 12 May 2021 15:13:00 +0000 (11:13 -0400)]
Merge branch 'master' of ssh://git-annex.branchable.com

5 years agoremove inode cache in unannex
Joey Hess [Wed, 12 May 2021 15:09:38 +0000 (11:09 -0400)]
remove inode cache in unannex

Similar to what commit 675556fd9ae682ffcb034fdf454a15fe6e7da979 did for
adding a non-annexed file, this prevents the smudge clean filter
recognising the inode if git add is later run on the unannexed file.

5 years agoAdded a comment
Atemu [Wed, 12 May 2021 14:17:06 +0000 (14:17 +0000)]
Added a comment

5 years ago(no commit message)
Lukey [Tue, 11 May 2021 11:22:31 +0000 (11:22 +0000)]

5 years agoAdded a comment
Lukey [Tue, 11 May 2021 10:28:12 +0000 (10:28 +0000)]
Added a comment

5 years agoAdded a comment
Lukey [Tue, 11 May 2021 09:21:38 +0000 (09:21 +0000)]
Added a comment

5 years agoAdded a comment
Lukey [Tue, 11 May 2021 08:50:36 +0000 (08:50 +0000)]
Added a comment

5 years agoAdded a comment
Lukey [Tue, 11 May 2021 08:41:42 +0000 (08:41 +0000)]
Added a comment

5 years agoAdded a comment
Lukey [Tue, 11 May 2021 07:37:08 +0000 (07:37 +0000)]
Added a comment

5 years agoidea
Joey Hess [Mon, 10 May 2021 23:16:15 +0000 (19:16 -0400)]
idea

5 years agoAdded a comment
erics [Mon, 10 May 2021 22:06:02 +0000 (22:06 +0000)]
Added a comment

5 years agoAdded a comment: D'oh!
erics [Mon, 10 May 2021 21:26:25 +0000 (21:26 +0000)]
Added a comment: D'oh!

5 years agomention index mode explicitly
Joey Hess [Mon, 10 May 2021 19:21:23 +0000 (15:21 -0400)]
mention index mode explicitly

5 years agoMerge branch 'master' of ssh://git-annex.branchable.com
Joey Hess [Mon, 10 May 2021 19:20:08 +0000 (15:20 -0400)]
Merge branch 'master' of ssh://git-annex.branchable.com

5 years agocomment
Joey Hess [Mon, 10 May 2021 19:12:59 +0000 (15:12 -0400)]
comment

5 years agoAdded a comment
kyle [Mon, 10 May 2021 19:05:58 +0000 (19:05 +0000)]
Added a comment

5 years agoMerge branch 'master' of ssh://git-annex.branchable.com
Joey Hess [Mon, 10 May 2021 19:02:31 +0000 (15:02 -0400)]
Merge branch 'master' of ssh://git-annex.branchable.com

5 years agosplit out common options to its own page and mention it on each subcommand page
Joey Hess [Mon, 10 May 2021 19:00:13 +0000 (15:00 -0400)]
split out common options to its own page and mention it on each subcommand page

Sometimes users would get confused because an option they were looking
for was not mentioned on a subcommand's man page, and they had not
noticed that the main git-annex man page had a list of common options.
This change lets each subcommand mention the common options, similarly
to how the matching options are handled.

This commit was sponsored by Svenne Krap on Patreon.

5 years agocomment
Joey Hess [Mon, 10 May 2021 18:43:37 +0000 (14:43 -0400)]
comment

5 years agoadd test cases for git/annexed conversions
Joey Hess [Mon, 10 May 2021 18:19:24 +0000 (14:19 -0400)]
add test cases for git/annexed conversions

Make sure that tip keeps working.

I tried to go futher and touch the file and make sure it stayed what it
was converted to, but struggled with some weird and not entirely
reproducable behavior, so kept the tests simple for now.

5 years ago(no commit message)
erics [Mon, 10 May 2021 17:58:51 +0000 (17:58 +0000)]

5 years agosmudge: check for known annexed inodes before checking annex.largefiles
Joey Hess [Mon, 10 May 2021 17:05:08 +0000 (13:05 -0400)]
smudge: check for known annexed inodes before checking annex.largefiles

smudge: Fix a case where an unlocked annexed file that annex.largefiles
does not match could get its unchanged content checked into git, due to git
running the smudge filter unecessarily.

When the file has the same inodecache as an already annexed file,
we can assume that the user is not intending to change how it's stored in
git.

Note that checkunchangedgitfile already handled the inverse case, where the
file was added to git previously. That goes further and actually sha1
hashes the new file and checks if it's the same hash in the index.

It would be possible to generate a key for the file and see if it's the
same as the old key, however that could be considerably more expensive than
sha1 of a small file is, and it is not necessary for the case I have, at
least, where the file is not modified or touched, and so its inode will
match the cache.

git-annex add was changed, when adding a small file, to remove the inode
cache for it. This is necessary to keep the recipe in
doc/tips/largefiles.mdwn for converting from annex to git working.
It also avoids bugs/case_where_using_pathspec_with_git-commit_leaves_s.mdwn
which the earlier try at this change introduced.

5 years agocomment
Joey Hess [Mon, 10 May 2021 16:44:53 +0000 (12:44 -0400)]
comment

5 years agocomment
Joey Hess [Mon, 10 May 2021 16:42:56 +0000 (12:42 -0400)]
comment

5 years agoRevert "smudge: check for known annexed inodes before checking annex.largefiles"
Joey Hess [Mon, 10 May 2021 16:19:26 +0000 (12:19 -0400)]
Revert "smudge: check for known annexed inodes before checking annex.largefiles"

This reverts commit 424bef6b6f43ba9e09b61faa337fc6c9104e1a1f.

This commit caused other buggy behavior unfortunately.

5 years agomention --all on fsck man page, and repurpose todo
Joey Hess [Mon, 10 May 2021 15:11:50 +0000 (11:11 -0400)]
mention --all on fsck man page, and repurpose todo

5 years agocomment and close
Joey Hess [Mon, 10 May 2021 15:04:50 +0000 (11:04 -0400)]
comment and close

5 years agocomment
Joey Hess [Mon, 10 May 2021 14:48:44 +0000 (10:48 -0400)]
comment

5 years agocomment
Joey Hess [Mon, 10 May 2021 14:37:28 +0000 (10:37 -0400)]
comment

5 years agoAdded a comment
Atemu [Mon, 10 May 2021 14:13:55 +0000 (14:13 +0000)]
Added a comment

5 years agoAdded a comment
Lukey [Mon, 10 May 2021 12:21:37 +0000 (12:21 +0000)]
Added a comment

5 years ago(no commit message)
Atemu [Mon, 10 May 2021 11:01:43 +0000 (11:01 +0000)]

5 years ago(no commit message)
Atemu [Mon, 10 May 2021 10:53:12 +0000 (10:53 +0000)]

5 years ago(no commit message)
Atemu [Mon, 10 May 2021 10:26:45 +0000 (10:26 +0000)]

5 years agouser error, not a bug
Joey Hess [Mon, 10 May 2021 00:58:35 +0000 (20:58 -0400)]
user error, not a bug

5 years agobug report
Joey Hess [Mon, 10 May 2021 00:55:07 +0000 (20:55 -0400)]
bug report

5 years agoAdded a comment
strmd [Fri, 7 May 2021 20:00:08 +0000 (20:00 +0000)]
Added a comment

5 years agoAdded a comment: thanks
kyle [Fri, 7 May 2021 18:07:24 +0000 (18:07 +0000)]
Added a comment: thanks