git-annex.git
5 years agocomment
Joey Hess [Wed, 12 May 2021 15:24:55 +0000 (11:24 -0400)]
comment

5 years agoMerge branch 'master' of ssh://git-annex.branchable.com
Joey Hess [Wed, 12 May 2021 15:13:00 +0000 (11:13 -0400)]
Merge branch 'master' of ssh://git-annex.branchable.com

5 years agoremove inode cache in unannex
Joey Hess [Wed, 12 May 2021 15:09:38 +0000 (11:09 -0400)]
remove inode cache in unannex

Similar to what commit 675556fd9ae682ffcb034fdf454a15fe6e7da979 did for
adding a non-annexed file, this prevents the smudge clean filter
recognising the inode if git add is later run on the unannexed file.

5 years agoAdded a comment
Atemu [Wed, 12 May 2021 14:17:06 +0000 (14:17 +0000)]
Added a comment

5 years ago(no commit message)
Lukey [Tue, 11 May 2021 11:22:31 +0000 (11:22 +0000)]

5 years agoAdded a comment
Lukey [Tue, 11 May 2021 10:28:12 +0000 (10:28 +0000)]
Added a comment

5 years agoAdded a comment
Lukey [Tue, 11 May 2021 09:21:38 +0000 (09:21 +0000)]
Added a comment

5 years agoAdded a comment
Lukey [Tue, 11 May 2021 08:50:36 +0000 (08:50 +0000)]
Added a comment

5 years agoAdded a comment
Lukey [Tue, 11 May 2021 08:41:42 +0000 (08:41 +0000)]
Added a comment

5 years agoAdded a comment
Lukey [Tue, 11 May 2021 07:37:08 +0000 (07:37 +0000)]
Added a comment

5 years agoidea
Joey Hess [Mon, 10 May 2021 23:16:15 +0000 (19:16 -0400)]
idea

5 years agoAdded a comment
erics [Mon, 10 May 2021 22:06:02 +0000 (22:06 +0000)]
Added a comment

5 years agoAdded a comment: D'oh!
erics [Mon, 10 May 2021 21:26:25 +0000 (21:26 +0000)]
Added a comment: D'oh!

5 years agomention index mode explicitly
Joey Hess [Mon, 10 May 2021 19:21:23 +0000 (15:21 -0400)]
mention index mode explicitly

5 years agoMerge branch 'master' of ssh://git-annex.branchable.com
Joey Hess [Mon, 10 May 2021 19:20:08 +0000 (15:20 -0400)]
Merge branch 'master' of ssh://git-annex.branchable.com

5 years agocomment
Joey Hess [Mon, 10 May 2021 19:12:59 +0000 (15:12 -0400)]
comment

5 years agoAdded a comment
kyle [Mon, 10 May 2021 19:05:58 +0000 (19:05 +0000)]
Added a comment

5 years agoMerge branch 'master' of ssh://git-annex.branchable.com
Joey Hess [Mon, 10 May 2021 19:02:31 +0000 (15:02 -0400)]
Merge branch 'master' of ssh://git-annex.branchable.com

5 years agosplit out common options to its own page and mention it on each subcommand page
Joey Hess [Mon, 10 May 2021 19:00:13 +0000 (15:00 -0400)]
split out common options to its own page and mention it on each subcommand page

Sometimes users would get confused because an option they were looking
for was not mentioned on a subcommand's man page, and they had not
noticed that the main git-annex man page had a list of common options.
This change lets each subcommand mention the common options, similarly
to how the matching options are handled.

This commit was sponsored by Svenne Krap on Patreon.

5 years agocomment
Joey Hess [Mon, 10 May 2021 18:43:37 +0000 (14:43 -0400)]
comment

5 years agoadd test cases for git/annexed conversions
Joey Hess [Mon, 10 May 2021 18:19:24 +0000 (14:19 -0400)]
add test cases for git/annexed conversions

Make sure that tip keeps working.

I tried to go futher and touch the file and make sure it stayed what it
was converted to, but struggled with some weird and not entirely
reproducable behavior, so kept the tests simple for now.

5 years ago(no commit message)
erics [Mon, 10 May 2021 17:58:51 +0000 (17:58 +0000)]

5 years agosmudge: check for known annexed inodes before checking annex.largefiles
Joey Hess [Mon, 10 May 2021 17:05:08 +0000 (13:05 -0400)]
smudge: check for known annexed inodes before checking annex.largefiles

smudge: Fix a case where an unlocked annexed file that annex.largefiles
does not match could get its unchanged content checked into git, due to git
running the smudge filter unecessarily.

When the file has the same inodecache as an already annexed file,
we can assume that the user is not intending to change how it's stored in
git.

Note that checkunchangedgitfile already handled the inverse case, where the
file was added to git previously. That goes further and actually sha1
hashes the new file and checks if it's the same hash in the index.

It would be possible to generate a key for the file and see if it's the
same as the old key, however that could be considerably more expensive than
sha1 of a small file is, and it is not necessary for the case I have, at
least, where the file is not modified or touched, and so its inode will
match the cache.

git-annex add was changed, when adding a small file, to remove the inode
cache for it. This is necessary to keep the recipe in
doc/tips/largefiles.mdwn for converting from annex to git working.
It also avoids bugs/case_where_using_pathspec_with_git-commit_leaves_s.mdwn
which the earlier try at this change introduced.

5 years agocomment
Joey Hess [Mon, 10 May 2021 16:44:53 +0000 (12:44 -0400)]
comment

5 years agocomment
Joey Hess [Mon, 10 May 2021 16:42:56 +0000 (12:42 -0400)]
comment

5 years agoRevert "smudge: check for known annexed inodes before checking annex.largefiles"
Joey Hess [Mon, 10 May 2021 16:19:26 +0000 (12:19 -0400)]
Revert "smudge: check for known annexed inodes before checking annex.largefiles"

This reverts commit 424bef6b6f43ba9e09b61faa337fc6c9104e1a1f.

This commit caused other buggy behavior unfortunately.

5 years agomention --all on fsck man page, and repurpose todo
Joey Hess [Mon, 10 May 2021 15:11:50 +0000 (11:11 -0400)]
mention --all on fsck man page, and repurpose todo

5 years agocomment and close
Joey Hess [Mon, 10 May 2021 15:04:50 +0000 (11:04 -0400)]
comment and close

5 years agocomment
Joey Hess [Mon, 10 May 2021 14:48:44 +0000 (10:48 -0400)]
comment

5 years agocomment
Joey Hess [Mon, 10 May 2021 14:37:28 +0000 (10:37 -0400)]
comment

5 years agoAdded a comment
Atemu [Mon, 10 May 2021 14:13:55 +0000 (14:13 +0000)]
Added a comment

5 years agoAdded a comment
Lukey [Mon, 10 May 2021 12:21:37 +0000 (12:21 +0000)]
Added a comment

5 years ago(no commit message)
Atemu [Mon, 10 May 2021 11:01:43 +0000 (11:01 +0000)]

5 years ago(no commit message)
Atemu [Mon, 10 May 2021 10:53:12 +0000 (10:53 +0000)]

5 years ago(no commit message)
Atemu [Mon, 10 May 2021 10:26:45 +0000 (10:26 +0000)]

5 years agouser error, not a bug
Joey Hess [Mon, 10 May 2021 00:58:35 +0000 (20:58 -0400)]
user error, not a bug

5 years agobug report
Joey Hess [Mon, 10 May 2021 00:55:07 +0000 (20:55 -0400)]
bug report

5 years agoAdded a comment
strmd [Fri, 7 May 2021 20:00:08 +0000 (20:00 +0000)]
Added a comment

5 years agoAdded a comment: thanks
kyle [Fri, 7 May 2021 18:07:24 +0000 (18:07 +0000)]
Added a comment: thanks

5 years agoreinject: Error out when run on a file that is not annexed
Joey Hess [Fri, 7 May 2021 17:31:03 +0000 (13:31 -0400)]
reinject: Error out when run on a file that is not annexed

rather than silently skipping it

5 years agofileRef: make paths relative and simplified
Joey Hess [Fri, 7 May 2021 17:25:59 +0000 (13:25 -0400)]
fileRef: make paths relative and simplified

Fix behavior of several commands, including reinject, addurl, and rmurl
when given an absolute path to an unlocked file, or a relative path that
leaves and re-enters the repository.

To avoid slowing down all the cases where the paths are already ok
with an unncessary call to getCurrentDirectory, put in an optimisation
in relPathCwdToFile. That will probably also speed up other parts of
git-annex by some small amount, but I have not benchmarked.

Note that I did not convert branchFileRef, because it seems likely that
it will be used with a file that is not provided by the user, so is already
in a sane format. This is certainly true for the way git-annex uses it,
though maybe arguable to the extent Git.Ref is a reusable library.

5 years agocomment
Joey Hess [Fri, 7 May 2021 17:13:48 +0000 (13:13 -0400)]
comment

5 years agodocument an important property of relPathCwdToFile
Joey Hess [Fri, 7 May 2021 16:57:54 +0000 (12:57 -0400)]
document an important property of relPathCwdToFile

5 years agoMerge branch 'master' of ssh://git-annex.branchable.com
Joey Hess [Fri, 7 May 2021 15:44:58 +0000 (11:44 -0400)]
Merge branch 'master' of ssh://git-annex.branchable.com

5 years agopatch review
Joey Hess [Fri, 7 May 2021 15:44:30 +0000 (11:44 -0400)]
patch review

5 years agoAdded a comment: different keys for the same content
Ilya_Shlyakhter [Fri, 7 May 2021 15:37:46 +0000 (15:37 +0000)]
Added a comment: different keys for the same content

5 years agoremove now redundant -O0
Joey Hess [Fri, 7 May 2021 15:25:34 +0000 (11:25 -0400)]
remove now redundant -O0

That is now enabled by -f-Production, since commit
cab398c945d6e7a890fa64071d37ddbabaaf6619

5 years agoMerge remote-tracking branch 'atemu/misc-fixes'
Joey Hess [Fri, 7 May 2021 15:23:54 +0000 (11:23 -0400)]
Merge remote-tracking branch 'atemu/misc-fixes'

5 years agoapplied patch
Joey Hess [Fri, 7 May 2021 15:11:10 +0000 (11:11 -0400)]
applied patch

5 years agofromkey: create directory for pointer files too
Kyle Meyer [Thu, 6 May 2021 15:11:14 +0000 (11:11 -0400)]
fromkey: create directory for pointer files too

fromkey creates leading directories for symbolic links.  Do the same
for pointer files.

5 years agoMerge branch 'master' of ssh://git-annex.branchable.com
Joey Hess [Fri, 7 May 2021 15:09:21 +0000 (11:09 -0400)]
Merge branch 'master' of ssh://git-annex.branchable.com

5 years agoreinject: silent failure with absolute path to pointer file
kyle [Thu, 6 May 2021 19:26:52 +0000 (19:26 +0000)]
reinject: silent failure with absolute path to pointer file

5 years agopatch: fromkey: create directory for pointer files too
kyle [Thu, 6 May 2021 15:23:07 +0000 (15:23 +0000)]
patch: fromkey: create directory for pointer files too

5 years agoAdded a comment
pat [Wed, 5 May 2021 22:51:29 +0000 (22:51 +0000)]
Added a comment

5 years agoupdate
Joey Hess [Wed, 5 May 2021 21:30:35 +0000 (17:30 -0400)]
update

5 years agoAdded a comment
pat [Wed, 5 May 2021 19:39:12 +0000 (19:39 +0000)]
Added a comment

5 years ago(no commit message)
pat [Wed, 5 May 2021 19:06:19 +0000 (19:06 +0000)]

5 years agoAdded a comment
Lukey [Wed, 5 May 2021 18:08:49 +0000 (18:08 +0000)]
Added a comment

5 years ago(no commit message)
https://esgf-node.llnl.gov/esgf-idp/openid/tom_clune [Wed, 5 May 2021 16:31:32 +0000 (16:31 +0000)]

5 years ago(no commit message)
Atemu [Wed, 5 May 2021 08:52:28 +0000 (08:52 +0000)]

5 years agoAdded a comment
Atemu [Wed, 5 May 2021 07:33:07 +0000 (07:33 +0000)]
Added a comment

5 years ago(no commit message)
Atemu [Wed, 5 May 2021 06:11:51 +0000 (06:11 +0000)]

5 years agoAdded a comment
Atemu [Wed, 5 May 2021 06:04:49 +0000 (06:04 +0000)]
Added a comment

5 years agoCabal: Use -O0 for development builds
Atemu [Wed, 5 May 2021 05:30:30 +0000 (07:30 +0200)]
Cabal: Use -O0 for development builds

Can be configured with `--flags=-production`

Time for full build on my machine: 2m -> 45s

5 years agoAdded a comment
Atemu [Wed, 5 May 2021 05:43:56 +0000 (05:43 +0000)]
Added a comment

5 years ago(no commit message)
pat [Wed, 5 May 2021 02:51:47 +0000 (02:51 +0000)]

5 years agogit-commit pathspec change due to 424bef6b6
kyle [Tue, 4 May 2021 21:43:41 +0000 (21:43 +0000)]
git-commit pathspec change due to 424bef6b6

5 years agoAdded a comment
cecile.madjar@d95f9e618c3dff4829e7fedba1a71e1499542f3f [Tue, 4 May 2021 21:12:52 +0000 (21:12 +0000)]
Added a comment

5 years agoAdded a comment
Lukey [Tue, 4 May 2021 20:38:01 +0000 (20:38 +0000)]
Added a comment

5 years agoAdded a comment
Lukey [Tue, 4 May 2021 20:31:45 +0000 (20:31 +0000)]
Added a comment

5 years agoAdded a comment
cecile.madjar@d95f9e618c3dff4829e7fedba1a71e1499542f3f [Tue, 4 May 2021 20:24:51 +0000 (20:24 +0000)]
Added a comment

5 years agoremoved
yarikoptic [Tue, 4 May 2021 19:57:53 +0000 (19:57 +0000)]
removed

5 years agoAdded a comment
fortran [Tue, 4 May 2021 19:25:47 +0000 (19:25 +0000)]
Added a comment

5 years agoAdded a comment
fortran [Tue, 4 May 2021 19:10:35 +0000 (19:10 +0000)]
Added a comment

5 years agoAdded a comment
yarikoptic [Tue, 4 May 2021 17:51:09 +0000 (17:51 +0000)]
Added a comment

5 years agoAdded a comment
yarikoptic [Tue, 4 May 2021 17:50:45 +0000 (17:50 +0000)]
Added a comment

5 years agoAdded a comment
Atemu [Tue, 4 May 2021 17:37:04 +0000 (17:37 +0000)]
Added a comment

5 years agoAdded a comment
Atemu [Tue, 4 May 2021 17:19:57 +0000 (17:19 +0000)]
Added a comment

5 years agoAdded a comment
yarikoptic [Tue, 4 May 2021 16:53:18 +0000 (16:53 +0000)]
Added a comment

5 years agocomment
Joey Hess [Tue, 4 May 2021 15:13:50 +0000 (11:13 -0400)]
comment

5 years agocomment
Joey Hess [Tue, 4 May 2021 14:56:27 +0000 (10:56 -0400)]
comment

5 years agoresponse
Joey Hess [Tue, 4 May 2021 14:31:53 +0000 (10:31 -0400)]
response

5 years agocomment and todo
Joey Hess [Tue, 4 May 2021 14:14:53 +0000 (10:14 -0400)]
comment and todo

5 years agoremove my comment as someone else already answered it well
Joey Hess [Tue, 4 May 2021 13:52:50 +0000 (09:52 -0400)]
remove my comment as someone else already answered it well

5 years agoresponse
Joey Hess [Tue, 4 May 2021 13:52:23 +0000 (09:52 -0400)]
response

5 years agoAdded a comment
Lukey [Tue, 4 May 2021 13:42:34 +0000 (13:42 +0000)]
Added a comment

5 years ago(no commit message)
fortran [Tue, 4 May 2021 12:56:53 +0000 (12:56 +0000)]

5 years agoAdded a comment
Atemu [Tue, 4 May 2021 12:46:59 +0000 (12:46 +0000)]
Added a comment

5 years agoCommand/Multicast: use proper hyphen
Atemu [Tue, 4 May 2021 03:44:31 +0000 (05:44 +0200)]
Command/Multicast: use proper hyphen

GHC was complaining about it possibly being a homoglyph:

Command/Multicast.hs:111:36: error:
     warning: treating Unicode character <U+2212> as identifier character rather than as '-' symbol [-Wunicode-homoglyph]
            -- using a nice prime, namely 2521−1  but the sheer size of this
                                              ^
    |
111 |         -- using a nice prime, namely 2521−1  but the sheer size of this
    |                                    ^
1 warning generated.

5 years ago(no commit message)
Atemu [Tue, 4 May 2021 02:43:14 +0000 (02:43 +0000)]

5 years agofix test that broke due to fromkey improvements
Joey Hess [Mon, 3 May 2021 17:37:30 +0000 (13:37 -0400)]
fix test that broke due to fromkey improvements

4588668a12f4f9b43cd6875b8ff45d7f3f6ffb1a made fromkey honor adjusted
unlocked branches. Also, it can be used on a crippled filesystem now.

5 years agosmudge: check for known annexed inodes before checking annex.largefiles
Joey Hess [Mon, 3 May 2021 17:23:19 +0000 (13:23 -0400)]
smudge: check for known annexed inodes before checking annex.largefiles

smudge: Fix a case where an unlocked annexed file that annex.largefiles
does not match could get its unchanged content checked into git, due to git
running the smudge filter unecessarily.

When the file has the same inodecache as an already annexed file,
we can assume that the user is not intending to change how it's stored in
git.

Note that checkunchangedgitfile already handled the inverse case, where the
file was added to git previously. That goes further and actually sha1
hashes the new file and checks if it's the same hash in the index.

It would be possible to generate a key for the file and see if it's the
same as the old key, however that could be considerably more expensive than
sha1 of a small file is, and it is not necessary for the case I have, at
least, where the file is not modified or touched, and so its inode will
match the cache.

5 years agoclose
Joey Hess [Mon, 3 May 2021 16:24:06 +0000 (12:24 -0400)]
close

5 years agoMerge branch 'master' of ssh://git-annex.branchable.com
Joey Hess [Mon, 3 May 2021 16:12:07 +0000 (12:12 -0400)]
Merge branch 'master' of ssh://git-annex.branchable.com

5 years agoAdded a comment
ijc@c69abafeb65fa2e784811fc549e9976a5cf4b903 [Mon, 3 May 2021 15:45:14 +0000 (15:45 +0000)]
Added a comment

5 years agofromkey unlocked files support
Joey Hess [Mon, 3 May 2021 15:26:18 +0000 (11:26 -0400)]
fromkey unlocked files support

fromkey: Create an unlocked file when used in an adjusted branch where the
file should be unlocked, or when configured by annex.addunlocked.

There is some overlap with code in Annex.Ingest, however it's not quite the
same because ingesting has a temp file with the content, where here the
content, if any, is in the annex object file. So it eg, makes sense for
Annex.Ingest to copy the execute mode of the content file, but it does not make
sense for fromkey to do that.

Also changed in passing to stage the file in git directly, rather than
using git add. One consequence of that is that if the file is gitignored,
it will still get added, rather than the old behavior:

The following paths are ignored by one of your .gitignore files:
ignored
hint: Use -f if you really want to add them.
hint: Turn this message off by running
hint: "git config advice.addIgnoredFile false"
git-annex: user error (xargs ["-0","git","--git-dir=.git","--work-tree=.","--literal-pathspecs","add","--"] exited 123)

That old behavior was a surprise to me, and so I consider it a bug, and doubt
anyone would have relied on it.

Note that, when on an --hide-missing branch, it is possible to fromkey a key
that is not present (needs --force). The annex link or pointer file still gets
written in this case. It doesn't seem to make any sense not to write it,
because then fromkey would not do anything useful in this case, and this way
the file can be committed and synced to master, and the branch re-adjusted to
hide the new missing file.

This commit was sponsored by Noam Kremen on Patreon.

5 years agoMerge branch 'master' of ssh://git-annex.branchable.com
Joey Hess [Mon, 3 May 2021 14:29:44 +0000 (10:29 -0400)]
Merge branch 'master' of ssh://git-annex.branchable.com

5 years ago(no commit message)
Lukey [Mon, 3 May 2021 13:01:54 +0000 (13:01 +0000)]

5 years agoAdded a comment
Lukey [Mon, 3 May 2021 12:33:32 +0000 (12:33 +0000)]
Added a comment

5 years agoremoved
Lukey [Mon, 3 May 2021 12:31:03 +0000 (12:31 +0000)]
removed