git-annex.git
3 years agocomment
Joey Hess [Wed, 24 Aug 2022 19:17:43 +0000 (15:17 -0400)]
comment

3 years ago(no commit message)
hoegiflo@befdf51af27be5af346451fe32863dadb1d37ad5 [Wed, 24 Aug 2022 18:43:15 +0000 (18:43 +0000)]

3 years ago(no commit message)
hoegiflo@befdf51af27be5af346451fe32863dadb1d37ad5 [Wed, 24 Aug 2022 18:41:37 +0000 (18:41 +0000)]

3 years agoAdded a comment
yarikoptic [Wed, 24 Aug 2022 18:40:10 +0000 (18:40 +0000)]
Added a comment

3 years agoAdded a comment
yarikoptic [Wed, 24 Aug 2022 18:35:25 +0000 (18:35 +0000)]
Added a comment

3 years agoAdded a comment
yarikoptic [Wed, 24 Aug 2022 18:32:53 +0000 (18:32 +0000)]
Added a comment

3 years agocomment
Joey Hess [Wed, 24 Aug 2022 17:28:43 +0000 (13:28 -0400)]
comment

3 years agocomment
Joey Hess [Wed, 24 Aug 2022 17:26:42 +0000 (13:26 -0400)]
comment

3 years agocomment
Joey Hess [Wed, 24 Aug 2022 17:17:56 +0000 (13:17 -0400)]
comment

3 years agocomment
Joey Hess [Wed, 24 Aug 2022 17:13:45 +0000 (13:13 -0400)]
comment

3 years agocomment
Joey Hess [Wed, 24 Aug 2022 17:05:15 +0000 (13:05 -0400)]
comment

3 years agoAdded a comment
yarikoptic [Wed, 24 Aug 2022 15:42:10 +0000 (15:42 +0000)]
Added a comment

3 years agoadded "reproducer"
yarikoptic [Wed, 24 Aug 2022 15:25:33 +0000 (15:25 +0000)]
added "reproducer"

3 years agorequest add --batch to be able to handle directories
yarikoptic [Wed, 24 Aug 2022 15:12:19 +0000 (15:12 +0000)]
request add --batch to be able to handle directories

3 years agoadded suggestion to add clean-up after a testremote failure
Ilya_Shlyakhter [Wed, 24 Aug 2022 14:52:36 +0000 (14:52 +0000)]
added suggestion to add clean-up after a testremote failure

3 years agoadded bug report about a cryptic error message when copying to S3
Ilya_Shlyakhter [Wed, 24 Aug 2022 14:47:16 +0000 (14:47 +0000)]
added bug report about a cryptic error message when copying to S3

3 years agoAdded a comment: imports and symlinks
Ilya_Shlyakhter [Mon, 22 Aug 2022 20:40:42 +0000 (20:40 +0000)]
Added a comment: imports and symlinks

3 years agoAdded a comment
DavidD [Mon, 22 Aug 2022 17:54:19 +0000 (17:54 +0000)]
Added a comment

3 years agoremove old closed bugs and todo items to speed up wiki updates and reduce size
Joey Hess [Mon, 22 Aug 2022 16:27:10 +0000 (12:27 -0400)]
remove old closed bugs and todo items to speed up wiki updates and reduce size

Remove closed bugs and todos that were last edited or commented before 2021.

Except for ones tagged projects/* since projects like datalad want to keep
around records of old deleted bugs longer.

Command line used:

    for f in $(grep -l '|done\]\]' -- ./*.mdwn); do if ! grep -q "projects/" "$f"; then d="$(echo "$f" | sed 's/.mdwn$//')"; if [ -z "$(git log --since=01-01-2021 --pretty=oneline -- "$f")" -a -z "$(git log --since=01-01-2021 --pretty=oneline -- "$d")" ]; then git rm -- "./$f" ; git rm -rf "./$d"; fi; fi; done
    for f in $(grep -l '\[\[done\]\]' -- ./*.mdwn); do if ! grep -q "projects/" "$f"; then d="$(echo "$f" | sed 's/.mdwn$//')"; if [ -z "$(git log --since=01-01-2021 --pretty=oneline -- "$f")" -a -z "$(git log --since=01-01-2021 --pretty=oneline -- "$d")" ]; then git rm -- "./$f" ; git rm -rf "./$d"; fi; fi; done

3 years agoadd news item for git-annex 10.20220822
Joey Hess [Mon, 22 Aug 2022 16:08:24 +0000 (12:08 -0400)]
add news item for git-annex 10.20220822

3 years agoignore more cabal.project backup files
Joey Hess [Mon, 22 Aug 2022 16:03:27 +0000 (12:03 -0400)]
ignore more cabal.project backup files

3 years agoremove changelog entry about reverted stack.yaml change
Joey Hess [Mon, 22 Aug 2022 16:02:22 +0000 (12:02 -0400)]
remove changelog entry about reverted stack.yaml change

3 years agoprep release
Joey Hess [Mon, 22 Aug 2022 16:02:04 +0000 (12:02 -0400)]
prep release

3 years agoadd comment (and other old comment I forgot to add earlier)
Joey Hess [Mon, 22 Aug 2022 16:01:29 +0000 (12:01 -0400)]
add comment (and other old comment I forgot to add earlier)

3 years agocommet
Joey Hess [Mon, 22 Aug 2022 15:53:18 +0000 (11:53 -0400)]
commet

3 years agoMerge branch 'master' of ssh://git-annex.branchable.com
Joey Hess [Mon, 22 Aug 2022 15:50:21 +0000 (11:50 -0400)]
Merge branch 'master' of ssh://git-annex.branchable.com

3 years agoAdded a comment: adding checksums to WORM keys
Ilya_Shlyakhter [Sun, 21 Aug 2022 21:20:03 +0000 (21:20 +0000)]
Added a comment: adding checksums to WORM keys

3 years agoAdded a comment: addurl and authentication
Ilya_Shlyakhter [Sun, 21 Aug 2022 21:13:57 +0000 (21:13 +0000)]
Added a comment: addurl and authentication

3 years agoTypo fix unncessary -> unnecessary.
Yaroslav Halchenko [Fri, 19 Aug 2022 21:45:04 +0000 (17:45 -0400)]
Typo fix unncessary -> unnecessary.

Detected while reading recent CHANGELOG entry but then decided to apply
to entire codebase and docs since why not?

3 years agoAdded a comment: imports and symlinks
Ilya_Shlyakhter [Fri, 19 Aug 2022 20:19:50 +0000 (20:19 +0000)]
Added a comment: imports and symlinks

3 years agoAdded a comment
DavidD [Fri, 19 Aug 2022 20:07:49 +0000 (20:07 +0000)]
Added a comment

3 years agoAdded a comment
DavidD [Fri, 19 Aug 2022 19:42:55 +0000 (19:42 +0000)]
Added a comment

3 years agoMerge branch 'master' of ssh://git-annex.branchable.com
Joey Hess [Fri, 19 Aug 2022 17:45:19 +0000 (13:45 -0400)]
Merge branch 'master' of ssh://git-annex.branchable.com

3 years agoimport: Avoid following symbolic links inside directories being imported
Joey Hess [Fri, 19 Aug 2022 17:31:16 +0000 (13:31 -0400)]
import: Avoid following symbolic links inside directories being imported

Too big a footgun.

This does not prevent attackers who can write to the directory being
imported from racing the check. But they can cause anything to be imported
anyway, so would be limited to getting the legacy import to follow into a
directory they do not write to, and move files out of it into the annex.
(The directory special remote does not have that problem since it does not
move files.)

Sponsored-by: Jack Hill on Patreon
3 years agoAdded a comment: git-annex-import and symlinks
Ilya_Shlyakhter [Fri, 19 Aug 2022 17:18:37 +0000 (17:18 +0000)]
Added a comment: git-annex-import and symlinks

3 years agocomment
Joey Hess [Fri, 19 Aug 2022 17:06:38 +0000 (13:06 -0400)]
comment

3 years agocomment
Joey Hess [Fri, 19 Aug 2022 16:58:29 +0000 (12:58 -0400)]
comment

3 years agocomment
Joey Hess [Fri, 19 Aug 2022 16:56:51 +0000 (12:56 -0400)]
comment

3 years agofix git-annex add regression on deleted file
Joey Hess [Fri, 19 Aug 2022 16:49:17 +0000 (12:49 -0400)]
fix git-annex add regression on deleted file

Fix a regression in 10.20220624 that caused git-annex add to crash when
there was an unstaged deletion.

Sponsored-by: Dartmouth College's Datalad project
3 years agoAdded a comment
Atemu [Fri, 19 Aug 2022 14:23:27 +0000 (14:23 +0000)]
Added a comment

3 years agoAdded a comment: Option to not follow symlinks?
skcin [Thu, 18 Aug 2022 15:32:43 +0000 (15:32 +0000)]
Added a comment: Option to not follow symlinks?

3 years agoAdded a comment
Atemu [Thu, 18 Aug 2022 11:27:12 +0000 (11:27 +0000)]
Added a comment

3 years agoadded datalad project tag to the issue
yarikoptic [Wed, 17 Aug 2022 19:56:25 +0000 (19:56 +0000)]
added datalad project tag to the issue

3 years agoAdded a comment
yarikoptic [Wed, 17 Aug 2022 19:55:45 +0000 (19:55 +0000)]
Added a comment

3 years agoAdded a comment
DavidD [Wed, 17 Aug 2022 19:03:19 +0000 (19:03 +0000)]
Added a comment

3 years agoinitial report on getSymbolicLinkStatus crashing upon file removal
yarikoptic [Wed, 17 Aug 2022 18:46:27 +0000 (18:46 +0000)]
initial report on getSymbolicLinkStatus crashing upon file removal

3 years agoMerge branch 'master' of ssh://git-annex.branchable.com
Joey Hess [Wed, 17 Aug 2022 17:16:06 +0000 (13:16 -0400)]
Merge branch 'master' of ssh://git-annex.branchable.com

3 years agoinit: probe if sqlite works
Joey Hess [Wed, 17 Aug 2022 17:07:14 +0000 (13:07 -0400)]
init: probe if sqlite works

Help the user get annex.dbdir configured when their filesystem is not
one that sqlite works on.

The change in Database.Handle makes an error from sqlite not be ignored
besides being displayed, which it was before. I can't see any reason
git-annex would want to ignore these errors.

I chose to use the fsck database rather than the keys database because
opening the keys database populates it, and see commit
b3c4579c7907147a496bdf2c73b42238d8b239d6.

The placement of the call to checkSqliteWorks inside checkInitializeAllowed
avoids annex.uuid getting set before it's called.

Sponsored-by: Dartmouth College's Datalad project
3 years agoAdded a comment
account+annex@806a7c5f67b75d530bced4ea294c77681ebdf766 [Wed, 17 Aug 2022 16:59:17 +0000 (16:59 +0000)]
Added a comment

3 years agofixed in v10
Joey Hess [Wed, 17 Aug 2022 16:40:43 +0000 (12:40 -0400)]
fixed in v10

3 years ago(no commit message)
account+annex@806a7c5f67b75d530bced4ea294c77681ebdf766 [Wed, 17 Aug 2022 14:28:27 +0000 (14:28 +0000)]

3 years agocomment
Joey Hess [Tue, 16 Aug 2022 16:09:12 +0000 (12:09 -0400)]
comment

3 years agoAdded a comment
oliv5 [Tue, 16 Aug 2022 14:55:44 +0000 (14:55 +0000)]
Added a comment

4 years agoclose
Joey Hess [Mon, 15 Aug 2022 18:33:40 +0000 (14:33 -0400)]
close

4 years agocorrect documentation, keyid= only works once
Joey Hess [Mon, 15 Aug 2022 18:25:13 +0000 (14:25 -0400)]
correct documentation, keyid= only works once

keyid+= can be used to add additional key ids later.

I wonder if this broke with changes to remote configs? But I think it's
always been a map, and so only one keyid can be stored and later ones
overwrite earlier ones.

Sponsored-by: Brett Eisenberg on Patreon
4 years agocomment
Joey Hess [Mon, 15 Aug 2022 18:05:05 +0000 (14:05 -0400)]
comment

4 years agocomment
Joey Hess [Mon, 15 Aug 2022 16:39:19 +0000 (12:39 -0400)]
comment

4 years agomake it easier to use curl for unusual url schemes
Joey Hess [Mon, 15 Aug 2022 16:22:01 +0000 (12:22 -0400)]
make it easier to use curl for unusual url schemes

Use curl when annex.security.allowed-url-schemes includes an url scheme not
supported by git-annex internally, as long as
annex.security.allowed-ip-addresses is configured to allow using curl.

Sponsored-by: Luke Shumaker on Patreon
4 years ago(no commit message)
Atemu [Mon, 15 Aug 2022 10:50:59 +0000 (10:50 +0000)]

4 years ago(no commit message)
DavidD [Fri, 12 Aug 2022 18:33:35 +0000 (18:33 +0000)]

4 years agocomment about annex.dbdir on relevant bugs
Joey Hess [Fri, 12 Aug 2022 17:31:27 +0000 (13:31 -0400)]
comment about annex.dbdir on relevant bugs

4 years agouse a subdirectory of annex.dbdir
Joey Hess [Fri, 12 Aug 2022 17:18:15 +0000 (13:18 -0400)]
use a subdirectory of annex.dbdir

This allows annex.dbdir to be set globally or always set to the same
value when needed. Each repository uses a subdirectory of it.

Sponsored-by: Dartmouth College's Datalad project
4 years agocomment
Joey Hess [Fri, 12 Aug 2022 17:10:54 +0000 (13:10 -0400)]
comment

4 years agoMerge branch 'dbdir'
Joey Hess [Fri, 12 Aug 2022 17:07:12 +0000 (13:07 -0400)]
Merge branch 'dbdir'

4 years agoannex.dbdir fully working
Joey Hess [Fri, 12 Aug 2022 16:56:56 +0000 (12:56 -0400)]
annex.dbdir fully working

Completes work started in e60766543f0ae9eaa2ac8fdaff8fff5c66501beb

I've verified that all the sqlite databases get stored in annex.dbdir
and are created successfully. If annex.dbdir does not exist, it will be
created; its parent directory must already exist though.

Sponsored-by: Dartmouth College's Datalad project
4 years agoimprove createDirectoryUnder to allow alternate top directories
Joey Hess [Fri, 12 Aug 2022 16:45:46 +0000 (12:45 -0400)]
improve createDirectoryUnder to allow alternate top directories

This should not change the behavior of it, unless there are multiple top
directories, and then it should behave the same as if there was a single
top directory that was actually above the directory to be created.

Sponsored-by: Dartmouth College's Datalad project
4 years agocomment
Joey Hess [Thu, 11 Aug 2022 21:16:35 +0000 (17:16 -0400)]
comment

4 years agoadd annex.dbdir (WIP)
Joey Hess [Thu, 11 Aug 2022 20:57:44 +0000 (16:57 -0400)]
add annex.dbdir (WIP)

WIP: This is mostly complete, but there is a problem: createDirectoryUnder
throws an error when annex.dbdir is set to outside the git repo.

annex.dbdir is a workaround for filesystems where sqlite does not work,
due to eg, the filesystem not properly supporting locking.

It's intended to be set before initializing the repository. Changing it
in an existing repository can be done, but would be the same as making a
new repository and moving all the annexed objects into it. While the
databases get recreated from the git-annex branch in that situation, any
information that is in the databases but not stored in the branch gets
lost. It may be that no information ever gets stored in the databases
that cannot be reconstructed from the branch, but I have not verified
that.

Sponsored-by: Dartmouth College's Datalad project
4 years agocomment
Joey Hess [Thu, 11 Aug 2022 17:59:37 +0000 (13:59 -0400)]
comment

4 years agoMerge branch 'master' of ssh://git-annex.branchable.com
Joey Hess [Thu, 11 Aug 2022 17:54:02 +0000 (13:54 -0400)]
Merge branch 'master' of ssh://git-annex.branchable.com

4 years ago(no commit message)
atrent [Thu, 11 Aug 2022 12:45:59 +0000 (12:45 +0000)]

4 years agofix wording
Joey Hess [Wed, 10 Aug 2022 16:32:49 +0000 (12:32 -0400)]
fix wording

4 years agoclose
Joey Hess [Wed, 10 Aug 2022 16:29:29 +0000 (12:29 -0400)]
close

4 years agoAdded a comment
Atemu [Wed, 10 Aug 2022 12:35:28 +0000 (12:35 +0000)]
Added a comment

4 years agoAdded a comment
yarikoptic [Tue, 9 Aug 2022 19:12:40 +0000 (19:12 +0000)]
Added a comment

4 years agoAdded a comment
yarikoptic [Tue, 9 Aug 2022 18:02:32 +0000 (18:02 +0000)]
Added a comment

4 years agoAdded a comment
yarikoptic [Tue, 9 Aug 2022 18:02:08 +0000 (18:02 +0000)]
Added a comment

4 years agofix reversion
Joey Hess [Tue, 9 Aug 2022 17:46:43 +0000 (13:46 -0400)]
fix reversion

3a513cfe73ed873aeeabbc17d2c458b62dd4198c caused a reversion in addurl.
The type of addSmall changed, but the void prevented the type checker
from helping notice this. Since it now returns a CommandPerform, the
cleanup action has to be run.

Sponsored-by: Dartmouth College's Datalad project
4 years agocomment
Joey Hess [Tue, 9 Aug 2022 17:26:47 +0000 (13:26 -0400)]
comment

4 years agocomment
Joey Hess [Tue, 9 Aug 2022 17:21:58 +0000 (13:21 -0400)]
comment

4 years agocomment
Joey Hess [Tue, 9 Aug 2022 17:06:48 +0000 (13:06 -0400)]
comment

4 years agocomment
Joey Hess [Tue, 9 Aug 2022 16:33:24 +0000 (12:33 -0400)]
comment

4 years agoMerge branch 'master' of ssh://git-annex.branchable.com
Joey Hess [Tue, 9 Aug 2022 16:27:38 +0000 (12:27 -0400)]
Merge branch 'master' of ssh://git-annex.branchable.com

4 years agodon't force debuglocks flag on in Makefile
Joey Hess [Tue, 9 Aug 2022 14:43:07 +0000 (10:43 -0400)]
don't force debuglocks flag on in Makefile

Reverts a change accidentially committed in 09edb07ac5982edc8fe2987a8b477405fe9f982b

debuglocks is minimal cost, but there is some and this was an accidental
change

4 years agoAvoid running bup join concurrently with bup split
Joey Hess [Tue, 9 Aug 2022 14:40:45 +0000 (10:40 -0400)]
Avoid running bup join concurrently with bup split

On the bup mailing list, this was hypothesized as also being a
concurrency problem.

Sponsored-by: Svenne Krap on Patreon
4 years agoinitial report on possible regression due to --dry-run
yarikoptic [Tue, 9 Aug 2022 13:37:39 +0000 (13:37 +0000)]
initial report on possible regression due to --dry-run

4 years agoAdded a comment
Atemu [Tue, 9 Aug 2022 06:22:50 +0000 (06:22 +0000)]
Added a comment

4 years agoAdded a comment
Atemu [Tue, 9 Aug 2022 06:14:05 +0000 (06:14 +0000)]
Added a comment

4 years agoAdded a comment
rinomizu5@5ead4c82685c65d7717dbd5591b80425036ae9e3 [Tue, 9 Aug 2022 00:33:56 +0000 (00:33 +0000)]
Added a comment

4 years agoAvoid running multiple bup split processes concurrently
Joey Hess [Mon, 8 Aug 2022 22:54:06 +0000 (18:54 -0400)]
Avoid running multiple bup split processes concurrently

Since bup split is not concurrency safe.

Used a lock file so that 2 git-annex processes only run one bup split
between them (per bup repo).

(Concurrent writes from different git-annex repository clones to the same
bup repo could still have concurrency problems.)

Sponsored-by: Noam Kremen on Patreon
4 years agoavoid surprising "not found" error when copying to a http remote
Joey Hess [Mon, 8 Aug 2022 15:57:24 +0000 (11:57 -0400)]
avoid surprising "not found" error when copying to a http remote

git-annex copy --to a http remote will of course fail, as that's not
supported. But git-annex copy first checks if the content is already
present in the remote, and that threw a "not found".

Looks to me like other remotes that use Url.checkBoth in their checkPresent
do just return false when it fails. And Url.checkBoth does display
errors when unusual errors occur. So I'm pretty sure removing this error
message is ok.

Sponsored-by: Jarkko Kniivilä on Patreon
4 years agocomment
Joey Hess [Mon, 8 Aug 2022 15:26:25 +0000 (11:26 -0400)]
comment

4 years agocomment
Joey Hess [Mon, 8 Aug 2022 15:23:54 +0000 (11:23 -0400)]
comment

4 years agocomment
Joey Hess [Mon, 8 Aug 2022 15:15:04 +0000 (11:15 -0400)]
comment

4 years agoAdded a comment: Additional Questions: git annex copy failed
rinomizu5@5ead4c82685c65d7717dbd5591b80425036ae9e3 [Mon, 8 Aug 2022 10:31:26 +0000 (10:31 +0000)]
Added a comment: Additional Questions: git annex copy failed

4 years agoAdded a comment: Additional Questions: git annex copy failed
rinomizu5@5ead4c82685c65d7717dbd5591b80425036ae9e3 [Mon, 8 Aug 2022 10:31:04 +0000 (10:31 +0000)]
Added a comment: Additional Questions: git annex copy failed

4 years agoAdded a comment
aurelia@b44312a63326710de6cea9c43290e5debbd55607 [Sun, 7 Aug 2022 10:28:09 +0000 (10:28 +0000)]
Added a comment

4 years agoAdded a comment
Atemu [Sun, 7 Aug 2022 08:05:24 +0000 (08:05 +0000)]
Added a comment

4 years agoidea
Joey Hess [Fri, 5 Aug 2022 18:54:10 +0000 (14:54 -0400)]
idea

4 years agotag datalad since they have an issue about this
Joey Hess [Fri, 5 Aug 2022 18:48:21 +0000 (14:48 -0400)]
tag datalad since they have an issue about this