git-annex.git
9 years agodevblog
Joey Hess [Wed, 7 Dec 2016 19:50:54 +0000 (15:50 -0400)]
devblog

9 years agotodo
Joey Hess [Wed, 7 Dec 2016 19:49:15 +0000 (15:49 -0400)]
todo

9 years agoadd page for tor special remote
Joey Hess [Wed, 7 Dec 2016 19:44:18 +0000 (15:44 -0400)]
add page for tor special remote

9 years agoupdate
Joey Hess [Wed, 7 Dec 2016 19:38:37 +0000 (15:38 -0400)]
update

9 years agofix math error that caused resumes to always fail
Joey Hess [Wed, 7 Dec 2016 19:36:39 +0000 (15:36 -0400)]
fix math error that caused resumes to always fail

9 years agoReadWriteMode not AppendMode
Joey Hess [Wed, 7 Dec 2016 19:24:28 +0000 (15:24 -0400)]
ReadWriteMode not AppendMode

AppendMode does not allow seeking..

9 years agoadd section on tor speed
Joey Hess [Wed, 7 Dec 2016 19:21:38 +0000 (15:21 -0400)]
add section on tor speed

9 years agoopen file for append, not write, so resuming works
Joey Hess [Wed, 7 Dec 2016 19:06:07 +0000 (15:06 -0400)]
open file for append, not write, so resuming works

WriteMode zeros any existing content, so the seek filled with zeros, and
verification failed after download.

9 years agooffset meters when resuming
Joey Hess [Wed, 7 Dec 2016 18:52:10 +0000 (14:52 -0400)]
offset meters when resuming

9 years agotodo
Joey Hess [Wed, 7 Dec 2016 18:46:27 +0000 (14:46 -0400)]
todo

9 years agoMerge branch 'master' into tor
Joey Hess [Wed, 7 Dec 2016 18:32:25 +0000 (14:32 -0400)]
Merge branch 'master' into tor

9 years agomore p2p progress meters
Joey Hess [Wed, 7 Dec 2016 18:25:01 +0000 (14:25 -0400)]
more p2p progress meters

Display progress meter on send and receive from remote.

Added a new hGetMetered that can read an exact number of bytes (or
less), updating a meter as it goes.

This commit was sponsored by Andreas on Patreon.

9 years agoadd section on security
Joey Hess [Wed, 7 Dec 2016 17:58:10 +0000 (13:58 -0400)]
add section on security

9 years agoupdate progress meter when sending to p2p remote
Joey Hess [Wed, 7 Dec 2016 17:37:35 +0000 (13:37 -0400)]
update progress meter when sending to p2p remote

This commit was sponsored by Thom May on Patreon.

9 years agoupdate
Joey Hess [Wed, 7 Dec 2016 16:48:24 +0000 (12:48 -0400)]
update

9 years agovalidate peer uuid each time we talk to it
Joey Hess [Wed, 7 Dec 2016 16:39:28 +0000 (12:39 -0400)]
validate peer uuid each time we talk to it

In case the repo on the peer changes uuid (eg by a new repo being moved
into place).

Also, added some warning messages when unable to communicate with a
peer.

This commit was sponsored by Anthony DeRobertis on Patreon.

9 years agoremote uuid discovery in p2p --link
Joey Hess [Wed, 7 Dec 2016 16:38:21 +0000 (12:38 -0400)]
remote uuid discovery in p2p --link

This also tests that we can connect to the peer.

This commit was sponsored by Jeff Goeke-Smith on Patreon.

9 years agoadd todo list for remaining tor stuff
Joey Hess [Wed, 7 Dec 2016 16:11:38 +0000 (12:11 -0400)]
add todo list for remaining tor stuff

9 years agofix up some commands
Joey Hess [Wed, 7 Dec 2016 16:00:27 +0000 (12:00 -0400)]
fix up some commands

9 years agodevbog
Joey Hess [Tue, 6 Dec 2016 21:08:39 +0000 (17:08 -0400)]
devbog

9 years agoPAKE
Joey Hess [Tue, 6 Dec 2016 20:55:53 +0000 (16:55 -0400)]
PAKE

9 years agoneed to auth with the peer
Joey Hess [Tue, 6 Dec 2016 19:49:39 +0000 (15:49 -0400)]
need to auth with the peer

9 years agorefactor
Joey Hess [Tue, 6 Dec 2016 19:40:31 +0000 (15:40 -0400)]
refactor

9 years agofinish implementation of Remote.P2P (untested)
Joey Hess [Tue, 6 Dec 2016 19:08:00 +0000 (15:08 -0400)]
finish implementation of Remote.P2P (untested)

Not tested at all, but it just might work.
Only known problem is that progress is not updated when storing to a P2P
remote.

This commit was sponsored by Nick Daly on Patreon.

9 years agoadded StoreContentTo
Joey Hess [Tue, 6 Dec 2016 19:05:44 +0000 (15:05 -0400)]
added StoreContentTo

This is needed in addition to StoreContent, because retrieveKeyFile can
be used to retrieve to different destination files, not only the tmp
file for a key.

This commit was sponsored by Ole-Morten Duesund on Patreon.

9 years agostub Remote.P2P
Joey Hess [Tue, 6 Dec 2016 16:19:47 +0000 (12:19 -0400)]
stub Remote.P2P

Similar to GCrypt remotes, P2P remotes have an url, so Remote.Git has to
separate them out and handle them, passing off to Remote.P2P.

This commit was sponsored by Ignacio on Patreon.

9 years ago(no commit message)
0xloem@0bd8a79a57e4f0dcade8fc81d162c37eae4d6730 [Tue, 6 Dec 2016 14:59:40 +0000 (14:59 +0000)]

9 years ago(no commit message)
0xloem@0bd8a79a57e4f0dcade8fc81d162c37eae4d6730 [Tue, 6 Dec 2016 13:56:13 +0000 (13:56 +0000)]

9 years ago(no commit message)
0xloem@0bd8a79a57e4f0dcade8fc81d162c37eae4d6730 [Tue, 6 Dec 2016 13:03:51 +0000 (13:03 +0000)]

9 years ago(no commit message)
0xloem@0bd8a79a57e4f0dcade8fc81d162c37eae4d6730 [Tue, 6 Dec 2016 13:01:51 +0000 (13:01 +0000)]

9 years ago(no commit message)
alpernebbi [Mon, 5 Dec 2016 21:55:55 +0000 (21:55 +0000)]

9 years agoAdded a comment: UTF-8 problems in some other commands
alpernebbi [Mon, 5 Dec 2016 20:46:07 +0000 (20:46 +0000)]
Added a comment: UTF-8 problems in some other commands

9 years ago(no commit message)
alpernebbi [Mon, 5 Dec 2016 19:34:55 +0000 (19:34 +0000)]

9 years agoadd: Stage modified non-large files when running in indirect mode.
Joey Hess [Mon, 5 Dec 2016 18:02:11 +0000 (14:02 -0400)]
add: Stage modified non-large files when running in indirect mode.

(This was already done in v6 mode and direct mode.)

9 years agofix formatting
Joey Hess [Mon, 5 Dec 2016 17:52:40 +0000 (13:52 -0400)]
fix formatting

mdwn2man gets confused as `command` spanning multiple lines..

9 years agorekey: Added --batch mode.
Joey Hess [Mon, 5 Dec 2016 16:55:50 +0000 (12:55 -0400)]
rekey: Added --batch mode.

Would have liked to make the Parser parse the file and key pairs, but it
seems that optparse-applicative is unable to handle eg:

many ((,) <$> argument <*> argument)

This commit was sponsored by Thomas Hochstein on Patreon.

9 years agochangelog
Joey Hess [Mon, 5 Dec 2016 16:16:35 +0000 (12:16 -0400)]
changelog

9 years agominor style
Joey Hess [Mon, 5 Dec 2016 16:16:07 +0000 (12:16 -0400)]
minor style

9 years agoMerge kite:tmp/git-annex
Joey Hess [Mon, 5 Dec 2016 16:15:48 +0000 (12:15 -0400)]
Merge kite:tmp/git-annex

9 years agocleanup
Joey Hess [Mon, 5 Dec 2016 16:13:25 +0000 (12:13 -0400)]
cleanup

9 years agormurl: --batch
Joey Hess [Mon, 5 Dec 2016 16:10:07 +0000 (12:10 -0400)]
rmurl: --batch

* rmurl: Multiple pairs of files and urls can be provided on the
  command line.
* rmurl: Added --batch mode.

This commit was sponsored by Trenton Cronholm on Patreon.

9 years agogit-annex fromkey now takes multiple pairs of keys and filenames
Daniel Brooks [Mon, 5 Dec 2016 14:59:20 +0000 (09:59 -0500)]
git-annex fromkey now takes multiple pairs of keys and filenames

It also still reads from stdin when none are specified.

9 years ago"fixed" by reading --help
https://me.yahoo.com/a/EbvxpTI_xP9Aod7Mg4cwGhgjrCrdM5s-#7c0f4 [Sun, 4 Dec 2016 16:20:00 +0000 (16:20 +0000)]
"fixed" by reading --help

9 years agoadded forgotten author tag
https://me.yahoo.com/a/EbvxpTI_xP9Aod7Mg4cwGhgjrCrdM5s-#7c0f4 [Sun, 4 Dec 2016 15:54:32 +0000 (15:54 +0000)]
added forgotten author tag

9 years agoinitial report
https://me.yahoo.com/a/EbvxpTI_xP9Aod7Mg4cwGhgjrCrdM5s-#7c0f4 [Sun, 4 Dec 2016 15:52:29 +0000 (15:52 +0000)]
initial report

9 years ago(no commit message)
marek@33e8ba4fbc201af14a2badcc0656024401f5c916 [Sun, 4 Dec 2016 15:28:41 +0000 (15:28 +0000)]

9 years agoAdded a comment
justin.lebar@7a36fcafc322d9a381e89f08ab6289033c6dde91 [Sun, 4 Dec 2016 04:30:38 +0000 (04:30 +0000)]
Added a comment

9 years agouse list
Joey Hess [Sat, 3 Dec 2016 20:52:18 +0000 (16:52 -0400)]
use list

9 years agoupdate
Joey Hess [Sat, 3 Dec 2016 20:51:16 +0000 (16:51 -0400)]
update

9 years agoMerge branch 'master' of ssh://git-annex.branchable.com
Joey Hess [Sat, 3 Dec 2016 20:32:42 +0000 (16:32 -0400)]
Merge branch 'master' of ssh://git-annex.branchable.com

9 years agobreak out curent list of names into its own file so I can auto-add from patreon
Joey Hess [Sat, 3 Dec 2016 20:30:48 +0000 (16:30 -0400)]
break out curent list of names into its own file so I can auto-add from patreon

and some misc updates

9 years ago(no commit message)
lorenzo@a77fdbe826df1c175cbd30ed050312ccf7b7fc7b [Sat, 3 Dec 2016 09:04:45 +0000 (09:04 +0000)]

9 years agoplumb assicated files through P2P protocol for updating transfer logs
Joey Hess [Fri, 2 Dec 2016 20:39:01 +0000 (16:39 -0400)]
plumb assicated files through P2P protocol for updating transfer logs

ReadContent can't update the log, since it reads lazily. This part of
the P2P monad will need to be rethought.

Associated files are heavily sanitized when received from a peer;
they could be an exploit vector.

This commit was sponsored by Jochen Bartl on Patreon.

9 years agoplumb peer uuid through to runLocal
Joey Hess [Fri, 2 Dec 2016 19:34:15 +0000 (15:34 -0400)]
plumb peer uuid through to runLocal

This will allow updating transfer logs with the uuid.

9 years agoinitial implementation of P2P.Annex runner
Joey Hess [Fri, 2 Dec 2016 18:49:22 +0000 (14:49 -0400)]
initial implementation of P2P.Annex runner

Untested, and it does not yet update transfer logs.

Verifying transferred content is modeled on git-annex-shell recvkey.
In a direct mode or annex.thin repository, content can change while it's
being transferred. So, verification is always done, even if annex.verify
would normally prevent it.

Note that a WORM or URL key could change in a way the verification
doesn't catch. That can happen in git-annex-shell recvkey too. We don't
worry about it, because those key backends don't guarantee preservation
of data. (Which is to say, I worried about it, and then convinced myself
again it was ok.)

9 years agocatch non-IO exceptions too
Joey Hess [Fri, 2 Dec 2016 18:16:50 +0000 (14:16 -0400)]
catch non-IO exceptions too

9 years agomake remote-daemon able to send and receive objects over tor
Joey Hess [Fri, 2 Dec 2016 17:50:56 +0000 (13:50 -0400)]
make remote-daemon able to send and receive objects over tor

Each worker thread needs to run in the Annex monad, but the
remote-daemon's liftAnnex can only run 1 action at a time. Used
Annex.Concurrent to deal with that.

P2P.Annex is incomplete as of yet.

9 years agoimprove Local monad
Joey Hess [Fri, 2 Dec 2016 17:47:42 +0000 (13:47 -0400)]
improve Local monad

9 years agomake sure that the specified number of bytes of DATA are always sent
Joey Hess [Fri, 2 Dec 2016 17:45:45 +0000 (13:45 -0400)]
make sure that the specified number of bytes of DATA are always sent

It's possible, in direct or thin mode, that an object file gets
truncated or appended to as it's being sent. This would break the
protocol badly, so make sure never to send too many bytes, and to
close the protocol connection if too few bytes are available.

9 years ago(no commit message)
https://openid.stackexchange.com/user/3ee5cf54-f022-4a71-8666-3c2b5ee231dd [Thu, 1 Dec 2016 18:54:57 +0000 (18:54 +0000)]

9 years ago(no commit message)
https://openid.stackexchange.com/user/3ee5cf54-f022-4a71-8666-3c2b5ee231dd [Thu, 1 Dec 2016 18:54:24 +0000 (18:54 +0000)]

9 years agourk
Joey Hess [Thu, 1 Dec 2016 16:17:31 +0000 (12:17 -0400)]
urk

test failures were being ignored for complex reasons, new autobuilder broke that; bring it back

9 years agoMerge branch 'master' of ssh://git-annex.branchable.com
Joey Hess [Thu, 1 Dec 2016 16:08:20 +0000 (12:08 -0400)]
Merge branch 'master' of ssh://git-annex.branchable.com

9 years agochange link to windows autobuild page
Joey Hess [Thu, 1 Dec 2016 16:07:21 +0000 (12:07 -0400)]
change link to windows autobuild page

9 years agoRemove obsolete link to Windows build logs
Yury V. Zaytsev [Wed, 30 Nov 2016 18:37:32 +0000 (19:37 +0100)]
Remove obsolete link to Windows build logs

9 years agoAdd initial Jenkins pipeline script
Yury V. Zaytsev [Tue, 29 Nov 2016 18:49:25 +0000 (19:49 +0100)]
Add initial Jenkins pipeline script

Signed-off-by: Yury V. Zaytsev <yury.zaytsev@moneymeets.com>
9 years agocleanups
Joey Hess [Thu, 1 Dec 2016 04:41:01 +0000 (00:41 -0400)]
cleanups

9 years agomore flexible types for Proto runners
Joey Hess [Thu, 1 Dec 2016 04:27:07 +0000 (00:27 -0400)]
more flexible types for Proto runners

This will allow a runner in the Annex monad.

9 years agobetter comments
Joey Hess [Thu, 1 Dec 2016 03:54:00 +0000 (23:54 -0400)]
better comments

9 years agoAdded a comment: magic wormhole
https://anarc.at/openid/ [Wed, 30 Nov 2016 22:16:19 +0000 (22:16 +0000)]
Added a comment: magic wormhole

9 years ago(no commit message)
spiffytech [Wed, 30 Nov 2016 21:58:01 +0000 (21:58 +0000)]

9 years agoMerge branch 'master' of ssh://git-annex.branchable.com
Joey Hess [Wed, 30 Nov 2016 21:06:26 +0000 (17:06 -0400)]
Merge branch 'master' of ssh://git-annex.branchable.com

9 years agodevblog
Joey Hess [Wed, 30 Nov 2016 21:04:15 +0000 (17:04 -0400)]
devblog

9 years agoactually check p2p authtokens for tor connections
Joey Hess [Wed, 30 Nov 2016 20:38:16 +0000 (16:38 -0400)]
actually check p2p authtokens for tor connections

This commit was sponsored by Ethan Aubin.

9 years agouse P2P auth for git-remote-tor-annex
Joey Hess [Wed, 30 Nov 2016 19:26:16 +0000 (15:26 -0400)]
use P2P auth for git-remote-tor-annex

This changes the environment variable name to the more generic
GIT_ANNEX_P2P_AUTHTOKEN.

This commit was sponsored by andrea rota.

9 years agoimplement p2p --link
Joey Hess [Wed, 30 Nov 2016 19:14:54 +0000 (15:14 -0400)]
implement p2p --link

This commit was sponsored by Riku Voipio.

9 years ago(no commit message)
pablo@4f5b00d7b40f0a52e51761da420d6ff8e7c9aca7 [Wed, 30 Nov 2016 18:56:32 +0000 (18:56 +0000)]

9 years agoimplement p2p command
Joey Hess [Wed, 30 Nov 2016 18:35:24 +0000 (14:35 -0400)]
implement p2p command

9 years agomax authtoken length is 128
Joey Hess [Wed, 30 Nov 2016 18:19:26 +0000 (14:19 -0400)]
max authtoken length is 128

It was stopping at 128, so the 512 was only incorrect, it didn't change
behavior.

9 years agoavoid too-long command synopsis
Joey Hess [Wed, 30 Nov 2016 18:16:57 +0000 (14:16 -0400)]
avoid too-long command synopsis

It was making git-annex usage output columns far too wide

9 years agoMerge branch 'master' into tor
Joey Hess [Wed, 30 Nov 2016 18:16:36 +0000 (14:16 -0400)]
Merge branch 'master' into tor

9 years agoprefer xdot over dot
Joey Hess [Wed, 30 Nov 2016 16:50:49 +0000 (12:50 -0400)]
prefer xdot over dot

* map: Run xdot if it's available in PATH. On OSX, the dot command
  does not support graphical display, while xdot does.
* Debian: xdot is a better interactive viewer than dot, so Suggest
  xdot, rather than graphviz.

9 years agosupposedly unused import was used
Joey Hess [Wed, 30 Nov 2016 16:46:44 +0000 (12:46 -0400)]
supposedly unused import was used

9 years agoMerge branch 'master' into tor
Joey Hess [Wed, 30 Nov 2016 03:45:25 +0000 (23:45 -0400)]
Merge branch 'master' into tor

9 years agoremove unused import
Joey Hess [Wed, 30 Nov 2016 03:44:54 +0000 (23:44 -0400)]
remove unused import

9 years agocleanup
Joey Hess [Tue, 29 Nov 2016 21:52:46 +0000 (17:52 -0400)]
cleanup

9 years agodevblog
Joey Hess [Tue, 29 Nov 2016 21:36:03 +0000 (17:36 -0400)]
devblog

9 years agocomments
Joey Hess [Tue, 29 Nov 2016 21:33:49 +0000 (17:33 -0400)]
comments

9 years agoupdate docs for git-annex p2p command
Joey Hess [Tue, 29 Nov 2016 21:31:10 +0000 (17:31 -0400)]
update docs for git-annex p2p command

It is not yet implemented.

9 years agofinish git-annex enable-tor
Joey Hess [Tue, 29 Nov 2016 21:30:27 +0000 (17:30 -0400)]
finish git-annex enable-tor

Make it stash the address away for git-annex p2p to use later, rather
than outputting it. And, look up the UUID itself.

9 years agoMerge branch 'master' into tor
Joey Hess [Tue, 29 Nov 2016 19:45:29 +0000 (15:45 -0400)]
Merge branch 'master' into tor

9 years agofix
Joey Hess [Tue, 29 Nov 2016 19:43:34 +0000 (15:43 -0400)]
fix

9 years agoenable remotedaemon when assistant is not enabled
Joey Hess [Tue, 29 Nov 2016 19:41:28 +0000 (15:41 -0400)]
enable remotedaemon when assistant is not enabled

Needed to serve tor hidden services.

9 years agomove tor hidden service socket to /etc, temporarily violating the FHS
Joey Hess [Tue, 29 Nov 2016 17:02:19 +0000 (13:02 -0400)]
move tor hidden service socket to /etc, temporarily violating the FHS

On Debian, apparmor prevents tor from reading from most locations. And,
it silently fails if it is prevented from reading the hidden service
socket. I filed #846275 about this; violating the FHS is the least bad of a
bad set of choices until that bug is fixed.

9 years agotighten added language
Joey Hess [Tue, 29 Nov 2016 17:37:16 +0000 (13:37 -0400)]
tighten added language

Removed part about neeing to install git-annex and git in the same
location. The installer checks if the location given exists, and if not,
tells the user that git is not installed there. And the default should
work if the user just picks it in both installers.

9 years agoRevert "Added link to Windows installation instructions. The page was not easy to...
Joey Hess [Tue, 29 Nov 2016 17:32:20 +0000 (13:32 -0400)]
Revert "Added link to Windows installation instructions. The page was not easy to find."

This reverts commit c68d4305eb016e026d655dff7c7cb96cbb8296ea.

With all due respect, the link to the instructions for each OS is in the
"detailed instructions" column. Adding a second link to the same thing
is unlikely to help.

9 years agoMerge branch 'master' of ssh://git-annex.branchable.com
Joey Hess [Tue, 29 Nov 2016 17:32:10 +0000 (13:32 -0400)]
Merge branch 'master' of ssh://git-annex.branchable.com

9 years agoWindows autobuilder is going to be hosted at Dartmouth now
Joey Hess [Tue, 29 Nov 2016 16:05:37 +0000 (12:05 -0400)]
Windows autobuilder is going to be hosted at Dartmouth now

9 years agoAdded more explanations of my experience with the Windows install process.
senatorzergling@c1d78877a6120a80f0f4005210eda262c1586555 [Tue, 29 Nov 2016 15:13:16 +0000 (15:13 +0000)]
Added more explanations of my experience with the Windows install process.

9 years agoAdded link to Windows installation instructions. The page was not easy to find.
senatorzergling@c1d78877a6120a80f0f4005210eda262c1586555 [Tue, 29 Nov 2016 15:02:47 +0000 (15:02 +0000)]
Added link to Windows installation instructions. The page was not easy to find.