Jonathan Dieter [Wed, 25 Jul 2018 21:03:03 +0000 (22:03 +0100)]
ABI change: Make manual chunking a compression option
Signed-off-by: Jonathan Dieter <jdieter@gmail.com>
Jonathan Dieter [Wed, 25 Jul 2018 16:09:19 +0000 (17:09 +0100)]
Bump to 0.9.1
Signed-off-by: Jonathan Dieter <jdieter@gmail.com>
Jonathan Dieter [Wed, 25 Jul 2018 16:07:53 +0000 (17:07 +0100)]
Fix header change
Jonathan Dieter [Wed, 25 Jul 2018 16:05:51 +0000 (17:05 +0100)]
Fix format not a string literal and no format arguments, and make errors
const
Signed-off-by: Jonathan Dieter <jdieter@gmail.com>
Jonathan Dieter [Wed, 25 Jul 2018 15:53:47 +0000 (16:53 +0100)]
Update README.md
Signed-off-by: Jonathan Dieter <jdieter@gmail.com>
Jonathan Dieter [Wed, 25 Jul 2018 15:40:24 +0000 (16:40 +0100)]
Bump to 0.9.0
Signed-off-by: Jonathan Dieter <jdieter@gmail.com>
Jonathan Dieter [Wed, 25 Jul 2018 15:32:47 +0000 (16:32 +0100)]
Remove "quiet" option as it no longer makes sense with new error reporting
Signed-off-by: Jonathan Dieter <jdieter@gmail.com>
Jonathan Dieter [Wed, 25 Jul 2018 15:28:25 +0000 (16:28 +0100)]
Improve zck_read_header with new options and headers for chunk columns
Signed-off-by: Jonathan Dieter <jdieter@gmail.com>
Jonathan Dieter [Wed, 25 Jul 2018 15:27:47 +0000 (16:27 +0100)]
Fix zckdl
Signed-off-by: Jonathan Dieter <jdieter@gmail.com>
Jonathan Dieter [Wed, 25 Jul 2018 14:57:26 +0000 (15:57 +0100)]
Rename _VALIDATE_* to ALLOCD_*
Signed-off-by: Jonathan Dieter <jdieter@gmail.com>
Jonathan Dieter [Wed, 25 Jul 2018 14:53:37 +0000 (15:53 +0100)]
Rename VALIDATE_*_CHAR to VALIDATE_*_PTR
Signed-off-by: Jonathan Dieter <jdieter@gmail.com>
Jonathan Dieter [Wed, 25 Jul 2018 14:51:22 +0000 (15:51 +0100)]
Rename VALIDATE_*_TRI to VALIDATE_*_INT
Signed-off-by: Jonathan Dieter <jdieter@gmail.com>
Jonathan Dieter [Wed, 25 Jul 2018 14:48:36 +0000 (15:48 +0100)]
Remove unnecessary newlines
Signed-off-by: Jonathan Dieter <jdieter@gmail.com>
Jonathan Dieter [Wed, 25 Jul 2018 14:46:53 +0000 (15:46 +0100)]
_VALIDATE_* might not be zckCtx
Signed-off-by: Jonathan Dieter <jdieter@gmail.com>
Jonathan Dieter [Wed, 25 Jul 2018 14:45:55 +0000 (15:45 +0100)]
Fix unzck so it checks the data hash *before* decompressing any chunks
Signed-off-by: Jonathan Dieter <jdieter@gmail.com>
Jonathan Dieter [Tue, 24 Jul 2018 21:30:30 +0000 (22:30 +0100)]
API CHANGE: Update API with new error functions
Signed-off-by: Jonathan Dieter <jdieter@gmail.com>
Jonathan Dieter [Tue, 24 Jul 2018 21:30:05 +0000 (22:30 +0100)]
Update test cases to use new error functions
Signed-off-by: Jonathan Dieter <jdieter@gmail.com>
Jonathan Dieter [Tue, 24 Jul 2018 21:29:50 +0000 (22:29 +0100)]
Update everything to use new error functions
Signed-off-by: Jonathan Dieter <jdieter@gmail.com>
Jonathan Dieter [Tue, 24 Jul 2018 21:28:57 +0000 (22:28 +0100)]
Revamp error handling so it actually works
Signed-off-by: Jonathan Dieter <jdieter@gmail.com>
Jonathan Dieter [Tue, 24 Jul 2018 11:43:11 +0000 (12:43 +0100)]
Revamp error handling to handle variable arguments
Signed-off-by: Jonathan Dieter <jdieter@gmail.com>
Jonathan Dieter [Tue, 24 Jul 2018 11:14:26 +0000 (12:14 +0100)]
Add error handling functions
Signed-off-by: Jonathan Dieter <jdieter@gmail.com>
Jonathan Dieter [Sat, 21 Jul 2018 19:51:45 +0000 (20:51 +0100)]
Fix spec to clearly explain that chunk count includes the dictionary (#5)
Signed-off-by: Jonathan Dieter <jdieter@gmail.com>
Jonathan Dieter [Wed, 18 Jul 2018 16:25:03 +0000 (17:25 +0100)]
WARNING: File format change: flags are now compressed integer
Signed-off-by: Jonathan Dieter <jdieter@gmail.com>
Jonathan Dieter [Tue, 17 Jul 2018 15:55:04 +0000 (16:55 +0100)]
Revert "Add extra newline"
This reverts commit
f0c75ea50e8c846529dbd055c9fb30f924f8b9f7.
Jonathan Dieter [Tue, 17 Jul 2018 15:48:47 +0000 (16:48 +0100)]
Add extra newline
Signed-off-by: Jonathan Dieter <jdieter@gmail.com>
Jonathan Dieter [Tue, 17 Jul 2018 14:49:14 +0000 (15:49 +0100)]
Add testing Dockerfiles for automated testing
Signed-off-by: Jonathan Dieter <jdieter@gmail.com>
Jonathan Dieter [Thu, 12 Jul 2018 20:15:22 +0000 (21:15 +0100)]
Bump to 0.7.6
Signed-off-by: Jonathan Dieter <jdieter@gmail.com>
Jonathan Dieter [Thu, 12 Jul 2018 19:50:04 +0000 (20:50 +0100)]
Some more format definition cleanup
Signed-off-by: Jonathan Dieter <jdieter@gmail.com>
Jonathan Dieter [Wed, 11 Jul 2018 14:54:55 +0000 (15:54 +0100)]
Fix errors in format definition
Signed-off-by: Jonathan Dieter <jdieter@gmail.com>
Jonathan Dieter [Wed, 11 Jul 2018 14:54:30 +0000 (15:54 +0100)]
Fix memory leaks
Signed-off-by: Jonathan Dieter <jdieter@gmail.com>
Jonathan Dieter [Wed, 11 Jul 2018 13:51:07 +0000 (14:51 +0100)]
Merge branch '0.7.5-abi-check'
Jonathan Dieter [Wed, 11 Jul 2018 13:45:48 +0000 (14:45 +0100)]
Update ABI to 0.7.5
Signed-off-by: Jonathan Dieter <jdieter@gmail.com>
Jonathan Dieter [Wed, 11 Jul 2018 13:43:04 +0000 (14:43 +0100)]
Fix test case for new chunk checksum
Signed-off-by: Jonathan Dieter <jdieter@gmail.com>
Jonathan Dieter [Wed, 11 Jul 2018 13:35:48 +0000 (14:35 +0100)]
Add option to only manually chunk to zck utility
Signed-off-by: Jonathan Dieter <jdieter@gmail.com>
Jonathan Dieter [Wed, 11 Jul 2018 13:35:25 +0000 (14:35 +0100)]
Move buzhash into lib/ and automatically chunk by default
Signed-off-by: Jonathan Dieter <jdieter@gmail.com>
Jonathan Dieter [Wed, 11 Jul 2018 12:11:55 +0000 (13:11 +0100)]
Fix length calculation in compint
Signed-off-by: Jonathan Dieter <jdieter@gmail.com>
Jonathan Dieter [Wed, 11 Jul 2018 10:32:28 +0000 (11:32 +0100)]
Switch from SHA-512/64 to SHA-512/128 to reduce the probability of two
chunks matching checksums when different.
Signed-off-by: Jonathan Dieter <jdieter@gmail.com>
Jonathan Dieter [Wed, 11 Jul 2018 10:24:58 +0000 (11:24 +0100)]
More work on buzhash integration in library
Signed-off-by: Jonathan Dieter <jdieter@gmail.com>
Jonathan Dieter [Sun, 8 Jul 2018 20:23:35 +0000 (21:23 +0100)]
Add SHA-512 hash and SHA-512/64 (first 64 bits of SHA-512 hash), and make
SHA-512/64 the default chunk hash for new files
Signed-off-by: Jonathan Dieter <jdieter@gmail.com>
Jonathan Dieter [Sun, 8 Jul 2018 19:54:27 +0000 (20:54 +0100)]
Initial work to move buzhash into libzck
Signed-off-by: Jonathan Dieter <jdieter@gmail.com>
Jonathan Dieter [Tue, 3 Jul 2018 11:25:24 +0000 (14:25 +0300)]
Bump to 0.7.5
Signed-off-by: Jonathan Dieter <jdieter@gmail.com>
Jonathan Dieter [Tue, 3 Jul 2018 11:15:52 +0000 (14:15 +0300)]
Add support for using OpenSSL for checksums
Signed-off-by: Jonathan Dieter <jdieter@gmail.com>
Jonathan Dieter [Tue, 3 Jul 2018 11:13:18 +0000 (14:13 +0300)]
Get brackets right when we don't support streams
Signed-off-by: Jonathan Dieter <jdieter@gmail.com>
Jonathan Dieter [Mon, 2 Jul 2018 14:25:29 +0000 (17:25 +0300)]
Remove README that refers to library we're no longer using
Signed-off-by: Jonathan Dieter <jdieter@gmail.com>
Jonathan Dieter [Thu, 28 Jun 2018 17:33:09 +0000 (20:33 +0300)]
We don't actually support streams yet
Signed-off-by: Jonathan Dieter <jdieter@gmail.com>
Jonathan Dieter [Fri, 22 Jun 2018 16:31:19 +0000 (19:31 +0300)]
Bump to 0.7.4
Signed-off-by: Jonathan Dieter <jdieter@gmail.com>
Jonathan Dieter [Fri, 22 Jun 2018 16:30:43 +0000 (19:30 +0300)]
Update abi scripts to point to new header location
Signed-off-by: Jonathan Dieter <jdieter@gmail.com>
Jonathan Dieter [Fri, 22 Jun 2018 16:23:16 +0000 (19:23 +0300)]
Switch to native meson versioning
Signed-off-by: Jonathan Dieter <jdieter@gmail.com>
Jonathan Dieter [Fri, 22 Jun 2018 11:06:09 +0000 (14:06 +0300)]
Bump to 0.7.3
Signed-off-by: Jonathan Dieter <jdieter@gmail.com>
Jonathan Dieter [Fri, 22 Jun 2018 11:04:41 +0000 (14:04 +0300)]
Add support for --stdout to unzck
Signed-off-by: Jonathan Dieter <jdieter@gmail.com>
Jonathan Dieter [Tue, 12 Jun 2018 06:02:14 +0000 (09:02 +0300)]
Bump to 0.7.2 with minor API and ABI change
Signed-off-by: Jonathan Dieter <jdieter@gmail.com>
Jonathan Dieter [Tue, 12 Jun 2018 06:00:05 +0000 (09:00 +0300)]
ABI change: Rename function that looked too similar to another function
Signed-off-by: Jonathan Dieter <jdieter@gmail.com>
Jonathan Dieter [Mon, 11 Jun 2018 19:19:56 +0000 (22:19 +0300)]
Run ABI test and bump to 0.7.1
Signed-off-by: Jonathan Dieter <jdieter@gmail.com>
Jonathan Dieter [Mon, 11 Jun 2018 19:12:48 +0000 (22:12 +0300)]
Use public headers for abi test
Signed-off-by: Jonathan Dieter <jdieter@gmail.com>
Jonathan Dieter [Mon, 11 Jun 2018 18:48:29 +0000 (21:48 +0300)]
Add global function to change zck file descriptor
Signed-off-by: Jonathan Dieter <jdieter@gmail.com>
Jonathan Dieter [Mon, 11 Jun 2018 18:47:59 +0000 (21:47 +0300)]
Rework how lead is read and add function to validate it
Signed-off-by: Jonathan Dieter <jdieter@gmail.com>
Jonathan Dieter [Mon, 11 Jun 2018 18:46:49 +0000 (21:46 +0300)]
Fix misnamed global function
Signed-off-by: Jonathan Dieter <jdieter@gmail.com>
Jonathan Dieter [Mon, 11 Jun 2018 18:46:12 +0000 (21:46 +0300)]
Add private function to reset hash type
Signed-off-by: Jonathan Dieter <jdieter@gmail.com>
Jonathan Dieter [Mon, 11 Jun 2018 18:45:44 +0000 (21:45 +0300)]
Some variable name cleanup
Signed-off-by: Jonathan Dieter <jdieter@gmail.com>
Jonathan Dieter [Mon, 11 Jun 2018 18:45:03 +0000 (21:45 +0300)]
Exit immediately if downloaded chunk isn't valid
Signed-off-by: Jonathan Dieter <jdieter@gmail.com>
Jonathan Dieter [Sat, 9 Jun 2018 11:02:23 +0000 (14:02 +0300)]
Rename variable to be more accurate
Signed-off-by: Jonathan Dieter <jdieter@gmail.com>
Jonathan Dieter [Sat, 9 Jun 2018 11:01:44 +0000 (14:01 +0300)]
Fix headers and add function to set zchunk context in download context
Signed-off-by: Jonathan Dieter <jdieter@gmail.com>
Jonathan Dieter [Mon, 11 Jun 2018 18:51:02 +0000 (21:51 +0300)]
Point abi testing to new abi
Signed-off-by: Jonathan Dieter <jdieter@gmail.com>
Jonathan Dieter [Fri, 8 Jun 2018 11:57:08 +0000 (14:57 +0300)]
Bump to 0.7.0 with massive API changes
Signed-off-by: Jonathan Dieter <jdieter@gmail.com>
Jonathan Dieter [Fri, 8 Jun 2018 11:52:37 +0000 (14:52 +0300)]
Massive API cleanup in preparation for ABI stability guarantee
Signed-off-by: Jonathan Dieter <jdieter@gmail.com>
Jonathan Dieter [Fri, 8 Jun 2018 07:09:21 +0000 (10:09 +0300)]
Bump to 0.6.3
Signed-off-by: Jonathan Dieter <jdieter@gmail.com>
Jonathan Dieter [Fri, 8 Jun 2018 07:08:17 +0000 (10:08 +0300)]
Add ABI compliance test. To run it, run 'ninja test-abi'
Signed-off-by: Jonathan Dieter <jdieter@gmail.com>
Jonathan Dieter [Thu, 7 Jun 2018 15:09:30 +0000 (18:09 +0300)]
Logging improvements
Signed-off-by: Jonathan Dieter <jdieter@gmail.com>
Jonathan Dieter [Wed, 6 Jun 2018 11:36:52 +0000 (14:36 +0300)]
Bump to 0.6.2
Signed-off-by: Jonathan Dieter <jdieter@gmail.com>
Jonathan Dieter [Wed, 6 Jun 2018 10:24:33 +0000 (13:24 +0300)]
Move buzhash into struct for easier manipulation
Signed-off-by: Jonathan Dieter <jdieter@gmail.com>
Jonathan Dieter [Wed, 6 Jun 2018 10:24:02 +0000 (13:24 +0300)]
Make sure we cast to unsigned long when using printf, and use ftruncate
return value
Signed-off-by: Jonathan Dieter <jdieter@gmail.com>
Jonathan Dieter [Wed, 6 Jun 2018 10:23:04 +0000 (13:23 +0300)]
Fix error where we don't check for hash_type < 0
Signed-off-by: Jonathan Dieter <jdieter@gmail.com>
Jonathan Dieter [Wed, 6 Jun 2018 08:38:10 +0000 (11:38 +0300)]
Bump to 0.6.1
Signed-off-by: Jonathan Dieter <jdieter@gmail.com>
Jonathan Dieter [Wed, 6 Jun 2018 08:36:18 +0000 (11:36 +0300)]
Move functions out of zck.h to more appropriate files
Signed-off-by: Jonathan Dieter <jdieter@gmail.com>
Jonathan Dieter [Wed, 6 Jun 2018 08:35:48 +0000 (11:35 +0300)]
Move static function above non-static function
Signed-off-by: Jonathan Dieter <jdieter@gmail.com>
Jonathan Dieter [Wed, 6 Jun 2018 08:21:54 +0000 (11:21 +0300)]
Remove unused functions
Signed-off-by: Jonathan Dieter <jdieter@gmail.com>
Jonathan Dieter [Wed, 6 Jun 2018 08:20:14 +0000 (11:20 +0300)]
Make functions that aren't used outside the file static, and reorder
functions
Signed-off-by: Jonathan Dieter <jdieter@gmail.com>
Jonathan Dieter [Wed, 6 Jun 2018 08:19:14 +0000 (11:19 +0300)]
Reorder function so it's above non-static functions
Signed-off-by: Jonathan Dieter <jdieter@gmail.com>
Jonathan Dieter [Wed, 6 Jun 2018 06:46:20 +0000 (09:46 +0300)]
Make functions that aren't used outside of file static and remove unused
functions
Signed-off-by: Jonathan Dieter <jdieter@gmail.com>
Jonathan Dieter [Wed, 6 Jun 2018 06:34:46 +0000 (09:34 +0300)]
Change zck_reset_failed_chunks to void
Signed-off-by: Jonathan Dieter <jdieter@gmail.com>
Jonathan Dieter [Wed, 6 Jun 2018 06:34:23 +0000 (09:34 +0300)]
Remove extra logging and simplify code
Signed-off-by: Jonathan Dieter <jdieter@gmail.com>
Jonathan Dieter [Tue, 5 Jun 2018 18:23:14 +0000 (21:23 +0300)]
Remove some functions that shouldn't be public and bump to 0.6.0
Signed-off-by: Jonathan Dieter <jdieter@gmail.com>
Jonathan Dieter [Tue, 5 Jun 2018 18:22:50 +0000 (21:22 +0300)]
All non-public functions shouldn't start with zck_*
Signed-off-by: Jonathan Dieter <jdieter@gmail.com>
Jonathan Dieter [Tue, 5 Jun 2018 12:15:02 +0000 (15:15 +0300)]
Move download API to zck_dl.c
Signed-off-by: Jonathan Dieter <jdieter@gmail.com>
Jonathan Dieter [Tue, 5 Jun 2018 11:11:51 +0000 (14:11 +0300)]
Change zck_range_close to zck_range_free and fix zck_get_dl_range
Signed-off-by: Jonathan Dieter <jdieter@gmail.com>
Jonathan Dieter [Tue, 5 Jun 2018 11:11:07 +0000 (14:11 +0300)]
Fix various bugs in download code
Signed-off-by: Jonathan Dieter <jdieter@gmail.com>
Jonathan Dieter [Tue, 5 Jun 2018 11:10:47 +0000 (14:10 +0300)]
Remove unneeded copy_index_item function
Signed-off-by: Jonathan Dieter <jdieter@gmail.com>
Jonathan Dieter [Tue, 5 Jun 2018 11:09:35 +0000 (14:09 +0300)]
Fix IndexItem->valid so it is either -1 (failed), 0 (missing) or 1 (good)
Signed-off-by: Jonathan Dieter <jdieter@gmail.com>
Jonathan Dieter [Tue, 5 Jun 2018 11:08:52 +0000 (14:08 +0300)]
Fix memory leak
Signed-off-by: Jonathan Dieter <jdieter@gmail.com>
Jonathan Dieter [Tue, 5 Jun 2018 11:08:14 +0000 (14:08 +0300)]
Some new functions and cleanup of old functions
Signed-off-by: Jonathan Dieter <jdieter@gmail.com>
Jonathan Dieter [Mon, 4 Jun 2018 07:48:16 +0000 (10:48 +0300)]
Modify zckdl so it does the curl calls itself
Signed-off-by: Jonathan Dieter <jdieter@gmail.com>
Jonathan Dieter [Mon, 4 Jun 2018 07:47:51 +0000 (10:47 +0300)]
API revamp to give control over the actual download to the program
Signed-off-by: Jonathan Dieter <jdieter@gmail.com>
Jonathan Dieter [Mon, 4 Jun 2018 07:46:11 +0000 (10:46 +0300)]
New functions and rework zck_get_header_length so it works after only the
lead has been read
Signed-off-by: Jonathan Dieter <jdieter@gmail.com>
Jonathan Dieter [Mon, 4 Jun 2018 07:45:10 +0000 (10:45 +0300)]
Rework function that was only used by zckdl
Signed-off-by: Jonathan Dieter <jdieter@gmail.com>
Jonathan Dieter [Mon, 4 Jun 2018 07:43:54 +0000 (10:43 +0300)]
Add function for copying an index item (used to for mapping from an old
zchunk to a new)
Signed-off-by: Jonathan Dieter <jdieter@gmail.com>
Jonathan Dieter [Mon, 4 Jun 2018 07:43:00 +0000 (10:43 +0300)]
Change how headers are read. Full lead must be read in one go.
Signed-off-by: Jonathan Dieter <jdieter@gmail.com>
Jonathan Dieter [Mon, 4 Jun 2018 05:16:48 +0000 (08:16 +0300)]
Break regex generation into separate function
Signed-off-by: Jonathan Dieter <jdieter@gmail.com>
Jonathan Dieter [Mon, 4 Jun 2018 05:12:48 +0000 (08:12 +0300)]
Move curl dependency to just zckdl
Signed-off-by: Jonathan Dieter <jdieter@gmail.com>
Jonathan Dieter [Mon, 4 Jun 2018 05:12:02 +0000 (08:12 +0300)]
Header checksum and header size were in the wrong order
Signed-off-by: Jonathan Dieter <jdieter@gmail.com>
Jonathan Dieter [Thu, 31 May 2018 07:08:49 +0000 (10:08 +0300)]
Make error message more accurate when digest size is incorrect
Signed-off-by: Jonathan Dieter <jdieter@gmail.com>