Jonathan Dieter [Wed, 11 Jul 2018 10:24:58 +0000 (11:24 +0100)]
More work on buzhash integration in library
Signed-off-by: Jonathan Dieter <jdieter@gmail.com>
Jonathan Dieter [Sun, 8 Jul 2018 20:23:35 +0000 (21:23 +0100)]
Add SHA-512 hash and SHA-512/64 (first 64 bits of SHA-512 hash), and make
SHA-512/64 the default chunk hash for new files
Signed-off-by: Jonathan Dieter <jdieter@gmail.com>
Jonathan Dieter [Sun, 8 Jul 2018 19:54:27 +0000 (20:54 +0100)]
Initial work to move buzhash into libzck
Signed-off-by: Jonathan Dieter <jdieter@gmail.com>
Jonathan Dieter [Tue, 3 Jul 2018 11:25:24 +0000 (14:25 +0300)]
Bump to 0.7.5
Signed-off-by: Jonathan Dieter <jdieter@gmail.com>
Jonathan Dieter [Tue, 3 Jul 2018 11:15:52 +0000 (14:15 +0300)]
Add support for using OpenSSL for checksums
Signed-off-by: Jonathan Dieter <jdieter@gmail.com>
Jonathan Dieter [Tue, 3 Jul 2018 11:13:18 +0000 (14:13 +0300)]
Get brackets right when we don't support streams
Signed-off-by: Jonathan Dieter <jdieter@gmail.com>
Jonathan Dieter [Mon, 2 Jul 2018 14:25:29 +0000 (17:25 +0300)]
Remove README that refers to library we're no longer using
Signed-off-by: Jonathan Dieter <jdieter@gmail.com>
Jonathan Dieter [Thu, 28 Jun 2018 17:33:09 +0000 (20:33 +0300)]
We don't actually support streams yet
Signed-off-by: Jonathan Dieter <jdieter@gmail.com>
Jonathan Dieter [Fri, 22 Jun 2018 16:31:19 +0000 (19:31 +0300)]
Bump to 0.7.4
Signed-off-by: Jonathan Dieter <jdieter@gmail.com>
Jonathan Dieter [Fri, 22 Jun 2018 16:30:43 +0000 (19:30 +0300)]
Update abi scripts to point to new header location
Signed-off-by: Jonathan Dieter <jdieter@gmail.com>
Jonathan Dieter [Fri, 22 Jun 2018 16:23:16 +0000 (19:23 +0300)]
Switch to native meson versioning
Signed-off-by: Jonathan Dieter <jdieter@gmail.com>
Jonathan Dieter [Fri, 22 Jun 2018 11:06:09 +0000 (14:06 +0300)]
Bump to 0.7.3
Signed-off-by: Jonathan Dieter <jdieter@gmail.com>
Jonathan Dieter [Fri, 22 Jun 2018 11:04:41 +0000 (14:04 +0300)]
Add support for --stdout to unzck
Signed-off-by: Jonathan Dieter <jdieter@gmail.com>
Jonathan Dieter [Tue, 12 Jun 2018 06:02:14 +0000 (09:02 +0300)]
Bump to 0.7.2 with minor API and ABI change
Signed-off-by: Jonathan Dieter <jdieter@gmail.com>
Jonathan Dieter [Tue, 12 Jun 2018 06:00:05 +0000 (09:00 +0300)]
ABI change: Rename function that looked too similar to another function
Signed-off-by: Jonathan Dieter <jdieter@gmail.com>
Jonathan Dieter [Mon, 11 Jun 2018 19:19:56 +0000 (22:19 +0300)]
Run ABI test and bump to 0.7.1
Signed-off-by: Jonathan Dieter <jdieter@gmail.com>
Jonathan Dieter [Mon, 11 Jun 2018 19:12:48 +0000 (22:12 +0300)]
Use public headers for abi test
Signed-off-by: Jonathan Dieter <jdieter@gmail.com>
Jonathan Dieter [Mon, 11 Jun 2018 18:48:29 +0000 (21:48 +0300)]
Add global function to change zck file descriptor
Signed-off-by: Jonathan Dieter <jdieter@gmail.com>
Jonathan Dieter [Mon, 11 Jun 2018 18:47:59 +0000 (21:47 +0300)]
Rework how lead is read and add function to validate it
Signed-off-by: Jonathan Dieter <jdieter@gmail.com>
Jonathan Dieter [Mon, 11 Jun 2018 18:46:49 +0000 (21:46 +0300)]
Fix misnamed global function
Signed-off-by: Jonathan Dieter <jdieter@gmail.com>
Jonathan Dieter [Mon, 11 Jun 2018 18:46:12 +0000 (21:46 +0300)]
Add private function to reset hash type
Signed-off-by: Jonathan Dieter <jdieter@gmail.com>
Jonathan Dieter [Mon, 11 Jun 2018 18:45:44 +0000 (21:45 +0300)]
Some variable name cleanup
Signed-off-by: Jonathan Dieter <jdieter@gmail.com>
Jonathan Dieter [Mon, 11 Jun 2018 18:45:03 +0000 (21:45 +0300)]
Exit immediately if downloaded chunk isn't valid
Signed-off-by: Jonathan Dieter <jdieter@gmail.com>
Jonathan Dieter [Sat, 9 Jun 2018 11:02:23 +0000 (14:02 +0300)]
Rename variable to be more accurate
Signed-off-by: Jonathan Dieter <jdieter@gmail.com>
Jonathan Dieter [Sat, 9 Jun 2018 11:01:44 +0000 (14:01 +0300)]
Fix headers and add function to set zchunk context in download context
Signed-off-by: Jonathan Dieter <jdieter@gmail.com>
Jonathan Dieter [Mon, 11 Jun 2018 18:51:02 +0000 (21:51 +0300)]
Point abi testing to new abi
Signed-off-by: Jonathan Dieter <jdieter@gmail.com>
Jonathan Dieter [Fri, 8 Jun 2018 11:57:08 +0000 (14:57 +0300)]
Bump to 0.7.0 with massive API changes
Signed-off-by: Jonathan Dieter <jdieter@gmail.com>
Jonathan Dieter [Fri, 8 Jun 2018 11:52:37 +0000 (14:52 +0300)]
Massive API cleanup in preparation for ABI stability guarantee
Signed-off-by: Jonathan Dieter <jdieter@gmail.com>
Jonathan Dieter [Fri, 8 Jun 2018 07:09:21 +0000 (10:09 +0300)]
Bump to 0.6.3
Signed-off-by: Jonathan Dieter <jdieter@gmail.com>
Jonathan Dieter [Fri, 8 Jun 2018 07:08:17 +0000 (10:08 +0300)]
Add ABI compliance test. To run it, run 'ninja test-abi'
Signed-off-by: Jonathan Dieter <jdieter@gmail.com>
Jonathan Dieter [Thu, 7 Jun 2018 15:09:30 +0000 (18:09 +0300)]
Logging improvements
Signed-off-by: Jonathan Dieter <jdieter@gmail.com>
Jonathan Dieter [Wed, 6 Jun 2018 11:36:52 +0000 (14:36 +0300)]
Bump to 0.6.2
Signed-off-by: Jonathan Dieter <jdieter@gmail.com>
Jonathan Dieter [Wed, 6 Jun 2018 10:24:33 +0000 (13:24 +0300)]
Move buzhash into struct for easier manipulation
Signed-off-by: Jonathan Dieter <jdieter@gmail.com>
Jonathan Dieter [Wed, 6 Jun 2018 10:24:02 +0000 (13:24 +0300)]
Make sure we cast to unsigned long when using printf, and use ftruncate
return value
Signed-off-by: Jonathan Dieter <jdieter@gmail.com>
Jonathan Dieter [Wed, 6 Jun 2018 10:23:04 +0000 (13:23 +0300)]
Fix error where we don't check for hash_type < 0
Signed-off-by: Jonathan Dieter <jdieter@gmail.com>
Jonathan Dieter [Wed, 6 Jun 2018 08:38:10 +0000 (11:38 +0300)]
Bump to 0.6.1
Signed-off-by: Jonathan Dieter <jdieter@gmail.com>
Jonathan Dieter [Wed, 6 Jun 2018 08:36:18 +0000 (11:36 +0300)]
Move functions out of zck.h to more appropriate files
Signed-off-by: Jonathan Dieter <jdieter@gmail.com>
Jonathan Dieter [Wed, 6 Jun 2018 08:35:48 +0000 (11:35 +0300)]
Move static function above non-static function
Signed-off-by: Jonathan Dieter <jdieter@gmail.com>
Jonathan Dieter [Wed, 6 Jun 2018 08:21:54 +0000 (11:21 +0300)]
Remove unused functions
Signed-off-by: Jonathan Dieter <jdieter@gmail.com>
Jonathan Dieter [Wed, 6 Jun 2018 08:20:14 +0000 (11:20 +0300)]
Make functions that aren't used outside the file static, and reorder
functions
Signed-off-by: Jonathan Dieter <jdieter@gmail.com>
Jonathan Dieter [Wed, 6 Jun 2018 08:19:14 +0000 (11:19 +0300)]
Reorder function so it's above non-static functions
Signed-off-by: Jonathan Dieter <jdieter@gmail.com>
Jonathan Dieter [Wed, 6 Jun 2018 06:46:20 +0000 (09:46 +0300)]
Make functions that aren't used outside of file static and remove unused
functions
Signed-off-by: Jonathan Dieter <jdieter@gmail.com>
Jonathan Dieter [Wed, 6 Jun 2018 06:34:46 +0000 (09:34 +0300)]
Change zck_reset_failed_chunks to void
Signed-off-by: Jonathan Dieter <jdieter@gmail.com>
Jonathan Dieter [Wed, 6 Jun 2018 06:34:23 +0000 (09:34 +0300)]
Remove extra logging and simplify code
Signed-off-by: Jonathan Dieter <jdieter@gmail.com>
Jonathan Dieter [Tue, 5 Jun 2018 18:23:14 +0000 (21:23 +0300)]
Remove some functions that shouldn't be public and bump to 0.6.0
Signed-off-by: Jonathan Dieter <jdieter@gmail.com>
Jonathan Dieter [Tue, 5 Jun 2018 18:22:50 +0000 (21:22 +0300)]
All non-public functions shouldn't start with zck_*
Signed-off-by: Jonathan Dieter <jdieter@gmail.com>
Jonathan Dieter [Tue, 5 Jun 2018 12:15:02 +0000 (15:15 +0300)]
Move download API to zck_dl.c
Signed-off-by: Jonathan Dieter <jdieter@gmail.com>
Jonathan Dieter [Tue, 5 Jun 2018 11:11:51 +0000 (14:11 +0300)]
Change zck_range_close to zck_range_free and fix zck_get_dl_range
Signed-off-by: Jonathan Dieter <jdieter@gmail.com>
Jonathan Dieter [Tue, 5 Jun 2018 11:11:07 +0000 (14:11 +0300)]
Fix various bugs in download code
Signed-off-by: Jonathan Dieter <jdieter@gmail.com>
Jonathan Dieter [Tue, 5 Jun 2018 11:10:47 +0000 (14:10 +0300)]
Remove unneeded copy_index_item function
Signed-off-by: Jonathan Dieter <jdieter@gmail.com>
Jonathan Dieter [Tue, 5 Jun 2018 11:09:35 +0000 (14:09 +0300)]
Fix IndexItem->valid so it is either -1 (failed), 0 (missing) or 1 (good)
Signed-off-by: Jonathan Dieter <jdieter@gmail.com>
Jonathan Dieter [Tue, 5 Jun 2018 11:08:52 +0000 (14:08 +0300)]
Fix memory leak
Signed-off-by: Jonathan Dieter <jdieter@gmail.com>
Jonathan Dieter [Tue, 5 Jun 2018 11:08:14 +0000 (14:08 +0300)]
Some new functions and cleanup of old functions
Signed-off-by: Jonathan Dieter <jdieter@gmail.com>
Jonathan Dieter [Mon, 4 Jun 2018 07:48:16 +0000 (10:48 +0300)]
Modify zckdl so it does the curl calls itself
Signed-off-by: Jonathan Dieter <jdieter@gmail.com>
Jonathan Dieter [Mon, 4 Jun 2018 07:47:51 +0000 (10:47 +0300)]
API revamp to give control over the actual download to the program
Signed-off-by: Jonathan Dieter <jdieter@gmail.com>
Jonathan Dieter [Mon, 4 Jun 2018 07:46:11 +0000 (10:46 +0300)]
New functions and rework zck_get_header_length so it works after only the
lead has been read
Signed-off-by: Jonathan Dieter <jdieter@gmail.com>
Jonathan Dieter [Mon, 4 Jun 2018 07:45:10 +0000 (10:45 +0300)]
Rework function that was only used by zckdl
Signed-off-by: Jonathan Dieter <jdieter@gmail.com>
Jonathan Dieter [Mon, 4 Jun 2018 07:43:54 +0000 (10:43 +0300)]
Add function for copying an index item (used to for mapping from an old
zchunk to a new)
Signed-off-by: Jonathan Dieter <jdieter@gmail.com>
Jonathan Dieter [Mon, 4 Jun 2018 07:43:00 +0000 (10:43 +0300)]
Change how headers are read. Full lead must be read in one go.
Signed-off-by: Jonathan Dieter <jdieter@gmail.com>
Jonathan Dieter [Mon, 4 Jun 2018 05:16:48 +0000 (08:16 +0300)]
Break regex generation into separate function
Signed-off-by: Jonathan Dieter <jdieter@gmail.com>
Jonathan Dieter [Mon, 4 Jun 2018 05:12:48 +0000 (08:12 +0300)]
Move curl dependency to just zckdl
Signed-off-by: Jonathan Dieter <jdieter@gmail.com>
Jonathan Dieter [Mon, 4 Jun 2018 05:12:02 +0000 (08:12 +0300)]
Header checksum and header size were in the wrong order
Signed-off-by: Jonathan Dieter <jdieter@gmail.com>
Jonathan Dieter [Thu, 31 May 2018 07:08:49 +0000 (10:08 +0300)]
Make error message more accurate when digest size is incorrect
Signed-off-by: Jonathan Dieter <jdieter@gmail.com>
Jonathan Dieter [Thu, 31 May 2018 07:05:36 +0000 (10:05 +0300)]
Fix problems with validating pre-supplied header checksum and length
Signed-off-by: Jonathan Dieter <jdieter@gmail.com>
Jonathan Dieter [Wed, 30 May 2018 12:01:30 +0000 (15:01 +0300)]
Add unknown hash type
Signed-off-by: Jonathan Dieter <jdieter@gmail.com>
Jonathan Dieter [Wed, 30 May 2018 11:13:59 +0000 (14:13 +0300)]
We now verify whether options are valid for reading or writing
Signed-off-by: Jonathan Dieter <jdieter@gmail.com>
Jonathan Dieter [Wed, 30 May 2018 11:01:35 +0000 (14:01 +0300)]
Add support for specifying header information before reading file
Signed-off-by: Jonathan Dieter <jdieter@gmail.com>
Jonathan Dieter [Mon, 21 May 2018 18:39:50 +0000 (21:39 +0300)]
Add new argument to zck_read_header to validate zchunk file
Signed-off-by: Jonathan Dieter <jdieter@gmail.com>
Jonathan Dieter [Mon, 21 May 2018 18:39:23 +0000 (21:39 +0300)]
Revamp chunk validation functions and add new public function to check full
file checksums
Signed-off-by: Jonathan Dieter <jdieter@gmail.com>
Jonathan Dieter [Mon, 21 May 2018 18:36:57 +0000 (21:36 +0300)]
Rename zckIndexItem.finished to zckIndexItem.valid
Signed-off-by: Jonathan Dieter <jdieter@gmail.com>
Jonathan Dieter [Mon, 21 May 2018 18:34:53 +0000 (21:34 +0300)]
Move buffer size into util_common.h
Signed-off-by: Jonathan Dieter <jdieter@gmail.com>
Jonathan Dieter [Mon, 21 May 2018 18:34:13 +0000 (21:34 +0300)]
Output logging to stderr instead of stdout
Signed-off-by: Jonathan Dieter <jdieter@gmail.com>
Jonathan Dieter [Mon, 21 May 2018 18:33:45 +0000 (21:33 +0300)]
Get rid of unused return
Signed-off-by: Jonathan Dieter <jdieter@gmail.com>
Jonathan Dieter [Wed, 16 May 2018 07:59:56 +0000 (10:59 +0300)]
Apparently spaces matter
Signed-off-by: Jonathan Dieter <jdieter@gmail.com>
Jonathan Dieter [Wed, 16 May 2018 07:56:48 +0000 (10:56 +0300)]
Update README.md
Signed-off-by: Jonathan Dieter <jdieter@gmail.com>
Jonathan Dieter [Thu, 10 May 2018 11:42:12 +0000 (14:42 +0300)]
Bump to 0.5.2
Signed-off-by: Jonathan Dieter <jdieter@gmail.com>
Jonathan Dieter [Thu, 10 May 2018 11:41:55 +0000 (14:41 +0300)]
Change zck_range_get_char to not output header beginning
Signed-off-by: Jonathan Dieter <jdieter@gmail.com>
Jonathan Dieter [Thu, 10 May 2018 11:16:49 +0000 (14:16 +0300)]
Bump to 0.5.1 with new zck_get_range() function
Signed-off-by: Jonathan Dieter <jdieter@gmail.com>
Jonathan Dieter [Thu, 10 May 2018 11:15:40 +0000 (14:15 +0300)]
Add function to get range string from start and end location
Signed-off-by: Jonathan Dieter <jdieter@gmail.com>
Jonathan Dieter [Wed, 9 May 2018 16:49:41 +0000 (19:49 +0300)]
Bump to 0.5.0 with proper command line utilities
Signed-off-by: Jonathan Dieter <jdieter@gmail.com>
Jonathan Dieter [Wed, 9 May 2018 16:22:46 +0000 (19:22 +0300)]
Move dictionary decompression from zck_read_header to zck_read
Signed-off-by: Jonathan Dieter <jdieter@gmail.com>
Jonathan Dieter [Sun, 6 May 2018 14:10:58 +0000 (17:10 +0300)]
Get rid of warning about stripping '\0' from strncpy
Signed-off-by: Jonathan Dieter <jdieter@gmail.com>
Jonathan Dieter [Fri, 4 May 2018 15:13:31 +0000 (18:13 +0300)]
Fix incomplete conversion to argp
Signed-off-by: Jonathan Dieter <jdieter@gmail.com>
Jonathan Dieter [Fri, 4 May 2018 15:09:02 +0000 (18:09 +0300)]
Make zck_delta_size a proper utility with arguments and help.
Signed-off-by: Jonathan Dieter <jdieter@gmail.com>
Jonathan Dieter [Fri, 4 May 2018 15:08:45 +0000 (18:08 +0300)]
Make zck_read_header a proper utility with arguments and help.
Signed-off-by: Jonathan Dieter <jdieter@gmail.com>
Jonathan Dieter [Fri, 4 May 2018 15:08:26 +0000 (18:08 +0300)]
Make zckdl a proper utility with arguments and help.
Signed-off-by: Jonathan Dieter <jdieter@gmail.com>
Jonathan Dieter [Fri, 4 May 2018 14:27:09 +0000 (17:27 +0300)]
Make unzck a proper utility with arguments and help.
Signed-off-by: Jonathan Dieter <jdieter@gmail.com>
Jonathan Dieter [Fri, 4 May 2018 14:25:57 +0000 (17:25 +0300)]
Split common utility functions out of individual utilities
Signed-off-by: Jonathan Dieter <jdieter@gmail.com>
Jonathan Dieter [Thu, 3 May 2018 19:52:11 +0000 (22:52 +0300)]
Make zck a proper utility with arguments and help. Still needs some work
on splitting strings.
Signed-off-by: Jonathan Dieter <jdieter@gmail.com>
Jonathan Dieter [Thu, 3 May 2018 19:51:01 +0000 (22:51 +0300)]
Make zck_get_data_length public (like it should be anyway) and fix some
header stuff
Signed-off-by: Jonathan Dieter <jdieter@gmail.com>
Jonathan Dieter [Thu, 3 May 2018 19:50:09 +0000 (22:50 +0300)]
Increase buzhash width and remove typo
Signed-off-by: Jonathan Dieter <jdieter@gmail.com>
Jonathan Dieter [Thu, 3 May 2018 08:00:11 +0000 (11:00 +0300)]
Buzhash integration into zck and some small changes to make buzhash work
correctly
Signed-off-by: Jonathan Dieter <jdieter@gmail.com>
Jonathan Dieter [Thu, 3 May 2018 07:57:55 +0000 (10:57 +0300)]
Add buzhash from urlblock (under MIT license)
Signed-off-by: Jonathan Dieter <jdieter@gmail.com>
Jonathan Dieter [Mon, 30 Apr 2018 06:41:26 +0000 (09:41 +0300)]
Update documentation for zchunk format
Signed-off-by: Jonathan Dieter <jdieter@gmail.com>
Jonathan Dieter [Sun, 29 Apr 2018 19:17:33 +0000 (22:17 +0300)]
Release version 0.4.0 with (hopefully) final incompatible file format
changes
Signed-off-by: Jonathan Dieter <jdieter@gmail.com>
Jonathan Dieter [Sun, 29 Apr 2018 18:15:24 +0000 (21:15 +0300)]
Revamp file structure one last (hopefully) time so we can check the header
checksum without reading the whole header into memory in one go
Signed-off-by: Jonathan Dieter <jdieter@gmail.com>
Jonathan Dieter [Tue, 24 Apr 2018 06:19:30 +0000 (09:19 +0300)]
Add comments to first test
Signed-off-by: Jonathan Dieter <jdieter@gmail.com>
Jonathan Dieter [Sat, 21 Apr 2018 11:25:52 +0000 (14:25 +0300)]
Add first test
Signed-off-by: Jonathan Dieter <jdieter@gmail.com>
Jonathan Dieter [Sat, 21 Apr 2018 11:25:04 +0000 (14:25 +0300)]
Rework build files so we can do testing
Signed-off-by: Jonathan Dieter <jdieter@gmail.com>
Jonathan Dieter [Sat, 21 Apr 2018 11:24:29 +0000 (14:24 +0300)]
Turn off debugging when reading zchunk header
Signed-off-by: Jonathan Dieter <jdieter@gmail.com>
projects / zchunk.git / log