summary |
shortlog | log |
commit |
commitdiff |
tree
first ⋅ prev ⋅ next
Jonathan Dieter [Mon, 30 Apr 2018 06:41:26 +0000 (09:41 +0300)]
Update documentation for zchunk format
Signed-off-by: Jonathan Dieter <jdieter@gmail.com>
Jonathan Dieter [Sun, 29 Apr 2018 19:17:33 +0000 (22:17 +0300)]
Release version 0.4.0 with (hopefully) final incompatible file format
changes
Signed-off-by: Jonathan Dieter <jdieter@gmail.com>
Jonathan Dieter [Sun, 29 Apr 2018 18:15:24 +0000 (21:15 +0300)]
Revamp file structure one last (hopefully) time so we can check the header
checksum without reading the whole header into memory in one go
Signed-off-by: Jonathan Dieter <jdieter@gmail.com>
Jonathan Dieter [Tue, 24 Apr 2018 06:19:30 +0000 (09:19 +0300)]
Add comments to first test
Signed-off-by: Jonathan Dieter <jdieter@gmail.com>
Jonathan Dieter [Sat, 21 Apr 2018 11:25:52 +0000 (14:25 +0300)]
Add first test
Signed-off-by: Jonathan Dieter <jdieter@gmail.com>
Jonathan Dieter [Sat, 21 Apr 2018 11:25:04 +0000 (14:25 +0300)]
Rework build files so we can do testing
Signed-off-by: Jonathan Dieter <jdieter@gmail.com>
Jonathan Dieter [Sat, 21 Apr 2018 11:24:29 +0000 (14:24 +0300)]
Turn off debugging when reading zchunk header
Signed-off-by: Jonathan Dieter <jdieter@gmail.com>
Jonathan Dieter [Fri, 20 Apr 2018 17:36:54 +0000 (20:36 +0300)]
Bump to 0.3.0 with file format changes
Signed-off-by: Jonathan Dieter <jdieter@gmail.com>
Jonathan Dieter [Fri, 20 Apr 2018 17:35:17 +0000 (20:35 +0300)]
Fix memory leak with full data hash
Signed-off-by: Jonathan Dieter <jdieter@gmail.com>
Jonathan Dieter [Fri, 20 Apr 2018 17:27:20 +0000 (20:27 +0300)]
Add zchunk format description
Signed-off-by: Jonathan Dieter <jdieter@gmail.com>
Jonathan Dieter [Fri, 20 Apr 2018 17:23:05 +0000 (20:23 +0300)]
Change file format to support streams and signatures
Signed-off-by: Jonathan Dieter <jdieter@gmail.com>
Jonathan Dieter [Thu, 19 Apr 2018 12:03:42 +0000 (15:03 +0300)]
Fix return value
Signed-off-by: Jonathan Dieter <jdieter@gmail.com>
Jonathan Dieter [Thu, 19 Apr 2018 09:35:26 +0000 (12:35 +0300)]
Rename zck_read_index_hash to the more accurate zck_read_header_hash
Signed-off-by: Jonathan Dieter <jdieter@gmail.com>
Jonathan Dieter [Tue, 17 Apr 2018 13:30:03 +0000 (16:30 +0300)]
Bump to 0.2.2
Signed-off-by: Jonathan Dieter <jdieter@gmail.com>
Jonathan Dieter [Tue, 17 Apr 2018 13:25:39 +0000 (16:25 +0300)]
Get rid of warnings on EL7 gcc
Signed-off-by: Jonathan Dieter <jdieter@gmail.com>
Jonathan Dieter [Tue, 17 Apr 2018 11:11:18 +0000 (14:11 +0300)]
Cast size_t to unsigned long and ssize_t to long so we don't get warnings
with 32-bit architectures
Signed-off-by: Jonathan Dieter <jdieter@gmail.com>
Jonathan Dieter [Tue, 17 Apr 2018 10:57:34 +0000 (13:57 +0300)]
We use some gnu99 options, so set gnu99
Signed-off-by: Jonathan Dieter <jdieter@gmail.com>
Jonathan Dieter [Tue, 17 Apr 2018 10:54:51 +0000 (13:54 +0300)]
Fix off by one error
Jonathan Dieter [Tue, 17 Apr 2018 10:54:23 +0000 (13:54 +0300)]
Make sure we hand invalid reads in zck tool
Signed-off-by: Jonathan Dieter <jdieter@gmail.com>
Jonathan Dieter [Tue, 17 Apr 2018 09:28:59 +0000 (12:28 +0300)]
Bump to 0.2.1
Signed-off-by: Jonathan Dieter <jdieter@gmail.com>
Jonathan Dieter [Tue, 17 Apr 2018 09:28:34 +0000 (12:28 +0300)]
Make sure we're using all function results
Signed-off-by: Jonathan Dieter <jdieter@gmail.com>
Jonathan Dieter [Tue, 17 Apr 2018 09:28:00 +0000 (12:28 +0300)]
Give all functions warn_unused_result and make sure warnings are turned on
Signed-off-by: Jonathan Dieter <jdieter@gmail.com>
Jonathan Dieter [Tue, 17 Apr 2018 07:18:32 +0000 (10:18 +0300)]
Bump release to 0.2.0
Signed-off-by: Jonathan Dieter <jdieter@gmail.com>
Jonathan Dieter [Mon, 16 Apr 2018 12:17:04 +0000 (15:17 +0300)]
End chunk when closing zchunk file that was open for writing
Signed-off-by: Jonathan Dieter <jdieter@gmail.com>
Jonathan Dieter [Mon, 16 Apr 2018 09:42:52 +0000 (12:42 +0300)]
Reorganize header so download stuff is at the end
Signed-off-by: Jonathan Dieter <jdieter@gmail.com>
Jonathan Dieter [Mon, 16 Apr 2018 09:40:35 +0000 (12:40 +0300)]
Revamp how options are set
Signed-off-by: Jonathan Dieter <jdieter@gmail.com>
Jonathan Dieter [Sun, 15 Apr 2018 18:46:16 +0000 (21:46 +0300)]
Change zck_get_index_digest and zck_get_data_digest to return string
version of digest and make sure digest isn't cleared after closing file
for writing
Signed-off-by: Jonathan Dieter <jdieter@gmail.com>
Jonathan Dieter [Sun, 15 Apr 2018 18:44:45 +0000 (21:44 +0300)]
Make set_comp_parameter parameter const
Signed-off-by: Jonathan Dieter <jdieter@gmail.com>
Jonathan Dieter [Fri, 13 Apr 2018 11:05:32 +0000 (14:05 +0300)]
Only make API functions public using -fvisibility
Signed-off-by: Jonathan Dieter <jdieter@gmail.com>
Jonathan Dieter [Wed, 11 Apr 2018 17:13:21 +0000 (20:13 +0300)]
Make binaries work with dict change
Signed-off-by: Jonathan Dieter <jdieter@gmail.com>
Jonathan Dieter [Wed, 11 Apr 2018 17:12:58 +0000 (20:12 +0300)]
Finish last commit
Signed-off-by: Jonathan Dieter <jdieter@gmail.com>
Jonathan Dieter [Wed, 11 Apr 2018 16:56:57 +0000 (19:56 +0300)]
When setting compression dictionary, make immediate copy
Signed-off-by: Jonathan Dieter <jdieter@gmail.com>
Jonathan Dieter [Tue, 10 Apr 2018 15:10:43 +0000 (18:10 +0300)]
Make sure executables get installed
Signed-off-by: Jonathan Dieter <jdieter@gmail.com>
Jonathan Dieter [Tue, 10 Apr 2018 13:00:04 +0000 (16:00 +0300)]
Add ability to get index based on file location
Signed-off-by: Jonathan Dieter <jdieter@gmail.com>
Jonathan Dieter [Tue, 10 Apr 2018 12:59:43 +0000 (15:59 +0300)]
Rewrite binaries to use new API
Signed-off-by: Jonathan Dieter <jdieter@gmail.com>
Jonathan Dieter [Tue, 10 Apr 2018 12:59:18 +0000 (15:59 +0300)]
Reorganize the main header so it's easier to understand
Signed-off-by: Jonathan Dieter <jdieter@gmail.com>
Jonathan Dieter [Tue, 10 Apr 2018 12:57:19 +0000 (15:57 +0300)]
Massive work changing API to support zck_read and zck_write functions
Signed-off-by: Jonathan Dieter <jdieter@gmail.com>
Jonathan Dieter [Wed, 4 Apr 2018 07:30:08 +0000 (10:30 +0300)]
Rename dl.c/write_data to dl.c/dl_write_data as we use write_data()
elsewhere
Signed-off-by: Jonathan Dieter <jdieter@gmail.com>
Jonathan Dieter [Tue, 3 Apr 2018 10:02:26 +0000 (13:02 +0300)]
Rename zck_compress to zck_write and zck_decompress to zck_read and
reorder some functions in comp.c
Signed-off-by: Jonathan Dieter <jdieter@gmail.com>
Jonathan Dieter [Tue, 3 Apr 2018 07:20:01 +0000 (10:20 +0300)]
Rename io functions
Signed-off-by: Jonathan Dieter <jdieter@gmail.com>
Jonathan Dieter [Mon, 26 Mar 2018 19:05:01 +0000 (22:05 +0300)]
When compressing file, automatically start compression if it hasn't already
been started.
Signed-off-by: Jonathan Dieter <jdieter@gmail.com>
Jonathan Dieter [Mon, 26 Mar 2018 09:30:07 +0000 (12:30 +0300)]
Remove infinite loop if there's no dict in file
Signed-off-by: Jonathan Dieter <jdieter@gmail.com>
Jonathan Dieter [Mon, 26 Mar 2018 09:29:50 +0000 (12:29 +0300)]
Fix compression so it works correctly if there's no dict
Signed-off-by: Jonathan Dieter <jdieter@gmail.com>
Jonathan Dieter [Sat, 24 Mar 2018 14:54:19 +0000 (16:54 +0200)]
Change compression so it's streamed. Decompression is still on a chunk-by-
chunk basis.
Signed-off-by: Jonathan Dieter <jdieter@gmail.com>
Jonathan Dieter [Fri, 23 Mar 2018 13:36:46 +0000 (15:36 +0200)]
Switch to multi-step chunk addition to pave the way for streaming
compression
Signed-off-by: Jonathan Dieter <jdieter@gmail.com>
Jonathan Dieter [Fri, 23 Mar 2018 11:51:24 +0000 (13:51 +0200)]
Store uncompressed size in index
Signed-off-by: Jonathan Dieter <jdieter@gmail.com>
Jonathan Dieter [Fri, 23 Mar 2018 10:48:10 +0000 (12:48 +0200)]
Change name of compressed length in index to comp_length in preparation
for adding uncompressed length
Signed-off-by: Jonathan Dieter <jdieter@gmail.com>
Jonathan Dieter [Fri, 23 Mar 2018 10:35:55 +0000 (12:35 +0200)]
Make a number of zckDL fields private
Signed-off-by: Jonathan Dieter <jdieter@gmail.com>
Jonathan Dieter [Thu, 22 Mar 2018 11:13:16 +0000 (13:13 +0200)]
Use add_project_arguments instead of use_global_arguments
Signed-off-by: Jonathan Dieter <jdieter@gmail.com>
Jonathan Dieter [Thu, 22 Mar 2018 09:00:23 +0000 (11:00 +0200)]
More documentation in zck.h
Signed-off-by: Jonathan Dieter <jdieter@gmail.com>
Jonathan Dieter [Thu, 22 Mar 2018 08:28:30 +0000 (10:28 +0200)]
Some more documentation on zck binary
Signed-off-by: Jonathan Dieter <jdieter@gmail.com>
Jonathan Dieter [Thu, 22 Mar 2018 08:27:34 +0000 (10:27 +0200)]
Rename zckRange to zckRangeItem and zckRangeInfo to zckRange
Signed-off-by: Jonathan Dieter <jdieter@gmail.com>
Jonathan Dieter [Thu, 22 Mar 2018 08:26:02 +0000 (10:26 +0200)]
Rename zckIndex to zckIndexItem and zckIndexInfo to zckIndex
Signed-off-by: Jonathan Dieter <jdieter@gmail.com>
Jonathan Dieter [Thu, 22 Mar 2018 08:24:34 +0000 (10:24 +0200)]
More documentation
Signed-off-by: Jonathan Dieter <jdieter@gmail.com>
Jonathan Dieter [Wed, 21 Mar 2018 19:25:28 +0000 (21:25 +0200)]
Initial rudimentary documentation for zck.h
Signed-off-by: Jonathan Dieter <jdieter@gmail.com>
Jonathan Dieter [Wed, 21 Mar 2018 19:06:25 +0000 (21:06 +0200)]
Add index size to download amount since we're guaranteed to have to
download the target index
Signed-off-by: Jonathan Dieter <jdieter@gmail.com>
Jonathan Dieter [Wed, 21 Mar 2018 18:57:50 +0000 (20:57 +0200)]
Fix zckdl to work with compressed integers
Signed-off-by: Jonathan Dieter <jdieter@gmail.com>
Jonathan Dieter [Wed, 21 Mar 2018 13:08:35 +0000 (15:08 +0200)]
Initial work in switching to compressed integers in header and index
Signed-off-by: Jonathan Dieter <jdieter@gmail.com>
Jonathan Dieter [Tue, 20 Mar 2018 14:07:34 +0000 (16:07 +0200)]
Write to output file rather than temporary file
Signed-off-by: Jonathan Dieter <jdieter@gmail.com>
Jonathan Dieter [Tue, 20 Mar 2018 14:07:03 +0000 (16:07 +0200)]
Extra error checking
Signed-off-by: Jonathan Dieter <jdieter@gmail.com>
Jonathan Dieter [Mon, 19 Mar 2018 19:11:51 +0000 (21:11 +0200)]
Split multirange parsing into multipart.c
Signed-off-by: Jonathan Dieter <jdieter@gmail.com>
Jonathan Dieter [Mon, 19 Mar 2018 13:12:29 +0000 (15:12 +0200)]
Switch download code to POSIX extended regex for more flexibility
Signed-off-by: Jonathan Dieter <jdieter@gmail.com>
Jonathan Dieter [Tue, 13 Mar 2018 19:10:04 +0000 (21:10 +0200)]
Finish code to allow downloading of zck files
Signed-off-by: Jonathan Dieter <jdieter@gmail.com>
Jonathan Dieter [Tue, 13 Mar 2018 19:09:02 +0000 (21:09 +0200)]
Add preindex_size so we can easily figure out how far to seek in file, and
add offset to zck_read_header so we're getting real locations
Signed-off-by: Jonathan Dieter <jdieter@gmail.com>
Jonathan Dieter [Sun, 11 Mar 2018 08:58:19 +0000 (10:58 +0200)]
We can now download the missing parts of a zck file. Still need to write
the code to combine them with the old parts.
Signed-off-by: Jonathan Dieter <jdieter@gmail.com>
Jonathan Dieter [Sun, 11 Mar 2018 08:57:18 +0000 (10:57 +0200)]
Make sure we clear zckRangeInfo when closing it
Signed-off-by: Jonathan Dieter <jdieter@gmail.com>
Jonathan Dieter [Sun, 11 Mar 2018 08:56:55 +0000 (10:56 +0200)]
Remove unsuitable multipart_parser code
Signed-off-by: Jonathan Dieter <jdieter@gmail.com>
Jonathan Dieter [Sun, 11 Mar 2018 08:56:41 +0000 (10:56 +0200)]
Make zckDL struct public and add in function to get temporary fd and
download range based on url and zckDL
Signed-off-by: Jonathan Dieter <jdieter@gmail.com>
Jonathan Dieter [Sun, 11 Mar 2018 08:54:39 +0000 (10:54 +0200)]
Fix bug in detecting failure to allocate zckCtx
Signed-off-by: Jonathan Dieter <jdieter@gmail.com>
Jonathan Dieter [Wed, 7 Mar 2018 11:31:14 +0000 (13:31 +0200)]
Add null parameter checking for public functions
Signed-off-by: Jonathan Dieter <jdieter@gmail.com>
Jonathan Dieter [Wed, 7 Mar 2018 11:30:49 +0000 (13:30 +0200)]
Finish refactoring zckIndex and zckIndexInfo
Signed-off-by: Jonathan Dieter <jdieter@gmail.com>
Jonathan Dieter [Wed, 7 Mar 2018 10:18:33 +0000 (12:18 +0200)]
Add missing test directory
Signed-off-by: Jonathan Dieter <jdieter@gmail.com>
Jonathan Dieter [Wed, 7 Mar 2018 10:17:08 +0000 (12:17 +0200)]
Update LICENSE and README
Jonathan Dieter [Wed, 7 Mar 2018 07:48:33 +0000 (09:48 +0200)]
Initial commit
Signed-off-by: Jonathan Dieter <jdieter@gmail.com>
Jonathan Dieter [Wed, 7 Mar 2018 07:46:21 +0000 (09:46 +0200)]
Initial commit