Commit Graph

139 Commits

Author SHA1 Message Date
emmanuel-marty
a708a02048 Fix compilation warning 2019-05-14 12:18:35 +02:00
emmanuel-marty
277b5b1025 Move top-level streaming compression code to library 2019-05-13 22:22:53 +02:00
emmanuel-marty
0f4ffa7166 Clean up check for emitting a single raw block 2019-05-12 23:21:50 +02:00
emmanuel-marty
c96594680a Use full BLOCK_SIZE for dictionary, and use last BLOCK_SIZE bytes rather than first 2019-05-12 14:44:28 +02:00
emmanuel-marty
3caa72c722 Clarify optimizer 2019-05-11 11:42:18 +02:00
emmanuel-marty
8b7b4a2b4f Check in LZSA2 implementation (ratio competitive with ZX7, faster decompression) 2019-05-09 16:51:29 +02:00
emmanuel-marty
49b0739050 Isolate frame implementation details 2019-05-03 19:17:14 +02:00
emmanuel-marty
31ededcdf7 Rejoin large patterns 2019-05-03 13:45:37 +02:00
emmanuel-marty
bab5225e4c Implement dictionary support 2019-05-02 18:38:57 +02:00
emmanuel-marty
ef6b43a296 When using -m, decompress ~7% faster by trading ~0.5% of compression ratio 2019-05-02 11:23:57 +02:00
emmanuel-marty
9e75a55dd3 Reduce token count by 1% without changing the ratio 2019-04-25 13:01:56 +02:00
emmanuel-marty
2b9780bd65 Finalize lzsa1 compressed format, speed up and simplify decompression 2019-04-24 09:47:40 +02:00
emmanuel-marty
593110ae5d Fix parsing of -m option 2019-04-22 14:16:25 +02:00
emmanuel-marty
331d6f9911 Add --prefer-ratio, --prefer-speed, -m options 2019-04-21 09:41:12 +02:00
emmanuel-marty
6c4a86c9fe Make compression 5% faster 2019-04-20 16:24:54 +02:00
emmanuel-marty
fb79d319cb Speed up portable decompressor a bit 2019-04-20 10:27:24 +02:00
emmanuel-marty
3e5639afaf Reduce token count further 2019-04-20 10:26:45 +02:00
emmanuel-marty
88054841cf Add strict block checks when decompressing, comparing 2019-04-20 10:26:13 +02:00
emmanuel-marty
aa5dbe283d Small optimization to the cost model 2019-04-13 12:33:39 +02:00
emmanuel-marty
4913fe5d48 Fix reporting of compressed size for raw mode 2019-04-13 12:33:25 +02:00
emmanuel-marty
cf51f1775a Fix small literals cost estimate issue in optimizer, gain a small amount of compression and reduction of token count 2019-04-11 23:47:57 +02:00
emmanuel-marty
2451d5802e Fix typo in lzsa tool 2019-04-10 17:38:22 +02:00
emmanuel-marty
9649073131 Speed up compression 2019-04-08 09:44:07 +02:00
emmanuel-marty
837b6895cf Further reduce the number of tokens for even better decompression speed; increase compression slightly 2019-04-07 15:10:53 +02:00
emmanuel-marty
9c35d5115b When verbose, display uncompressed bytes/token ratio 2019-04-07 15:10:17 +02:00
emmanuel-marty
6aa2dae4b3 Add context to libdivsufsort, don't allocate memory during compression 2019-04-07 00:01:22 +02:00
emmanuel-marty
1353573af1 Small cleanup for end-of-data handling in decompression, check commands 2019-04-06 00:02:11 +02:00
emmanuel-marty
a785010448 Revert token to O|LLL|MMMM; revert to always shifting the match offset by 1; set raw block end marker as a large zero-size match 2019-04-05 23:16:05 +02:00
emmanuel-marty
06e6a14871 Add optimization pass to reduce the number of command tokens in the compressed data blocks without changing the compression ratio 2019-04-05 16:32:11 +02:00
emmanuel-marty
f05359b63d Don't write an unnecessary footer byte when emitting a raw block 2019-04-05 12:13:51 +02:00
emmanuel-marty
1ef1ad8111 Reorganize token byte for faster decoding on 8-bit CPUs, without affecting the compression ratio 2019-04-05 11:58:44 +02:00
emmanuel-marty
c7692cf688 Store 16-bit lengths and match offsets directly, to simplify decompression on 8-bit CPUs without affecting the compression ratio 2019-04-05 10:42:06 +02:00
emmanuel-marty
c86d38ba63 Reduce the number of literals required at the end of a compressed block 2019-04-05 09:28:16 +02:00
emmanuel-marty
18fc4da994 Implement raw block mode 2019-04-03 13:05:10 +02:00
emmanuel-marty
11d1ff8cd7 Use 3-byte file header 2019-04-03 11:26:36 +02:00
emmanuel-marty
1f04705845 Fix degenerate case; use full 32 bits for suffix array intervals; make EOD parsable by a decompressor as a long 0 match offset as well; use more aggressive compression settings. 2019-04-03 10:16:12 +02:00
emmanuel-marty
fcfdbe9745 Add autodocs to internal compressor functions 2019-04-02 15:03:21 +02:00
emmanuel-marty
8b992bb33a Add autodocs to public functions in compressor and decompressor 2019-04-02 12:12:12 +02:00
marty-emmanuel
e216b0c544 Initial checkin 2019-04-01 18:04:56 +02:00