1 2 3 File Names Actual Sizes Actual Sizes Calgary Bib book1 book2 News paper1 paper2 paper3 paper4 paper5 paper6 Progc Progl Progp Trans File Names Canterbury 111261 768771 610856 377109 53161 82199 46526 13286 11954 38105 39611 71646 49379 93695 alice29 txt asyoulik txt cp html fields c grammar lsp lcet10 txt plrabn12 txt xargs 1 bible txt kjv Gutenberg world192 txt 152089 125179 24603 11150 3721 426754 481861 4227 4047392 4846137 2473400 Project Gutenberg 1musk10 txt anne11 txt world95 txt 1344739 586960 2988578 Table 1 Text files used in our tests a Table showing text files and their sizes from Calgary Corpus Table showing text files and their sizes from Canterbury Corpus and Project Gutenberg FileNames Calgary paper5 paper4 paper6 Progc paper3 Progp paper1 Progl paper2 Trans Bib News Book2 Book1 Average BPC Bzip2 BPC 3 24 3 12 2 58 2 53 2 72 1 74 2 49 1 74 2 44 1 53 1 97 2 52 2 06 2 42 2 36 Bzip2 with LIPT BPC FileNames Canterbury 2 95 grammar lsp 2 74 xargs 1 2 40 fields c 2 44 cp html 2 45 asyoulik txt 1 72 alice29 txt 2 33 lcet10 txt 1 66 plrabn12 txt 2 26 world192 txt 1 47 bible txt 1 93 kjv gutenberg 2 45 Average BPC 1 99 2 31 Bzip2 with LIPT Bzip2 BPC BPC FileNames Gutenberg 2 76 2 58 Anne11 txt 3 33 3 10 1musk10 txt 2 18 2 14 World95 txt 2 48 2 44 Average BPC 2 53 2 42 2 27 2 13 2 02 1 91 2 42 2 33 1 58 1 52 1 67 1 62 1 66 1 62 2 26 2 17 b Bzip2 BPC Bzip2 with LIPT BPC 2 22 2 08 1 54 1 95 2 12 1 98 1 49 1 86 2 22 Table 2 Tables a c show BPC comparison between original Bzip2 9 and Bzip2 9 with LIPT for the files in three corpuses a b c a b 4 c PPMD PPMD PPMD with with with PPMD LIPT PPMD LIPT FileNames BPC BPC FileNames BPC LIPT FileNames Calgary Canterbury Gutenberg paper5 2 98 2 74 grammar lsp 2 36 2 21 Anne11 txt 2 13 2 04 paper4 2 89 2 57 xargs 1 2 94 2 73 1musk10 txt 1 91 1 85 paper6 2 41 2 29 fields c 2 04 1 97 World95 txt 1 48 1 45 Progc 2 36 2 30 cp html 2 26 2 22 Average BPC 1 84 1 78 paper3 2 58 2 37 asyoulik txt 2 47 2 35 Progp 1 70 1 68 alice29 txt 2 18 2 06 paper1 2 33 2 21 lcet10 txt 1 93 1 86 Progl 1 68 1 61 plrabn12 txt 2 32 2 27 paper2 2 32 2 17 world192 txt 1 49 1 45 Trans 1 47 1 41 bible txt 1 60 1 57 Bib 1 86 1 83 kjv gutenberg 1 57 1 55 news 2 35 2 31 Average BPC 2 11 2 02 book2 1 96 1 91 book1 2 30 2 23 Average BPC 2 23 2 12 Table 3 Tables a c show BPC comparison between original PPMD order 5 and PPMD order 5 with LIPT for the files in three corpuses PPMD BPC a FileNames Calgary paper5 paper4 paper6 Progc paper3 Progp paper1 Progl paper2 Trans bib news book2 book1 Average BPC b Gzip BPC 3 34 3 33 2 77 2 68 3 11 1 81 2 79 1 80 2 89 1 61 2 51 3 06 2 70 3 25 2 69 c Gzip with Gzip with LIPT Gzip LIPT BPC FileNames BPC BPC Canterbury 3 05 grammar lsp 2 68 2 61 2 95 xargs 1 3 32 3 13 2 61 fields c 2 25 2 21 2 61 Cp html 2 60 2 55 2 76 asyoulik txt 3 12 2 89 1 81 alice29 txt 2 85 2 60 2 57 lcet10 txt 2 71 2 42 1 74 plrabn12 txt 3 23 2 96 2 62 world192 txt 2 33 2 18 1 56 bible txt 2 33 2 18 2 41 kjv gutenberg 2 34 2 19 2 93 Average BPC 2 70 2 54 2 48 2 96 2 51 FileNames Gutenberg Anne11 txt 1musk10 txt World95 txt Average BPC Gzip BPC Gzip with LIPT BPC 3 02 2 91 2 31 2 75 2 75 2 62 2 15 2 51 Table 4 Tables a c show BPC comparison between original Gzip 9 and Gzip 9 with LIPT for the files in three corpuses 5 BPC COMPARISON 3 5 3 2 5 BPC Bzip2 2 Bzip2 LIPT PPMD 1 5 PPMD LIPT 1 0 5 kjv gutenberg world95 txt book1 anne11 txt plrabn12 txt news alice29 txt asyoulik txt trans paper2 progl progp progc cp html paper4 paper5 fields c 0 Files Figure 3 Bar Chart giving comparison of Bzip2 Bzip2 with LIPT PPMD and PPPMD with LIPT Huffman character based Arithmetic word based Gzip 9 Bzip2 PPMD encoded BPC 4 12 2 90 2 52 2 24 2 13 Original BPC 4 87 2 71 2 70 2 28 2 13 Table 5 Summary of BPC Results 6 LIPT BPC 4 49 2 61 2 52 2 16 2 04 File Ref No 1 Ref No 2 Ref No 4 Bzip2 with LIPT 2 05 2 29 2 02 2 55 2 59 2 49 2 68 1 86 1 85 1 63 2 21 1 94 2 33 2 00 2 47 2 44 2 39 2 47 1 70 1 69 1 47 2 105 1 94 2 29 2 00 2 48 2 45 2 39 2 51 1 71 1 71 1 48 2 11 1 93 2 31 1 99 2 45 2 33 2 26 2 44 1 66 1 72 1 47 2 07 bib book1 book2 news paper1 paper2 progc progl progp trans Average BPC Table 6 BPC comparison of approaches based on BWT File bib book1 book2 news paper1 paper2 progc progl progp trans Average BPC Ref No 11 Ref No 7 PPMD order 5 with LIPT 1 86 2 22 1 92 2 36 2 33 2 27 2 38 1 66 1 64 1 43 2 021 1 84 2 39 1 97 2 37 2 32 2 33 2 34 1 59 1 56 1 38 2 026 1 83 2 23 1 91 2 31 2 21 2 17 2 30 1 61 1 68 1 41 1 98 Table 7 BPC comparison of new approaches based on Prediction Models 7 cp html paper6 progc paper1 progp progl trans bib asyoulik txt alice29 txt lcet10 txt news book2 anne11 txt 1musk10 txt world192 txt world95 txt kjv gutenberg AVERAGE Filesize 21333 32528 33736 42199 44862 62367 90985 105945 108140 132534 307026 324476 479612 503408 1101083 1884748 2054715 4116876 Bzip2 with LIPT 2 03 2 506 2 508 2 554 1 733 1 729 1 368 1 642 2 525 2 305 2 466 2 582 …