- Research Article
17
- 10.1147/rd.501.0149
An approximation to the greedy algorithm for differential compression
- Jan 01, 2006
- IBM Journal of Research and Development
- R C Agarwal + 3 more +3
We present a new algorithm that combines the hash value techniques and suffix array techniques of previous work. The term differential compression refers to encoding a file (a version file) as a set of changes with respect to another file (a reference file). Previous algorithms can be shown empirically to run in linear time, but they have certain drawbacks; namely, they do not find the best matches for every offset of the version file. Our algorithm, hsadelta (hash suffix array delta), finds the best matches for every offset of the version file, with respect to a certain granularity and above a certain length threshold. The algorithm has two variations depending on how we choose the block size. We show that if the block size is kept fixed, the performance of the algorithm is similar to that of the greedy algorithm, without the associated expensive space and time requirements. If the block size is varied linearly with the reference file size, the algorithm can run in linear time and constant space. We also show empirically that the algorithm performs better than other state-of-the-art algorithms in terms of and is comparable in speed.
Read more