#Is it possible to compress a file by passing the (indexed) binary data into auto-encoder network?

3 messages · Page 1 of 1 (latest)

nova ether
#

can it do it? or the accuracy would be the issue.

coarse gyro
#

The answer is yes, you should theoretically be able to do it in most cases. "Accuracy" or "Noise" are not really an issue for compression. Read about Huffman coding (https://en.wikipedia.org/wiki/Huffman_coding) to get some idea of how it could work.

Huffman coding

In computer science and information theory, a Huffman code is a particular type of optimal prefix code that is commonly used for lossless data compression. The process of finding or using such a code proceeds by means of Huffman coding, an algorithm developed by David A. Huffman while he was a Sc.D. student at MIT, and published in the 1952 pape...

#

You could for example make a network that can predict the next symbol/byte in a file and then whenever it makes a correct prediction, you use just 1 bit to encode that. Otherwise you use 9 bits to encode the correct byte (1 extra bit to mark the prediction incorrect).