Posts tagged compression
Entropy coding as a text generator
The compression gains of entropy coding revolves around making likely symbols short and unlikely symbols long. In principle you have some pre-arranged model of the string you want to compress and decompress, and you use that model to tell you the likelihoods that different symbols will turn up next and then you distribute the coding space accordingly, so it takes very few bits to land in the likeliest buckets and many more bits to force the outcome to land in an improbable bucket.
Automatic wiki
A project I’ve wanted to do for a long while now, ia a dynamically generated wiki. Use generative AI to produce an encyclopedic-looking page of text with a topic deduced from the URL and the random seed determined by a hash of the URL.