Тёмный

Raul Fraile: How GZIP compression works | JSConf EU 2014 

JSConf
Подписаться 284 тыс.
Просмотров 23 тыс.
50% 1

Data compression is an amazing topic. Even in today’s world, with fast networks and almost unlimited storage, data compression is still relevant, especially for mobile devices and countries with poor Internet connections.
For better or worse, GZIP compression is the de-facto lossless compression method for compressing text data in websites. It is not the fastest nor the better, but provides an excellent tradeoff between speed and compression ratio. The way Internet works makes it also difficult to use newer compression methods.
This talk examines how GZIP works internally, explaining the internals of the DEFLATE algorithm, which is a combination of LZ77 and Huffman coding. Different implementations will be compared, such as GNU GZIP, 7-ZIP and zopfli, focusing on why and how some of these implementations perform better than others.
Finally, we will try to go beyond GZIP, preprocessing our data to achieve better results. For example, transposing JSON.
Transcript & slides: 2014.jsconf.eu/...
License: For reuse of this video under a more permissive license please get in touch with us. The speakers retain the copyright for their performances.

Опубликовано:

 

3 окт 2024

Поделиться:

Ссылка:

Скачать:

Готовим ссылку...

Добавить в:

Мой плейлист
Посмотреть позже
Комментарии : 15   
4 года назад
Why is the presenter taking up the majority of the screen instead of the slides 90% of the time? Text is unreadable.
@pauldacus4590
@pauldacus4590 6 лет назад
4:31 "facial eggs presentations" Machine translations FTW!
@Bajo85
@Bajo85 2 года назад
Loved the presentation, thanks!
@pankaj.parkar
@pankaj.parkar 6 лет назад
Nice informative and neatly presented. Thanks alot
@nooxis
@nooxis 10 лет назад
Great talk. Thanks!
@disorderedenthropy
@disorderedenthropy 6 лет назад
what's the difference between gzip and zlib?
@baganatube
@baganatube 6 лет назад
Both gzip and zlib streams are very thin container formats around the Deflate algorithm. Gzip can contain slightly more extra information (timestamps, filenames, comments, etc), but not in practice. Although both of them do allow algorithms other than Deflate, neither actually defines any. Read RFC 1950, 1951, and 1952, they are all quite short.
@SalmanRavoof
@SalmanRavoof 4 года назад
zlib is an abstraction of gzip. They both work on the same algorithm, but zlib is just a library.
@Chai-T-Rex
@Chai-T-Rex 3 месяца назад
@@baganatube Are you certain that gzip is a container format? You generally need to use .tar.gz with tar being the container format and gz being mere compression.
@baganatube
@baganatube 3 месяца назад
@@Chai-T-Rex By "container" I didn't mean collecting multiple files into one stream, for which you need a format like tar.
@Chai-T-Rex
@Chai-T-Rex 3 месяца назад
@@baganatube Ahh, OK. I looked into it and I didn't know that gzip stored the original filename. Thanks!
@Crazzilla
@Crazzilla 9 лет назад
Does Gzip change what you see when using View Source?
@MaddGameMaker
@MaddGameMaker 7 лет назад
no
@joeye6556
@joeye6556 Год назад
11:04 that huffman encoding is wrong. its impossible to tell whether the first 3 0s are 3 Ls, an H and an L, or a D. Dude didn't even try to make a proper huffman tree, just listed binary strings in lexicographical order and assigned a value to them.
@chinoto1
@chinoto1 10 месяцев назад
I thought the same thing, but he starts correcting that 10 seconds later.
Далее
How Gzip Compression Works
19:10
Просмотров 2,4 тыс.
🎙Пою РЕТРО Песни💃
3:05:57
Просмотров 1,3 млн
Image compression deep-dive
31:32
Просмотров 53 тыс.
How File Compression Works
11:25
Просмотров 264 тыс.
Variable Length Codes (Ep 1, Compressor Head)
20:16
Просмотров 50 тыс.
Explaining File Compression Formats
15:26
Просмотров 145 тыс.
The Beauty of Lempel-Ziv Compression
11:23
Просмотров 53 тыс.
Markov Chain Compression (Ep 3, Compressor Head)
19:33