Archiving and compression
The traditional Unix archiving and compression tools are separated according to the Unix philosophy:
- A file archiver combines several files into one archive file, e.g. tar.
- A compression tool compresses and decompresses data, e.g. gzip.
These tools are often used in sequence by firstly creating an archive file and then compressing it.
Of course there are also tools that do both, which tend to additionally offer encryption, error detection and recovery.
Archiving only
| Name | Package | Manuals | Description |
|---|---|---|---|
| GNU tar | tar | tar(1), info | Core utility for manipulating the ubiquitous tar archives (tarballs), which are used by pacman and the AUR. |
| libarchive | libarchive | bsdtar(1) bsdcpio(1) | Implementation of tar and cpio that also offers a library. Used by pacman and mkinitcpio. |
| ar | binutils | ar(1) | Legacy Unix archiver before tar. Today only used for creating static library files. |
| cpio | cpio | cpio(1) | File archiver via stdin/stdout, supports cpio and tar formats. |
| DAR | darAUR | Archiver to backup large live filesystems, takes care of hard links, extended attributes, sparse files and inode types. |
--use-compress-program=lz4/-Ilz4). When creating archives both support the -a switch to automatically filter the created archive through the right compression program based on the file extension. While BSD tar recognizes compression formats based on the format, GNU tar only guesses based on the file extension.See also #Archiving only usage.
Compression tools
Compression only
These compression programs implement their own file format.
| Name | Package | Manual | Ext | Tar ext | Description | Parallel implementations |
|---|---|---|---|---|---|---|
| bzip2 | .bz2, .bz | .tbz2, .tbz | Uses the Burrows–Wheeler algorithm. | , pbzip2 | ||
| gzip | .gz, .z | .tgz, .taz | GNU zip, based on DEFLATE algorithm. | |||
| lrzip | lrzip(1) | .lrz | Improved version of rzip, uses multiple algorithms. | is multithreaded | ||
| LZ4 | .lz4 | Written in C, focused on compression and decompression speed. | is multithreaded | |||
| lzip | .lz | Uses LZMA. | ||||
| lzop | lzop | .lzop | .tzo | Uses the LZO library (). | ||
| xz | .xz, .lzma | .txz, .tlz | Uses LZMA, default for GNU and kernel archive files. | is multithreaded, , pxz-gitAUR | ||
| zstd | .zst | Uses Zstandard algorithm. | is multithreaded | |||
- Parallel implementations offer improved speeds by using multiple CPU cores.
- Tar extensions refers to compressed archives where and the compression tool is used, e.g.
.tzois . - See also #Compression only usage.
Archiving and compression
| Name | Packages | Manuals | Ext | Description |
|---|---|---|---|---|
| p7zip | .7z | The third-party POSIX port of 7-zip's command-line. | ||
| 7-Zip | - | The upstream Linux version of a file archiver with a high compression ratio. | ||
| RAR | , | .rar | Both the format and the rar utility are proprietary. | |
| ZIP | zip, | , | .zip | Widely used outside of the Linux world. |
| Unarchiver | unar(1), | many | Command-line tool of a Mac application, supports over 40 archive formats. | |
| ZPAQ | .zpaq | A high compression ratio archiver written in C++, uses several algorithms. | ||
| LHa | , | lha(1) | .lzh (on Amiga: .lha) | LZH/LHA archiver, supports the lh7-method. |
See also #Archiving and compression usage.
Feature charts
Some of the tools above are capable of handling multiple formats, allowing for fewer installed packages.
Decompress
| Name | gzip | bzip2 | ZIP | LHa/LZH | RAR | compress | CAB | ARJ |
|---|---|---|---|---|---|---|---|---|
- 's gunzip can only decompress single member ZIP files.
Usage comparison
Archiving only usage
| Name | Create archive | Extract archive | List content |
|---|---|---|---|
| tar(1) | tar -tvf archive.tar | ||
| cpio(1) |
Compression only usage
| Name | Compress | Decompress | Decompress to stdout |
|---|---|---|---|
bzip2 -d file.bz2 | |||
| lrzip(1) | lrzip -d file.lrz | ||
Archiving and compression usage
| Name | Compress | Decompress | Decompress to stdout | List content |
|---|---|---|---|---|
7z a archive.7z file1 file2 | ||||
rar a archive.rar file1 file2 | ||||
| , | ||||
| lha(1) | lha ao7 archive.lzh file1 file2 | minimal: verbose: | ||
Convenience tools
- atool — Script for managing file archives of various types.
Determining archive format
To extract an archive, its file format needs to be determined. If the file is properly named you can deduce its format from the file extension.
Otherwise you can use the tool, see .
Esoteric, rare or deprecated tools
| Name | Packages | Ext | Description |
|---|---|---|---|
| ARC | arcAUR | .arc, .ark | Was very popular during the early days of the dial-up BBS. Superseded by ZIP. |
| ARJ | .arj | An archiver used on DOS/Windows in mid-1990s. This is an open source clone. | |
| compress | .Z | The classic unix compression utility which can handle the ancient .Z archive. | |
| PAR2 | .par2 | Parity archiver for increased data integrity. See also Parchive. | |
| shar | .shar | Creates self-extracting archives that are valid shell scripts. | |
| Zoo | .zoo | Was mostly popular on the OpenVMS operating system before PKZIP became popular. |
Device mapper compression
There is work being done to mainline (integrate into the Linux kernel project) the recently open-sourced VDO project, which provides a deduplication and compression device mapper layer in the interest of increasing storage efficiency. The following packages are available:
- kvdo — A pair of kernel modules which provide pools of deduplicated and/or compressed block storage
Compression libraries
- zlib — Compression library implementing the deflate compression method found in gzip and PKZIP.
Troubleshooting
Garbled Japanese Filenames
Japanese versions of Windows encode ZIP archives with Shift-JIS. By default, these archives will suffer from mojibake filenames when extracted. To extract properly, use `unzip` in the command-line using the shift-jis option.
$ unzip -O shift-jis nihongo.zip