Transparent (de)compression
This is a large MR but brings significant improvements:
- All (de)compression is done transparently in-process
- Detected from the file extension for outputs
- Detected from the file extension and/or file magic for the standard input
- Removes a huge footgun in that you can specify a
archive.tar.gzbut without specifyingcompressit will actually create atar - A new
//tar/toolprovides a central tool for generaltarmanipulation - The
tar_concatenate/tar_filterrule implementations become simple due to//tar/toolaccepting input/outputs as arguments - Hopefully, improvements in speed as it removes the need for all the pipes
Edited by Matthew Clarkson