Creating tar in buffer through libarchive and streaming it .

RohitB · 01-11-2019, 05:25 AM

Hi,

I want to create tar stream in buffer one by one and stream it as soon as some bytes are available to send.Whether libarchive support this.
For example I cannot create full tar file in disk or ram.
I need to open a tar stream due to this.
I have buffer of size 1024 bytes and I have 4 file of 2048 bytes.
I want to create a tar stream but at a time my buffer can hold only 1024 bytes so i will read that much byte and flush it again next.
Can any body help on this?

rtmistler · 01-11-2019, 06:14 AM

Quote:

Originally Posted by RohitB

Hi,

I want to create tar stream in buffer one by one and stream it as soon as some bytes are available to send.Whether libarchive support this.
For example I cannot create full tar file in disk or ram.
I need to open a tar stream due to this.
I have buffer of size 1024 bytes and I have 4 file of 2048 bytes.
I want to create a tar stream but at a time my buffer can hold only 1024 bytes so i will read that much byte and flush it again next.
Can any body help on this?

Welcome to LQ,

Have you written any code here? Please review the link in my signature which discusses how to use the Linux Questions site and provide some updates as to your efforts here. Note that you haven't identified the destination for this stream.

serIdol · 04-07-2021, 05:47 PM

Any ideas on (if and) how libarchive handles that kind of streaming would be most appreciated! The destination of such a stream would be a memory buffer that could then be flushed practically anywhere (e.g. for testing purposes, on a file in the filesystem).