Combine 10,000 small files into a single one

Kunsheng · 10-21-2009, 03:28 PM

I got 10,000 small pieces text files inside a folder and thinking of comebine them together. (append them together)

'cat *' inside the folder failed and reminding me 'argument list too long'.

I know a perl scripts will do but wondering if there is better way (bash command ?)

Any idea is well appreciated,

-Kun

MensaWater · 10-21-2009, 03:46 PM

Duplicate post of:
http://www.linuxquestions.org/questi...ig-one-763441/

lutusp · 10-22-2009, 12:43 AM

Quote:

Originally Posted by Kunsheng

I got 10,000 small pieces text files inside a folder and thinking of comebine them together. (append them together)

'cat *' inside the folder failed and reminding me 'argument list too long'.

I know a perl scripts will do but wondering if there is better way (bash command ?)

Any idea is well appreciated,

-Kun

The problem is that you have 10,000 files in a single folder. How did this happen? Have you considered this solution:

Code:

ls | while read path
do
    cat $path >> masterfile.txt
done

But avoid giving "ls" a wildcard argument -- just let it scan the directory on its own. And in the future, don't put so many files in one directory.

pixellany · 10-22-2009, 02:35 AM

Please post your thread in only one forum. Posting a single thread in the most relevant forum will make it easier for members to help you and will keep the discussion in one place. This thread is being closed because it is a duplicate.