Converting 30 GB XML File to CSV file

AkhilSJSU · 10-24-2014, 12:16 AM

I need to convert 30GB of XML file to CSV. I wrote a Java program to convert XML file to CSV file but I am getting Java out of memory error as it is exceeding Heap memory.Please provide some software that convert large XML file to CSV.Any suggestions would be appreciated.

j-ray · 10-24-2014, 02:00 AM

If you have some little knowlegde in Perl you can write a SAX parser that will not need much RAM to parse the XML file. Or you can look for it on the web.

zhjim · 10-24-2014, 02:21 AM

From the error description I bet you just read in more and more data till the memory is exhausted. Maybe check on your program and have lower numbers of the chunks of data you read and write.

j-ray · 10-24-2014, 04:17 AM

In general there are 2 basic approaches. You can parse XML by reading in the whole document in an object or you can parse it sequentially. Java provides this 2nd option, too.

http://www.javabeat.net/parsing-xml-...nts-using-sax/