phoenix-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Sriram Nookala <sri...@firstfuel.com>
Subject Phoenix CSV Bulk Load fails to load a large file
Date Wed, 06 Sep 2017 20:13:09 GMT
I'm trying to load a 3.5G file with 60 million rows using CsvBulkLoadTool.
It hangs while loading HFiles. This runs successfully if I split this into
2 files, but I'd like to avoid doing that. This is on Amazon EMR, is this
an issue due to disk space or memory. I have a single master and 2 region
server configuration with 16 GB memory on each node.

Mime
View raw message