Another observation - It crashed with 84 groups and 73K instance. In this scenario, I shall have pretty enough memory and disk.
You may refer to the enclosed dump data for the training table, and I used the below SQL for random forest.
Dear user group,
I got a problem when training the grouped data with random forest(300 features). Small data was fine ( eg, 56K instances in 56 groups), but failed for 240K instances in 250 groups. Postgres forced to disconnect the session after showing the below message in verbose mode:
NOTICE: view "__madlib_temp_60124179_
1532371657_7130296__" will be a temporary viewNOTICE: sql_create_empty_result_table:
CREATE TABLE analysis.dx_rf_train_output_1 (gid integer,sample_id integer,tree madlib.bytea8);
TRUNCATE TABLE __madlib_temp_91155016_
1532371657_5660955__ CASCADE;INSERT INTO __madlib_temp_91155016_ 1532371657_5660955__SELECT*,madlib.poisson_random(1) AS poisson_countFROM(SELECT*,0.::double precision AS __madlib_temp_14328459_ 1532371657_7318497__FROM analysis.dxpredict_svec) subqWHERE __madlib_temp_14328459_ 1532371657_7318497__ < 1
NOTICE:src_cnt: 158360,oob_cnt: 92418,dup_cnt: 250617.
NOTICE: Started tree building for all groupsserver closed the connection unexpectedlyThis probably means the server terminated abnormallybefore or while processing the request.The connection to the server was lost. Attempting reset: Failed.
The PostgreSQL did not capture the detail log even I increased the logstatement to "all"2018-07-23 14:47:50.229 EDT  LOG: server process (PID 1980) was terminated by signal 11: Segmentation fault2018-07-23 14:47:50.229 EDT  DETAIL: Failed process was running: SELECT madlib.forest_train('analysis.
dxpredict_svec','analysis.dx_rf_train_output_ 1','rowid','positive','*','rowid,positive,case_icd','case_icd',30::integer,30::integer,TRUE::boolean,1::integer,10::integer,3::integer,1::integer,10::integer,NULL,TRUE);2018-07-23 14:47:50.229 EDT  LOG: terminating any other active server processes2018-07-23 14:47:50.229 EDT  WARNING: terminating connection because of crash of another server process