코알못

[EMR] Hive StatsTask 이슈 본문

BIG DATA

[EMR] Hive StatsTask 이슈

코린이s 2022. 8. 3. 11:50
728x90

Load 가 정상적으로 되었으나 StatsTask 에러가 발생

Loading data to table db.table partition (yyyy=null, mm=null, dd=null)

Loaded : 3778/3778 partitions.
	 Time taken to load dynamic partitions: 542.002 seconds
	 Time taken for adding to write entity : 0.24 seconds
FAILED: Execution Error, return code 1 from org.apache.hadoop.hive.ql.exec.StatsTask

어래 옵션을 추가하여 해결!

set hive.stats.autogather=false;
728x90
Comments