快捷搜索: 王者荣耀 脱发

hive sql 时效突然降低的原因分析

2023-05-17 00:33:23 INFO GetSplits finish, it costs : 3616 milliseconds
2023-05-17 00:33:25 INFO Starting Job = job_1671604997808_23119680, Tracking URL = http://lfjd-dcjdtrcc-11-123-18-246.hadoop.jd.local:50320/proxy/application_1671604997808_23119680/
2023-05-17 00:33:25 INFO Kill Command = /common/bdp-app/hadoop/v7/hadoop/bin/hadoop job  -kill job_1671604997808_23119680
2023-05-17 00:33:31 INFO Hadoop job(job_1671604997808_23119680) information for Stage-1: number of mappers: 1644; number of reducers: 684
2023-05-17 00:33:31 INFO 2023-05-17 00:33:31,671 Stage-1(job_1671604997808_23119680) map = 0%,  reduce = 0%
2023-05-17 00:35:18 INFO 2023-05-17 00:35:18,833 Stage-1(job_1671604997808_23119680) map = 0%,  reduce = 0%
2023-05-17 00:36:29 INFO 2023-05-17 00:36:29,265 Stage-1(job_1671604997808_23119680) map = 0%,  reduce = 0%
2023-05-17 00:37:49 INFO 2023-05-17 00:37:49,420 Stage-1(job_1671604997808_23119680) map = 0%,  reduce = 0%
2023-05-17 00:39:25 INFO 2023-05-17 00:39:25,010 Stage-1(job_1671604997808_23119680) map = 0%,  reduce = 0%
2023-05-17 00:41:35 INFO 2023-05-17 00:41:35,359 Stage-1(job_1671604997808_23119680) map = 0%,  reduce = 0%
2023-05-17 00:42:46 INFO 2023-05-17 00:42:46,461 Stage-1(job_1671604997808_23119680) map = 0%,  reduce = 0%
2023-05-17 00:44:26 INFO 2023-05-17 00:44:26,713 Stage-1(job_1671604997808_23119680) map = 0%,  reduce = 0%
2023-05-17 00:45:42 INFO 2023-05-17 00:45:42,871 Stage-1(job_1671604997808_23119680) map = 0%,  reduce = 0%
2023-05-17 00:47:03 INFO 2023-05-17 00:47:03,174 Stage-1(job_1671604997808_23119680) map = 0%,  reduce = 0%
2023-05-17 00:48:13 INFO 2023-05-17 00:48:13,314 Stage-1(job_1671604997808_23119680) map = 0%,  reduce = 0%
2023-05-17 00:49:13 INFO 2023-05-17 00:49:13,553 Stage-1(job_1671604997808_23119680) map = 0%,  reduce = 0%
2023-05-17 00:50:58 INFO 2023-05-17 00:50:58,764 Stage-1(job_1671604997808_23119680) map = 0%,  reduce = 0%
2023-05-17 00:52:09 INFO 2023-05-17 00:52:09,028 Stage-1(job_1671604997808_23119680) map = 1%,  reduce = 0%, Cumulative CPU 602.4 sec
2023-05-17 00:53:08 INFO 2023-05-17 00:53:08,121 Stage-1(job_1671604997808_23119680) map = 2%,  reduce = 0%, Cumulative CPU 1758.89 sec
2023-05-17 00:54:39 INFO 2023-05-17 00:54:39,114 Stage-1(job_1671604997808_23119680) map = 2%,  reduce = 0%, Cumulative CPU 1941.95 sec
2023-05-17 00:56:19 INFO 2023-05-17 00:56:19,417 Stage-1(job_1671604997808_23119680) map = 2%,  reduce = 0%, Cumulative CPU 2522.5 sec
2023-05-17 00:57:34 INFO 2023-05-17 00:57:34,628 Stage-1(job_1671604997808_23119680) map = 3%,  reduce = 0%, Cumulative CPU 2678.39 sec
2023-05-17 00:58:55 INFO 2023-05-17 00:58:54,999 Stage-1(job_1671604997808_23119680) map = 3%,  reduce = 0%, Cumulative CPU 2800.18 sec
2023-05-17 01:00:15 INFO 2023-05-17 01:00:15,839 Stage-1(job_1671604997808_23119680) map = 3%,  reduce = 0%, Cumulative CPU 3075.92 sec
2023-05-17 01:01:36 INFO 2023-05-17 01:01:36,121 Stage-1(job_1671604997808_23119680) map = 3%,  reduce = 0%, Cumulative CPU 3204.97 sec
2023-05-17 01:02:31 INFO 2023-05-17 01:02:31,245 Stage-1(job_1671604997808_23119680) map = 4%,  reduce = 0%, Cumulative CPU 3642.07 sec
2023-05-17 01:03:36 INFO 2023-05-17 01:03:36,543 Stage-1(job_1671604997808_23119680) map = 4%,  reduce = 0%, Cumulative CPU 3642.07 sec
2023-05-17 01:04:46 INFO 2023-05-17 01:04:46,744 Stage-1(job_1671604997808_23119680) map = 4%,  reduce = 0%, Cumulative CPU 3642.07 sec
2023-05-17 01:06:07 INFO 2023-05-17 01:06:07,017 Stage-1(job_1671604997808_23119680) map = 4%,  reduce = 0%, Cumulative CPU 3642.07 sec
2023-05-17 01:07:27 INFO 2023-05-17 01:07:27,299 Stage-1(job_1671604997808_23119680) map = 4%,  reduce = 0%, Cumulative CPU 3642.07 sec
2023-05-17 01:08:27 INFO 2023-05-17 01:08:27,555 Stage-1(job_1671604997808_23119680) map = 4%,  reduce = 0%, Cumulative CPU 3642.07 sec
2023-05-17 01:09:52 INFO 2023-05-17 01:09:52,042 Stage-1(job_1671604997808_23119680) map = 4%,  reduce = 0%, Cumulative CPU 3642.07 sec

map 的时间特别长 ,然后一直没有紧张

经验分享 程序员 微信小程序 职场和发展