ページの先頭行へ戻る
NetCOBOL V12.0 ユーザーズガイド(Hadoop連携機能編)
FUJITSU Software

4.3.1 ジョブ成功時の例

以下は、Hadoopジョブの実行が成功した例です。Mapタスク、Reduceタスクが100%まで進捗し、エラーメッセージが出力されることなく、Hadoop実行シェルが終了しています。

[hadoop@hadoop1 hadoop01]$ cobhadoop.sh -conf  conf/configuration.xml -files reduce.exe
14/04/24 10:20:41 INFO util.NativeCodeLoader: Loaded the native-hadoop library
14/04/24 10:20:41 WARN snappy.LoadSnappy: Snappy native library not loaded
14/04/24 10:20:41 INFO mapred.FileInputFormat: Total input paths to process : 1
14/04/24 10:20:41 INFO mapred.FileInputFormat: Total input paths to process : 1
14/04/24 10:20:41 INFO mapred.JobClient: Running job: job_201403281518_0347
14/04/24 10:20:42 INFO mapred.JobClient:  map 0% reduce 0%
14/04/24 10:21:00 INFO mapred.JobClient:  map 25% reduce 0%
14/04/24 10:21:01 INFO mapred.JobClient:  map 50% reduce 0%
14/04/24 10:21:05 INFO mapred.JobClient:  map 75% reduce 0%
14/04/24 10:21:07 INFO mapred.JobClient:  map 100% reduce 0%
14/04/24 10:21:10 INFO mapred.JobClient:  map 100% reduce 33%
14/04/24 10:21:13 INFO mapred.JobClient:  map 100% reduce 100%
14/04/24 10:21:16 INFO mapred.JobClient: Job complete: job_201403281518_0347
14/04/24 10:21:16 INFO mapred.JobClient: Counters: 31
14/04/24 10:21:16 INFO mapred.JobClient:   Job Counters
14/04/24 10:21:16 INFO mapred.JobClient:     Launched reduce tasks=1
14/04/24 10:21:16 INFO mapred.JobClient:     SLOTS_MILLIS_MAPS=28884
14/04/24 10:21:16 INFO mapred.JobClient:     Total time spent by all reduces waiting after reserving slots (ms)=0
14/04/24 10:21:16 INFO mapred.JobClient:     Total time spent by all maps waiting after reserving slots (ms)=0
14/04/24 10:21:16 INFO mapred.JobClient:     Launched map tasks=4
14/04/24 10:21:16 INFO mapred.JobClient:     Data-local map tasks=4
14/04/24 10:21:16 INFO mapred.JobClient:     SLOTS_MILLIS_REDUCES=12510
14/04/24 10:21:16 INFO mapred.JobClient:   File Input Format Counters
14/04/24 10:21:16 INFO mapred.JobClient:     Bytes Read=0
14/04/24 10:21:16 INFO mapred.JobClient:   File Output Format Counters
14/04/24 10:21:16 INFO mapred.JobClient:     Bytes Written=1260
14/04/24 10:21:16 INFO mapred.JobClient:   FileSystemCounters
14/04/24 10:21:16 INFO mapred.JobClient:     FILE_BYTES_READ=320586
14/04/24 10:21:16 INFO mapred.JobClient:     HDFS_BYTES_READ=194818
14/04/24 10:21:16 INFO mapred.JobClient:     FILE_BYTES_WRITTEN=809649
14/04/24 10:21:16 INFO mapred.JobClient:     HDFS_BYTES_WRITTEN=1260
14/04/24 10:21:16 INFO mapred.JobClient:   Extjoiner.ExitStatus
14/04/24 10:21:16 INFO mapred.JobClient:     reduce.00=0
14/04/24 10:21:16 INFO mapred.JobClient:   Map-Reduce Framework
14/04/24 10:21:16 INFO mapred.JobClient:     Map output materialized bytes=320604
14/04/24 10:21:16 INFO mapred.JobClient:     Map input records=10020
14/04/24 10:21:16 INFO mapred.JobClient:     Reduce shuffle bytes=320604
14/04/24 10:21:16 INFO mapred.JobClient:     Spilled Records=20040
14/04/24 10:21:16 INFO mapred.JobClient:     Map output bytes=300540
14/04/24 10:21:16 INFO mapred.JobClient:     Total committed heap usage (bytes)=826540032
14/04/24 10:21:16 INFO mapred.JobClient:     CPU time spent (ms)=5870
14/04/24 10:21:16 INFO mapred.JobClient:     Map input bytes=190320
14/04/24 10:21:16 INFO mapred.JobClient:     SPLIT_RAW_BYTES=1032
14/04/24 10:21:16 INFO mapred.JobClient:     Combine input records=0
14/04/24 10:21:16 INFO mapred.JobClient:     Reduce input records=10020
14/04/24 10:21:16 INFO mapred.JobClient:     Reduce input groups=40
14/04/24 10:21:16 INFO mapred.JobClient:     Combine output records=0
14/04/24 10:21:16 INFO mapred.JobClient:     Physical memory (bytes) snapshot=877379584
14/04/24 10:21:16 INFO mapred.JobClient:     Reduce output records=20
14/04/24 10:21:16 INFO mapred.JobClient:     Virtual memory (bytes) snapshot=4984156160
14/04/24 10:21:16 INFO mapred.JobClient:     Map output records=10020
[hadoop@hadoop1 hadoop01]$