- 浏览: 884869 次
-
文章分类
最新评论
-
mxdxm：
总结不错，赞
NoSQL学习笔记(三)之BigTable -
itbj00：
不错，有实际案例的文章，看着简单。
以公司实际应用讲解OpenStack到底是什么 -
追梦--：
赞一个！
数据库插入百万数据 -
enet_java：
<artifactId>PM_Member_EAR ...
使用maven2 打ear包
Learning Hadoop
1.bin/hadoop jar hadoop-examples-*.jar grep conf output 'dfs[a-z.]+'
13/07/22 07:59:45 INFO util.NativeCodeLoader: Loaded the native-hadoop library
13/07/22 07:59:46 WARN snappy.LoadSnappy: Snappy native library not loaded
13/07/22 07:59:46 INFO mapred.FileInputFormat: Total input paths to process : 16
13/07/22 07:59:46 INFO mapred.JobClient: Running job: job_local_0001
13/07/22 07:59:46 INFO util.ProcessTree: setsid exited with exit code 0
13/07/22 07:59:46 INFO mapred.Task: Using ResourceCalculatorPlugin : org.apache.hadoop.util.LinuxResourceCalculatorPlugin@85b4459
13/07/22 07:59:46 INFO mapred.MapTask: numReduceTasks: 1
13/07/22 07:59:46 INFO mapred.MapTask: io.sort.mb = 100
13/07/22 07:59:46 INFO mapred.MapTask: data buffer = 79691776/99614720
13/07/22 07:59:46 INFO mapred.MapTask: record buffer = 262144/327680
13/07/22 07:59:47 INFO mapred.MapTask: Starting flush of map output
13/07/22 07:59:47 INFO mapred.Task: Task:attempt_local_0001_m_000000_0 is done. And is in the process of commiting
13/07/22 07:59:47 INFO mapred.LocalJobRunner: file:/home/yj70978/hadoop/hadoop-1.1.2/conf/capacity-scheduler.xml:0+7457
13/07/22 07:59:47 INFO mapred.Task: Task 'attempt_local_0001_m_000000_0' done.
13/07/22 07:59:47 INFO mapred.Task: Using ResourceCalculatorPlugin : org.apache.hadoop.util.LinuxResourceCalculatorPlugin@90a09af
13/07/22 07:59:47 INFO mapred.MapTask: numReduceTasks: 1
13/07/22 07:59:47 INFO mapred.MapTask: io.sort.mb = 100
13/07/22 07:59:47 INFO mapred.MapTask: data buffer = 79691776/99614720
13/07/22 07:59:47 INFO mapred.MapTask: record buffer = 262144/327680
13/07/22 07:59:47 INFO mapred.MapTask: Starting flush of map output
13/07/22 07:59:47 INFO mapred.MapTask: Finished spill 0
13/07/22 07:59:47 INFO mapred.Task: Task:attempt_local_0001_m_000001_0 is done. And is in the process of commiting
13/07/22 07:59:47 INFO mapred.LocalJobRunner: file:/home/yj70978/hadoop/hadoop-1.1.2/conf/hadoop-policy.xml:0+4644
13/07/22 07:59:47 INFO mapred.Task: Task 'attempt_local_0001_m_000001_0' done.
13/07/22 07:59:47 INFO mapred.Task: Using ResourceCalculatorPlugin : org.apache.hadoop.util.LinuxResourceCalculatorPlugin@90ac0dc
13/07/22 07:59:47 INFO mapred.MapTask: numReduceTasks: 1
13/07/22 07:59:47 INFO mapred.MapTask: io.sort.mb = 100
13/07/22 07:59:47 INFO mapred.MapTask: data buffer = 79691776/99614720
13/07/22 07:59:47 INFO mapred.MapTask: record buffer = 262144/327680
13/07/22 07:59:47 INFO mapred.MapTask: Starting flush of map output
13/07/22 07:59:47 INFO mapred.MapTask: Finished spill 0
13/07/22 07:59:47 INFO mapred.Task: Task:attempt_local_0001_m_000002_0 is done. And is in the process of commiting
13/07/22 07:59:47 INFO mapred.LocalJobRunner: file:/home/yj70978/hadoop/hadoop-1.1.2/conf/log4j.properties:0+4441
13/07/22 07:59:47 INFO mapred.Task: Task 'attempt_local_0001_m_000002_0' done.
13/07/22 07:59:47 INFO mapred.Task: Using ResourceCalculatorPlugin : org.apache.hadoop.util.LinuxResourceCalculatorPlugin@82eb9ab
13/07/22 07:59:47 INFO mapred.MapTask: numReduceTasks: 1
13/07/22 07:59:47 INFO mapred.MapTask: io.sort.mb = 100
13/07/22 07:59:47 INFO mapred.MapTask: data buffer = 79691776/99614720
13/07/22 07:59:47 INFO mapred.MapTask: record buffer = 262144/327680
13/07/22 07:59:47 INFO mapred.MapTask: Starting flush of map output
13/07/22 07:59:47 INFO mapred.Task: Task:attempt_local_0001_m_000003_0 is done. And is in the process of commiting
13/07/22 07:59:47 INFO mapred.LocalJobRunner: file:/home/yj70978/hadoop/hadoop-1.1.2/conf/hadoop-env.sh:0+2237
13/07/22 07:59:47 INFO mapred.Task: Task 'attempt_local_0001_m_000003_0' done.
13/07/22 07:59:47 INFO mapred.Task: Using ResourceCalculatorPlugin : org.apache.hadoop.util.LinuxResourceCalculatorPlugin@82eb8fb
13/07/22 07:59:47 INFO mapred.MapTask: numReduceTasks: 1
13/07/22 07:59:47 INFO mapred.MapTask: io.sort.mb = 100
13/07/22 07:59:47 INFO mapred.MapTask: data buffer = 79691776/99614720
13/07/22 07:59:47 INFO mapred.MapTask: record buffer = 262144/327680
13/07/22 07:59:47 INFO mapred.MapTask: Starting flush of map output
13/07/22 07:59:47 INFO mapred.Task: Task:attempt_local_0001_m_000004_0 is done. And is in the process of commiting
13/07/22 07:59:47 INFO mapred.LocalJobRunner: file:/home/yj70978/hadoop/hadoop-1.1.2/conf/mapred-queue-acls.xml:0+2033
13/07/22 07:59:47 INFO mapred.Task: Task 'attempt_local_0001_m_000004_0' done.
13/07/22 07:59:47 INFO mapred.Task: Using ResourceCalculatorPlugin : org.apache.hadoop.util.LinuxResourceCalculatorPlugin@82ec3ac
13/07/22 07:59:47 INFO mapred.MapTask: numReduceTasks: 1
13/07/22 07:59:47 INFO mapred.MapTask: io.sort.mb = 100
13/07/22 07:59:47 INFO mapred.MapTask: data buffer = 79691776/99614720
13/07/22 07:59:47 INFO mapred.MapTask: record buffer = 262144/327680
13/07/22 07:59:47 INFO mapred.MapTask: Starting flush of map output
13/07/22 07:59:47 INFO mapred.Task: Task:attempt_local_0001_m_000005_0 is done. And is in the process of commiting
13/07/22 07:59:47 INFO mapred.LocalJobRunner: file:/home/yj70978/hadoop/hadoop-1.1.2/conf/hadoop-metrics2.properties:0+1488
13/07/22 07:59:47 INFO mapred.Task: Task 'attempt_local_0001_m_000005_0' done.
13/07/22 07:59:47 INFO mapred.Task: Using ResourceCalculatorPlugin : org.apache.hadoop.util.LinuxResourceCalculatorPlugin@82ebacb
13/07/22 07:59:47 INFO mapred.MapTask: numReduceTasks: 1
13/07/22 07:59:47 INFO mapred.MapTask: io.sort.mb = 100
13/07/22 07:59:47 INFO mapred.MapTask: data buffer = 79691776/99614720
13/07/22 07:59:47 INFO mapred.MapTask: record buffer = 262144/327680
13/07/22 07:59:47 INFO mapred.MapTask: Starting flush of map output
13/07/22 07:59:47 INFO mapred.Task: Task:attempt_local_0001_m_000006_0 is done. And is in the process of commiting
13/07/22 07:59:47 INFO mapred.LocalJobRunner: file:/home/yj70978/hadoop/hadoop-1.1.2/conf/ssl-client.xml.example:0+1243
13/07/22 07:59:47 INFO mapred.Task: Task 'attempt_local_0001_m_000006_0' done.
13/07/22 07:59:47 INFO mapred.Task: Using ResourceCalculatorPlugin : org.apache.hadoop.util.LinuxResourceCalculatorPlugin@82eba73
13/07/22 07:59:47 INFO mapred.JobClient: map 100% reduce 0%
13/07/22 07:59:47 INFO mapred.MapTask: numReduceTasks: 1
13/07/22 07:59:47 INFO mapred.MapTask: io.sort.mb = 100
13/07/22 07:59:47 INFO mapred.MapTask: data buffer = 79691776/99614720
13/07/22 07:59:47 INFO mapred.MapTask: record buffer = 262144/327680
13/07/22 07:59:47 INFO mapred.MapTask: Starting flush of map output
13/07/22 07:59:47 INFO mapred.Task: Task:attempt_local_0001_m_000007_0 is done. And is in the process of commiting
13/07/22 07:59:47 INFO mapred.LocalJobRunner: file:/home/yj70978/hadoop/hadoop-1.1.2/conf/ssl-server.xml.example:0+1195
13/07/22 07:59:47 INFO mapred.Task: Task 'attempt_local_0001_m_000007_0' done.
13/07/22 07:59:47 INFO mapred.Task: Using ResourceCalculatorPlugin : org.apache.hadoop.util.LinuxResourceCalculatorPlugin@82ec518
13/07/22 07:59:47 INFO mapred.MapTask: numReduceTasks: 1
13/07/22 07:59:47 INFO mapred.MapTask: io.sort.mb = 100
13/07/22 07:59:47 INFO mapred.MapTask: data buffer = 79691776/99614720
13/07/22 07:59:47 INFO mapred.MapTask: record buffer = 262144/327680
13/07/22 07:59:47 INFO mapred.MapTask: Starting flush of map output
13/07/22 07:59:47 INFO mapred.Task: Task:attempt_local_0001_m_000008_0 is done. And is in the process of commiting
13/07/22 07:59:47 INFO mapred.LocalJobRunner: file:/home/yj70978/hadoop/hadoop-1.1.2/conf/configuration.xsl:0+535
13/07/22 07:59:47 INFO mapred.Task: Task 'attempt_local_0001_m_000008_0' done.
13/07/22 07:59:47 INFO mapred.Task: Using ResourceCalculatorPlugin : org.apache.hadoop.util.LinuxResourceCalculatorPlugin@82eb888
13/07/22 07:59:47 INFO mapred.MapTask: numReduceTasks: 1
13/07/22 07:59:47 INFO mapred.MapTask: io.sort.mb = 100
13/07/22 07:59:47 INFO mapred.MapTask: data buffer = 79691776/99614720
13/07/22 07:59:47 INFO mapred.MapTask: record buffer = 262144/327680
13/07/22 07:59:47 INFO mapred.MapTask: Starting flush of map output
13/07/22 07:59:47 INFO mapred.Task: Task:attempt_local_0001_m_000009_0 is done. And is in the process of commiting
13/07/22 07:59:47 INFO mapred.LocalJobRunner: file:/home/yj70978/hadoop/hadoop-1.1.2/conf/taskcontroller.cfg:0+382
13/07/22 07:59:47 INFO mapred.Task: Task 'attempt_local_0001_m_000009_0' done.
13/07/22 07:59:47 INFO mapred.Task: Using ResourceCalculatorPlugin : org.apache.hadoop.util.LinuxResourceCalculatorPlugin@82ecdd5
13/07/22 07:59:47 INFO mapred.MapTask: numReduceTasks: 1
13/07/22 07:59:47 INFO mapred.MapTask: io.sort.mb = 100
13/07/22 07:59:47 INFO mapred.MapTask: data buffer = 79691776/99614720
13/07/22 07:59:47 INFO mapred.MapTask: record buffer = 262144/327680
13/07/22 07:59:47 INFO mapred.MapTask: Starting flush of map output
13/07/22 07:59:47 INFO mapred.Task: Task:attempt_local_0001_m_000010_0 is done. And is in the process of commiting
13/07/22 07:59:47 INFO mapred.LocalJobRunner: file:/home/yj70978/hadoop/hadoop-1.1.2/conf/fair-scheduler.xml:0+327
13/07/22 07:59:47 INFO mapred.Task: Task 'attempt_local_0001_m_000010_0' done.
13/07/22 07:59:47 INFO mapred.Task: Using ResourceCalculatorPlugin : org.apache.hadoop.util.LinuxResourceCalculatorPlugin@82ebcf5
13/07/22 07:59:47 INFO mapred.MapTask: numReduceTasks: 1
13/07/22 07:59:47 INFO mapred.MapTask: io.sort.mb = 100
13/07/22 07:59:47 INFO mapred.MapTask: data buffer = 79691776/99614720
13/07/22 07:59:47 INFO mapred.MapTask: record buffer = 262144/327680
13/07/22 07:59:47 INFO mapred.MapTask: Starting flush of map output
13/07/22 07:59:47 INFO mapred.Task: Task:attempt_local_0001_m_000011_0 is done. And is in the process of commiting
13/07/22 07:59:47 INFO mapred.LocalJobRunner: file:/home/yj70978/hadoop/hadoop-1.1.2/conf/hdfs-site.xml:0+178
13/07/22 07:59:47 INFO mapred.Task: Task 'attempt_local_0001_m_000011_0' done.
13/07/22 07:59:47 INFO mapred.Task: Using ResourceCalculatorPlugin : org.apache.hadoop.util.LinuxResourceCalculatorPlugin@82ebda1
13/07/22 07:59:47 INFO mapred.MapTask: numReduceTasks: 1
13/07/22 07:59:47 INFO mapred.MapTask: io.sort.mb = 100
13/07/22 07:59:47 INFO mapred.MapTask: data buffer = 79691776/99614720
13/07/22 07:59:47 INFO mapred.MapTask: record buffer = 262144/327680
13/07/22 07:59:47 INFO mapred.MapTask: Starting flush of map output
13/07/22 07:59:47 INFO mapred.Task: Task:attempt_local_0001_m_000012_0 is done. And is in the process of commiting
13/07/22 07:59:47 INFO mapred.LocalJobRunner: file:/home/yj70978/hadoop/hadoop-1.1.2/conf/core-site.xml:0+178
13/07/22 07:59:47 INFO mapred.Task: Task 'attempt_local_0001_m_000012_0' done.
13/07/22 07:59:47 INFO mapred.Task: Using ResourceCalculatorPlugin : org.apache.hadoop.util.LinuxResourceCalculatorPlugin@82ecaec
13/07/22 07:59:47 INFO mapred.MapTask: numReduceTasks: 1
13/07/22 07:59:47 INFO mapred.MapTask: io.sort.mb = 100
13/07/22 07:59:48 INFO mapred.MapTask: data buffer = 79691776/99614720
13/07/22 07:59:48 INFO mapred.MapTask: record buffer = 262144/327680
13/07/22 07:59:48 INFO mapred.MapTask: Starting flush of map output
13/07/22 07:59:48 INFO mapred.Task: Task:attempt_local_0001_m_000013_0 is done. And is in the process of commiting
13/07/22 07:59:48 INFO mapred.LocalJobRunner: file:/home/yj70978/hadoop/hadoop-1.1.2/conf/mapred-site.xml:0+178
13/07/22 07:59:48 INFO mapred.Task: Task 'attempt_local_0001_m_000013_0' done.
13/07/22 07:59:48 INFO mapred.Task: Using ResourceCalculatorPlugin : org.apache.hadoop.util.LinuxResourceCalculatorPlugin@82ec195
13/07/22 07:59:48 INFO mapred.MapTask: numReduceTasks: 1
13/07/22 07:59:48 INFO mapred.MapTask: io.sort.mb = 100
13/07/22 07:59:48 INFO mapred.MapTask: data buffer = 79691776/99614720
13/07/22 07:59:48 INFO mapred.MapTask: record buffer = 262144/327680
13/07/22 07:59:48 INFO mapred.MapTask: Starting flush of map output
13/07/22 07:59:48 INFO mapred.Task: Task:attempt_local_0001_m_000014_0 is done. And is in the process of commiting
13/07/22 07:59:48 INFO mapred.LocalJobRunner: file:/home/yj70978/hadoop/hadoop-1.1.2/conf/slaves:0+10
13/07/22 07:59:48 INFO mapred.Task: Task 'attempt_local_0001_m_000014_0' done.
13/07/22 07:59:48 INFO mapred.Task: Using ResourceCalculatorPlugin : org.apache.hadoop.util.LinuxResourceCalculatorPlugin@82ec712
13/07/22 07:59:48 INFO mapred.MapTask: numReduceTasks: 1
13/07/22 07:59:48 INFO mapred.MapTask: io.sort.mb = 100
13/07/22 07:59:48 INFO mapred.MapTask: data buffer = 79691776/99614720
13/07/22 07:59:48 INFO mapred.MapTask: record buffer = 262144/327680
13/07/22 07:59:48 INFO mapred.MapTask: Starting flush of map output
13/07/22 07:59:48 INFO mapred.Task: Task:attempt_local_0001_m_000015_0 is done. And is in the process of commiting
13/07/22 07:59:48 INFO mapred.LocalJobRunner: file:/home/yj70978/hadoop/hadoop-1.1.2/conf/masters:0+10
13/07/22 07:59:48 INFO mapred.Task: Task 'attempt_local_0001_m_000015_0' done.
13/07/22 07:59:48 INFO mapred.Task: Using ResourceCalculatorPlugin : org.apache.hadoop.util.LinuxResourceCalculatorPlugin@82ecd87
13/07/22 07:59:48 INFO mapred.LocalJobRunner:
13/07/22 07:59:48 INFO mapred.Merger: Merging 16 sorted segments
13/07/22 07:59:48 INFO mapred.Merger: Down to the last merge-pass, with 2 segments left of total size: 54 bytes
13/07/22 07:59:48 INFO mapred.LocalJobRunner:
13/07/22 07:59:48 INFO mapred.Task: Task:attempt_local_0001_r_000000_0 is done. And is in the process of commiting
13/07/22 07:59:48 INFO mapred.LocalJobRunner:
13/07/22 07:59:48 INFO mapred.Task: Task attempt_local_0001_r_000000_0 is allowed to commit now
13/07/22 07:59:48 INFO mapred.FileOutputCommitter: Saved output of task 'attempt_local_0001_r_000000_0' to file:/home/yj70978/hadoop/hadoop-1.1.2/grep-temp-827490264
13/07/22 07:59:48 INFO mapred.LocalJobRunner: reduce > reduce
13/07/22 07:59:48 INFO mapred.Task: Task 'attempt_local_0001_r_000000_0' done.
13/07/22 07:59:48 INFO mapred.JobClient: map 100% reduce 100%
13/07/22 07:59:49 INFO mapred.JobClient: Job complete: job_local_0001
13/07/22 07:59:49 INFO mapred.JobClient: Counters: 21
13/07/22 07:59:49 INFO mapred.JobClient: File Input Format Counters
13/07/22 07:59:49 INFO mapred.JobClient: Bytes Read=26536
13/07/22 07:59:49 INFO mapred.JobClient: File Output Format Counters
13/07/22 07:59:49 INFO mapred.JobClient: Bytes Written=160
13/07/22 07:59:49 INFO mapred.JobClient: FileSystemCounters
13/07/22 07:59:49 INFO mapred.JobClient: FILE_BYTES_READ=3029579
13/07/22 07:59:49 INFO mapred.JobClient: FILE_BYTES_WRITTEN=3314276
13/07/22 07:59:49 INFO mapred.JobClient: Map-Reduce Framework
13/07/22 07:59:49 INFO mapred.JobClient: Map output materialized bytes=146
13/07/22 07:59:49 INFO mapred.JobClient: Map input records=749
13/07/22 07:59:49 INFO mapred.JobClient: Reduce shuffle bytes=0
13/07/22 07:59:49 INFO mapred.JobClient: Spilled Records=4
13/07/22 07:59:49 INFO mapred.JobClient: Map output bytes=46
13/07/22 07:59:49 INFO mapred.JobClient: Total committed heap usage (bytes)=4527820800
13/07/22 07:59:49 INFO mapred.JobClient: CPU time spent (ms)=0
13/07/22 07:59:49 INFO mapred.JobClient: Map input bytes=26536
13/07/22 07:59:49 INFO mapred.JobClient: SPLIT_RAW_BYTES=1818
13/07/22 07:59:49 INFO mapred.JobClient: Combine input records=2
13/07/22 07:59:49 INFO mapred.JobClient: Reduce input records=2
13/07/22 07:59:49 INFO mapred.JobClient: Reduce input groups=2
13/07/22 07:59:49 INFO mapred.JobClient: Combine output records=2
13/07/22 07:59:49 INFO mapred.JobClient: Physical memory (bytes) snapshot=0
13/07/22 07:59:49 INFO mapred.JobClient: Reduce output records=2
13/07/22 07:59:49 INFO mapred.JobClient: Virtual memory (bytes) snapshot=0
13/07/22 07:59:49 INFO mapred.JobClient: Map output records=2
13/07/22 07:59:49 INFO mapred.FileInputFormat: Total input paths to process : 1
13/07/22 07:59:49 INFO mapred.JobClient: Running job: job_local_0002
13/07/22 07:59:49 INFO mapred.Task: Using ResourceCalculatorPlugin : org.apache.hadoop.util.LinuxResourceCalculatorPlugin@82eb4bc
13/07/22 07:59:50 INFO mapred.MapTask: numReduceTasks: 1
13/07/22 07:59:50 INFO mapred.MapTask: io.sort.mb = 100
13/07/22 07:59:50 INFO mapred.MapTask: data buffer = 79691776/99614720
13/07/22 07:59:50 INFO mapred.MapTask: record buffer = 262144/327680
13/07/22 07:59:50 INFO mapred.MapTask: Starting flush of map output
13/07/22 07:59:50 INFO mapred.MapTask: Finished spill 0
13/07/22 07:59:50 INFO mapred.Task: Task:attempt_local_0002_m_000000_0 is done. And is in the process of commiting
13/07/22 07:59:50 INFO mapred.LocalJobRunner: file:/home/yj70978/hadoop/hadoop-1.1.2/grep-temp-827490264/part-00000:0+148
13/07/22 07:59:50 INFO mapred.Task: Task 'attempt_local_0002_m_000000_0' done.
13/07/22 07:59:50 INFO mapred.Task: Using ResourceCalculatorPlugin : org.apache.hadoop.util.LinuxResourceCalculatorPlugin@82e1723
13/07/22 07:59:50 INFO mapred.LocalJobRunner:
13/07/22 07:59:50 INFO mapred.Merger: Merging 1 sorted segments
13/07/22 07:59:50 INFO mapred.Merger: Down to the last merge-pass, with 1 segments left of total size: 52 bytes
13/07/22 07:59:50 INFO mapred.LocalJobRunner:
13/07/22 07:59:50 INFO mapred.Task: Task:attempt_local_0002_r_000000_0 is done. And is in the process of commiting
13/07/22 07:59:50 INFO mapred.LocalJobRunner:
13/07/22 07:59:50 INFO mapred.Task: Task attempt_local_0002_r_000000_0 is allowed to commit now
13/07/22 07:59:50 INFO mapred.FileOutputCommitter: Saved output of task 'attempt_local_0002_r_000000_0' to file:/home/yj70978/hadoop/hadoop-1.1.2/output
13/07/22 07:59:50 INFO mapred.LocalJobRunner: reduce > reduce
13/07/22 07:59:50 INFO mapred.Task: Task 'attempt_local_0002_r_000000_0' done.
13/07/22 07:59:50 INFO mapred.JobClient: map 100% reduce 100%
13/07/22 07:59:50 INFO mapred.JobClient: Job complete: job_local_0002
13/07/22 07:59:50 INFO mapred.JobClient: Counters: 21
13/07/22 07:59:50 INFO mapred.JobClient: File Input Format Counters
13/07/22 07:59:50 INFO mapred.JobClient: Bytes Read=160
13/07/22 07:59:50 INFO mapred.JobClient: File Output Format Counters
13/07/22 07:59:50 INFO mapred.JobClient: Bytes Written=46
13/07/22 07:59:50 INFO mapred.JobClient: FileSystemCounters
13/07/22 07:59:50 INFO mapred.JobClient: FILE_BYTES_READ=663158
13/07/22 07:59:50 INFO mapred.JobClient: FILE_BYTES_WRITTEN=774250
13/07/22 07:59:50 INFO mapred.JobClient: Map-Reduce Framework
13/07/22 07:59:50 INFO mapred.JobClient: Map output materialized bytes=56
13/07/22 07:59:50 INFO mapred.JobClient: Map input records=2
13/07/22 07:59:50 INFO mapred.JobClient: Reduce shuffle bytes=0
13/07/22 07:59:50 INFO mapred.JobClient: Spilled Records=4
13/07/22 07:59:50 INFO mapred.JobClient: Map output bytes=46
13/07/22 07:59:50 INFO mapred.JobClient: Total committed heap usage (bytes)=532684800
13/07/22 07:59:50 INFO mapred.JobClient: CPU time spent (ms)=0
13/07/22 07:59:50 INFO mapred.JobClient: Map input bytes=62
13/07/22 07:59:50 INFO mapred.JobClient: SPLIT_RAW_BYTES=122
13/07/22 07:59:50 INFO mapred.JobClient: Combine input records=0
13/07/22 07:59:50 INFO mapred.JobClient: Reduce input records=2
13/07/22 07:59:50 INFO mapred.JobClient: Reduce input groups=1
13/07/22 07:59:50 INFO mapred.JobClient: Combine output records=0
13/07/22 07:59:50 INFO mapred.JobClient: Physical memory (bytes) snapshot=0
13/07/22 07:59:50 INFO mapred.JobClient: Reduce output records=2
13/07/22 07:59:50 INFO mapred.JobClient: Virtual memory (bytes) snapshot=0
13/07/22 07:59:50 INFO mapred.JobClient: Map output records=2
发表评论
相关推荐
Learning Hadoop 2，学习Hadoop2，高清原版，学习hadoop
Hadoop is one of the most popular Big Data solutions, and forensically investigating a Hadoop cluster requires specialized tools and techniques. With the explosion of Big Data, forensic investigators...
Learning Hadoop 2.pdf，学习Hadoop，第二版，英文原版
Title: Deep Learning with Hadoop Author: Dipayan Dev Length: 259 pages Edition: 1 Language: English Publisher: Packt Publishing Publication Date: 2017-03-06 ISBN-10: 1787124762 ISBN-13: 9781787124769 ...
Title: Learning Hadoop 2 Author: Gabriele Modena, Garry Turkington Length: 316 pages Edition: 1 Language: English Publisher: Packt Publishing Publication Date: 2014-12-29 ISBN-10: 1783285516 ISBN-13: ...
If you are a system or application developer interested in learning how to solve practical problems using the Hadoop framework, then this book is ideal for you. You are expected to be familiar with ...
1、Big Data Forensics Learning Hadoop Investigations.pdf 2、Hadoop Beginner-'s Guide(2013).pdf 3、Hadoop in Practice 2nd Edition.pdf 4、Hadoop MapReduce Cookbook.pdf 5、Hadoop MapReduce v2 Cookbook ...
Deep Learning with Hadoop 英文epub 本资源转载自网络，如有侵权，请联系上传者或csdn删除 查看此书详细信息请在美国亚马逊官网搜索此书
Deep Learning with Hadoop 英文无水印原版pdf pdf所有页面使用FoxitReader、PDF-XChangeViewer、SumatraPDF和Firefox测试都可以打开 本资源转载自网络，如有侵权，请联系上传者或csdn删除 查看此书详细信息请...
Deep Learning with Hadoop Copyright © 2017 Packt Publishing All rights reserved. No part of this book may be reproduced, stored in a retrieval system, or transmitted in any form or by any means, ...
deep neural networks with Hadoop for optimal performance. Starting with understanding what deep learning is, and what the various models associated with deep neural networks are, this book will then ...
Deep.Learning.with.Hadoop纯英文版 PDF格式 Build, implement and scale distributed deep learning models for large-scale datasets About This Book Get to grips with the deep learning concepts and set up ...
Packt.Big.Data.Forensics.Learning.Hadoop.Investigations
If you are a system or application developer interested in learning how to solve practical problems using the Hadoop framework, then this book is ideal for you. This book is also meant for Hadoop ...
Cloud computing is a very hot new area, Hadoop is almost certain to be a part of its rise, and for any hip cloud computing programmer, learning Pro Hadoop is the best bet at getting in on it....
Developers who want to improve MapReduce jobs by learning how Hadoop works in large production environments will also benefit. Application administrators responsible for the health and operation of ...
HadoopLearning：启动Hadoop
"Data Analytics with Hadoop: An Introduction for Data Scientists" ISBN: 1491913703 | 2016 | PDF | 288 pages | 7 MB Ready to use statistical and machine-learning techniques across large data sets? ...
instantly useful techniques for analyzing real-time streams, moving data securely, machine learning, managing large-scale clusters, and taming big data using Hadoop. This completely revised edition ...