MAPREDUCE Application on yarn 执行错误,Spark on yarn也是同样的错误。所以可能是yarn的问题,但找不到具体原因,不知是否有大神遇到过这个问题并解决了的?若有回复,不胜感激~~~~

0
######    1、yarn UI 界面错误日志:
Application application_1502433676680_0001 failed 2 times due to AM Container for appattempt_1502433676680_0001_000002 exited with exitCode: 1
For more detailed output, check application tracking page:http://master:8099/proxy/appli ... /Then, click on links to logs of each attempt.
Diagnostics: Exception from container-launch.
Container id: container_1502433676680_0001_02_000001
Exit code: 1
Stack trace: ExitCodeException exitCode=1:
at org.apache.hadoop.util.Shell.runCommand(Shell.java:575)
at org.apache.hadoop.util.Shell.run(Shell.java:478)
at org.apache.hadoop.util.Shell$ShellCommandExecutor.execute(Shell.java:766)
at org.apache.hadoop.yarn.server.nodemanager.DefaultContainerExecutor.launchContainer(DefaultContainerExecutor.java:212)
at org.apache.hadoop.yarn.server.nodemanager.containermanager.launcher.ContainerLaunch.call(ContainerLaunch.java:302)
at org.apache.hadoop.yarn.server.nodemanager.containermanager.launcher.ContainerLaunch.call(ContainerLaunch.java:82)
at java.util.concurrent.FutureTask.run(FutureTask.java:262)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
at java.lang.Thread.run(Thread.java:745)
Container exited with a non-zero exit code 1
Failing this attempt. Failing the application.
#########################################################################

#######           2、node/containerlogs:
 Failed while trying to construct the redirect url to the log server. Log Server url may not be configured
java.lang.Exception: Unknown container. Container either has not started or has already completed or doesn't belong to this node at all.
##############################################################################33

#######           3、nodemanger详细log:
2017-08-11 14:41:14,397 INFO org.apache.hadoop.yarn.server.nodemanager.NodeManager: registered UNIX signal handlers for [TERM, HUP, INT]
2017-08-11 14:41:17,334 INFO org.apache.hadoop.yarn.event.AsyncDispatcher: Registering class org.apache.hadoop.yarn.server.nodemanager.containermanager.container.ContainerEventType for class org.apache.hadoop.yarn.server.nodemanager.containermanager.ContainerManagerImpl$ContainerEventDispatcher
2017-08-11 14:41:17,340 INFO org.apache.hadoop.yarn.event.AsyncDispatcher: Registering class org.apache.hadoop.yarn.server.nodemanager.containermanager.application.ApplicationEventType for class org.apache.hadoop.yarn.server.nodemanager.containermanager.ContainerManagerImpl$ApplicationEventDispatcher
2017-08-11 14:41:17,349 INFO org.apache.hadoop.yarn.event.AsyncDispatcher: Registering class org.apache.hadoop.yarn.server.nodemanager.containermanager.localizer.event.LocalizationEventType for class org.apache.hadoop.yarn.server.nodemanager.containermanager.localizer.ResourceLocalizationService
2017-08-11 14:41:17,358 INFO org.apache.hadoop.yarn.event.AsyncDispatcher: Registering class org.apache.hadoop.yarn.server.nodemanager.containermanager.AuxServicesEventType for class org.apache.hadoop.yarn.server.nodemanager.containermanager.AuxServices
2017-08-11 14:41:17,359 INFO org.apache.hadoop.yarn.event.AsyncDispatcher: Registering class org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorEventType for class org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl
2017-08-11 14:41:17,360 INFO org.apache.hadoop.yarn.event.AsyncDispatcher: Registering class org.apache.hadoop.yarn.server.nodemanager.containermanager.launcher.ContainersLauncherEventType for class org.apache.hadoop.yarn.server.nodemanager.containermanager.launcher.ContainersLauncher
2017-08-11 14:41:17,465 INFO org.apache.hadoop.yarn.event.AsyncDispatcher: Registering class org.apache.hadoop.yarn.server.nodemanager.ContainerManagerEventType for class org.apache.hadoop.yarn.server.nodemanager.containermanager.ContainerManagerImpl
2017-08-11 14:41:17,466 INFO org.apache.hadoop.yarn.event.AsyncDispatcher: Registering class org.apache.hadoop.yarn.server.nodemanager.NodeManagerEventType for class org.apache.hadoop.yarn.server.nodemanager.NodeManager
2017-08-11 14:41:17,629 INFO org.apache.hadoop.metrics2.impl.MetricsConfig: loaded properties from hadoop-metrics2.properties
2017-08-11 14:41:17,755 INFO org.apache.hadoop.metrics2.impl.MetricsSystemImpl: Scheduled snapshot period at 10 second(s).
2017-08-11 14:41:17,755 INFO org.apache.hadoop.metrics2.impl.MetricsSystemImpl: NodeManager metrics system started
2017-08-11 14:41:17,803 INFO org.apache.hadoop.yarn.event.AsyncDispatcher: Registering class org.apache.hadoop.yarn.server.nodemanager.containermanager.loghandler.event.LogHandlerEventType for class org.apache.hadoop.yarn.server.nodemanager.containermanager.logaggregation.LogAggregationService
2017-08-11 14:41:17,803 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.localizer.ResourceLocalizationService: per directory file limit = 8192
2017-08-11 14:41:17,846 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.localizer.ResourceLocalizationService: usercache path : file:/tmp/hadoop-hduser/nm-local-dir/usercache_DEL_1502433677809
2017-08-11 14:41:17,852 INFO org.apache.hadoop.yarn.server.nodemanager.DefaultContainerExecutor: Deleting path : file:/tmp/hadoop-hduser/nm-local-dir/usercache_DEL_1502433677809/hduser
2017-08-11 14:41:18,030 INFO org.apache.hadoop.yarn.event.AsyncDispatcher: Registering class org.apache.hadoop.yarn.server.nodemanager.containermanager.localizer.event.LocalizerEventType for class org.apache.hadoop.yarn.server.nodemanager.containermanager.localizer.ResourceLocalizationService$LocalizerTracker
2017-08-11 14:41:18,149 WARN org.apache.hadoop.yarn.server.nodemanager.containermanager.AuxServices: The Auxilurary Service named 'mapreduce_shuffle' in the configuration is for class class org.apache.hadoop.mapred.ShuffleHandler which has a name of 'httpshuffle'. Because these are not the same tools trying to send ServiceData and read Service Meta Data may have issues unless the refer to the name in the config.
2017-08-11 14:41:18,157 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.AuxServices: Adding auxiliary service httpshuffle, "mapreduce_shuffle"
2017-08-11 14:41:18,294 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl:  Using ResourceCalculatorPlugin : org.apache.hadoop.yarn.util.LinuxResourceCalculatorPlugin@25a32b76
2017-08-11 14:41:18,294 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl:  Using ResourceCalculatorProcessTree : null
2017-08-11 14:41:18,294 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl: Physical memory check enabled: false
2017-08-11 14:41:18,294 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl: Virtual memory check enabled: false
2017-08-11 14:41:18,305 INFO org.apache.hadoop.yarn.server.nodemanager.NodeStatusUpdaterImpl: Initialized nodemanager for null: physical-memory=2048 virtual-memory=10240 virtual-cores=2
2017-08-11 14:41:18,578 INFO org.apache.hadoop.ipc.CallQueueManager: Using callQueue: class java.util.concurrent.LinkedBlockingQueue queueCapacity: 2000
2017-08-11 14:41:18,684 INFO org.apache.hadoop.ipc.Server: Starting Socket Reader #1 for port 43023
2017-08-11 14:41:18,911 INFO org.apache.hadoop.yarn.factories.impl.pb.RpcServerFactoryPBImpl: Adding protocol org.apache.hadoop.yarn.api.ContainerManagementProtocolPB to the server
2017-08-11 14:41:18,917 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.ContainerManagerImpl: Blocking new container-requests as container manager rpc server is still starting.
2017-08-11 14:41:18,917 INFO org.apache.hadoop.ipc.Server: IPC Server Responder: starting
2017-08-11 14:41:18,919 INFO org.apache.hadoop.ipc.Server: IPC Server listener on 43023: starting
2017-08-11 14:41:18,959 INFO org.apache.hadoop.yarn.server.nodemanager.security.NMContainerTokenSecretManager: Updating node address : data1:43023
2017-08-11 14:41:23,992 INFO org.apache.hadoop.ipc.CallQueueManager: Using callQueue: class java.util.concurrent.LinkedBlockingQueue queueCapacity: 500
2017-08-11 14:41:23,993 INFO org.apache.hadoop.ipc.Server: Starting Socket Reader #1 for port 8040
2017-08-11 14:41:23,996 INFO org.apache.hadoop.yarn.factories.impl.pb.RpcServerFactoryPBImpl: Adding protocol org.apache.hadoop.yarn.server.nodemanager.api.LocalizationProtocolPB to the server
2017-08-11 14:41:23,999 INFO org.apache.hadoop.ipc.Server: IPC Server Responder: starting
2017-08-11 14:41:23,999 INFO org.apache.hadoop.ipc.Server: IPC Server listener on 8040: starting
2017-08-11 14:41:24,000 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.localizer.ResourceLocalizationService: Localizer started on port 8040
2017-08-11 14:41:24,017 INFO org.apache.hadoop.mapred.IndexCache: IndexCache created with max memory = 10485760
2017-08-11 14:41:24,041 INFO org.apache.hadoop.mapred.ShuffleHandler: httpshuffle listening on port 13562
2017-08-11 14:41:24,042 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl: Neither virutal-memory nor physical-memory monitoring is needed. Not running the monitor-thread
2017-08-11 14:41:24,043 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.ContainerManagerImpl: ContainerManager started at data1/192.168.0.115:43023
2017-08-11 14:41:24,043 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.ContainerManagerImpl: ContainerManager bound to 0.0.0.0/0.0.0.0:0
2017-08-11 14:41:24,044 INFO org.apache.hadoop.yarn.server.nodemanager.webapp.WebServer: Instantiating NMWebApp at 0.0.0.0:8042
2017-08-11 14:41:24,135 INFO org.mortbay.log: Logging to org.slf4j.impl.Log4jLoggerAdapter(org.mortbay.log) via org.mortbay.log.Slf4jLog
2017-08-11 14:41:24,139 INFO org.apache.hadoop.http.HttpRequestLog: Http request log for http.requests.nodemanager is not defined
2017-08-11 14:41:24,151 INFO org.apache.hadoop.http.HttpServer2: Added global filter 'safety' (class=org.apache.hadoop.http.HttpServer2$QuotingInputFilter)
2017-08-11 14:41:24,157 INFO org.apache.hadoop.http.HttpServer2: Added filter static_user_filter (class=org.apache.hadoop.http.lib.StaticUserWebFilter$StaticUserFilter) to context node
2017-08-11 14:41:24,157 INFO org.apache.hadoop.http.HttpServer2: Added filter static_user_filter (class=org.apache.hadoop.http.lib.StaticUserWebFilter$StaticUserFilter) to context static
2017-08-11 14:41:24,157 INFO org.apache.hadoop.http.HttpServer2: Added filter static_user_filter (class=org.apache.hadoop.http.lib.StaticUserWebFilter$StaticUserFilter) to context logs
2017-08-11 14:41:24,167 INFO org.apache.hadoop.http.HttpServer2: adding path spec: /node/*
2017-08-11 14:41:24,171 INFO org.apache.hadoop.http.HttpServer2: adding path spec: /ws/*
2017-08-11 14:41:24,182 INFO org.apache.hadoop.http.HttpServer2: Jetty bound to port 8042
2017-08-11 14:41:24,182 INFO org.mortbay.log: jetty-6.1.26
2017-08-11 14:41:24,230 INFO org.mortbay.log: Extract jar:file:/usr/local/hadoop/share/hadoop/yarn/hadoop-yarn-common-2.6.5.jar!/webapps/node to /tmp/Jetty_0_0_0_0_8042_node____19tj0x/webapp
2017-08-11 14:41:24,804 INFO org.mortbay.log: Started HttpServer2$SelectChannelConnectorWithSafeStartup@0.0.0.0:8042
2017-08-11 14:41:24,804 INFO org.apache.hadoop.yarn.webapp.WebApps: Web app /node started at 8042
2017-08-11 14:41:25,349 INFO org.apache.hadoop.yarn.webapp.WebApps: Registered webapp guice modules
2017-08-11 14:41:25,358 INFO org.apache.hadoop.yarn.client.RMProxy: Connecting to ResourceManager at master/192.168.0.116:8031
2017-08-11 14:41:25,383 INFO org.apache.hadoop.yarn.server.nodemanager.NodeStatusUpdaterImpl: Sending out 0 NM container statuses: []
2017-08-11 14:41:25,389 INFO org.apache.hadoop.yarn.server.nodemanager.NodeStatusUpdaterImpl: Registering with RM using containers :[]
2017-08-11 14:41:25,442 INFO org.apache.hadoop.yarn.server.nodemanager.security.NMContainerTokenSecretManager: Rolling master-key for container-tokens, got key with id 109013203
2017-08-11 14:41:25,445 INFO org.apache.hadoop.yarn.server.nodemanager.security.NMTokenSecretManagerInNM: Rolling master-key for container-tokens, got key with id -2053362328
2017-08-11 14:41:25,445 INFO org.apache.hadoop.yarn.server.nodemanager.NodeStatusUpdaterImpl: Registered with ResourceManager as data1:43023 with total resource of <memory:2048, vCores:2>
2017-08-11 14:41:25,445 INFO org.apache.hadoop.yarn.server.nodemanager.NodeStatusUpdaterImpl: Notifying ContainerManager to unblock new container-requests
2017-08-11 14:42:24,988 INFO SecurityLogger.org.apache.hadoop.ipc.Server: Auth successful for appattempt_1502433676680_0001_000001 (auth:SIMPLE)
2017-08-11 14:42:25,126 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.ContainerManagerImpl: Start request for container_1502433676680_0001_01_000001 by user hduser
2017-08-11 14:42:25,158 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.ContainerManagerImpl: Creating a new application reference for app application_1502433676680_0001
2017-08-11 14:42:25,165 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.application.Application: Application application_1502433676680_0001 transitioned from NEW to INITING
2017-08-11 14:42:25,171 INFO org.apache.hadoop.yarn.server.nodemanager.NMAuditLogger: USER=hduser    IP=192.168.0.116    OPERATION=Start Container Request    TARGET=ContainerManageImpl    RESULT=SUCCESS    APPID=application_1502433676680_0001    CONTAINERID=container_1502433676680_0001_01_000001
2017-08-11 14:42:26,246 WARN org.apache.hadoop.yarn.server.nodemanager.containermanager.logaggregation.AppLogAggregatorImpl: rollingMonitorInterval is set as -1. The log rolling mornitoring interval is disabled. The logs will be aggregated after this application is finished.
2017-08-11 14:42:26,289 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.application.Application: Adding container_1502433676680_0001_01_000001 to application application_1502433676680_0001
2017-08-11 14:42:26,292 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.application.Application: Application application_1502433676680_0001 transitioned from INITING to RUNNING
2017-08-11 14:42:26,296 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.container.Container: Container container_1502433676680_0001_01_000001 transitioned from NEW to LOCALIZING
2017-08-11 14:42:26,297 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.AuxServices: Got event CONTAINER_INIT for appId application_1502433676680_0001
2017-08-11 14:42:26,307 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.localizer.LocalizedResource: Resource hdfs://master:9000/tmp/hadoop-yarn/staging/hduser/.staging/job_1502433676680_0001/job.jar transitioned from INIT to DOWNLOADING
2017-08-11 14:42:26,307 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.localizer.LocalizedResource: Resource hdfs://master:9000/tmp/hadoop-yarn/staging/hduser/.staging/job_1502433676680_0001/job.splitmetainfo transitioned from INIT to DOWNLOADING
2017-08-11 14:42:26,307 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.localizer.LocalizedResource: Resource hdfs://master:9000/tmp/hadoop-yarn/staging/hduser/.staging/job_1502433676680_0001/job.split transitioned from INIT to DOWNLOADING
2017-08-11 14:42:26,308 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.localizer.LocalizedResource: Resource hdfs://master:9000/tmp/hadoop-yarn/staging/hduser/.staging/job_1502433676680_0001/job.xml transitioned from INIT to DOWNLOADING
2017-08-11 14:42:26,308 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.localizer.ResourceLocalizationService: Created localizer for container_1502433676680_0001_01_000001
2017-08-11 14:42:26,341 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.localizer.ResourceLocalizationService: Writing credentials to the nmPrivate file /tmp/hadoop-hduser/nm-local-dir/nmPrivate/container_1502433676680_0001_01_000001.tokens. Credentials list:
2017-08-11 14:42:26,357 INFO org.apache.hadoop.yarn.server.nodemanager.DefaultContainerExecutor: Initializing user hduser
2017-08-11 14:42:26,416 INFO org.apache.hadoop.yarn.server.nodemanager.DefaultContainerExecutor: Copying from /tmp/hadoop-hduser/nm-local-dir/nmPrivate/container_1502433676680_0001_01_000001.tokens to /tmp/hadoop-hduser/nm-local-dir/usercache/hduser/appcache/application_1502433676680_0001/container_1502433676680_0001_01_000001.tokens
2017-08-11 14:42:26,416 INFO org.apache.hadoop.yarn.server.nodemanager.DefaultContainerExecutor: Localizer CWD set to /tmp/hadoop-hduser/nm-local-dir/usercache/hduser/appcache/application_1502433676680_0001 = file:/tmp/hadoop-hduser/nm-local-dir/usercache/hduser/appcache/application_1502433676680_0001
2017-08-11 14:42:26,681 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.localizer.LocalizedResource: Resource hdfs://master:9000/tmp/hadoop-yarn/staging/hduser/.staging/job_1502433676680_0001/job.jar(->/tmp/hadoop-hduser/nm-local-dir/usercache/hduser/appcache/application_1502433676680_0001/filecache/10/job.jar) transitioned from DOWNLOADING to LOCALIZED
2017-08-11 14:42:26,714 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.localizer.LocalizedResource: Resource hdfs://master:9000/tmp/hadoop-yarn/staging/hduser/.staging/job_1502433676680_0001/job.splitmetainfo(->/tmp/hadoop-hduser/nm-local-dir/usercache/hduser/appcache/application_1502433676680_0001/filecache/11/job.splitmetainfo) transitioned from DOWNLOADING to LOCALIZED
2017-08-11 14:42:26,740 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.localizer.LocalizedResource: Resource hdfs://master:9000/tmp/hadoop-yarn/staging/hduser/.staging/job_1502433676680_0001/job.split(->/tmp/hadoop-hduser/nm-local-dir/usercache/hduser/appcache/application_1502433676680_0001/filecache/12/job.split) transitioned from DOWNLOADING to LOCALIZED
2017-08-11 14:42:26,762 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.localizer.LocalizedResource: Resource hdfs://master:9000/tmp/hadoop-yarn/staging/hduser/.staging/job_1502433676680_0001/job.xml(->/tmp/hadoop-hduser/nm-local-dir/usercache/hduser/appcache/application_1502433676680_0001/filecache/13/job.xml) transitioned from DOWNLOADING to LOCALIZED
2017-08-11 14:42:26,763 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.container.Container: Container container_1502433676680_0001_01_000001 transitioned from LOCALIZING to LOCALIZED
2017-08-11 14:42:26,805 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.container.Container: Container container_1502433676680_0001_01_000001 transitioned from LOCALIZED to RUNNING
2017-08-11 14:42:26,805 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl: Neither virutal-memory nor physical-memory monitoring is needed. Not running the monitor-thread
2017-08-11 14:42:26,821 INFO org.apache.hadoop.yarn.server.nodemanager.DefaultContainerExecutor: launchContainer: [bash, /tmp/hadoop-hduser/nm-local-dir/usercache/hduser/appcache/application_1502433676680_0001/container_1502433676680_0001_01_000001/default_container_executor.sh]
2017-08-11 14:42:31,649 WARN org.apache.hadoop.yarn.server.nodemanager.DefaultContainerExecutor: Exit code from container container_1502433676680_0001_01_000001 is : 1
2017-08-11 14:42:31,650 WARN org.apache.hadoop.yarn.server.nodemanager.DefaultContainerExecutor: Exception from container-launch with container ID: container_1502433676680_0001_01_000001 and exit code: 1
ExitCodeException exitCode=1:
    at org.apache.hadoop.util.Shell.runCommand(Shell.java:575)
    at org.apache.hadoop.util.Shell.run(Shell.java:478)
    at org.apache.hadoop.util.Shell$ShellCommandExecutor.execute(Shell.java:766)
    at org.apache.hadoop.yarn.server.nodemanager.DefaultContainerExecutor.launchContainer(DefaultContainerExecutor.java:212)
    at org.apache.hadoop.yarn.server.nodemanager.containermanager.launcher.ContainerLaunch.call(ContainerLaunch.java:302)
    at org.apache.hadoop.yarn.server.nodemanager.containermanager.launcher.ContainerLaunch.call(ContainerLaunch.java:82)
    at java.util.concurrent.FutureTask.run(FutureTask.java:262)
    at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145)
    at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
    at java.lang.Thread.run(Thread.java:745)
2017-08-11 14:42:31,652 INFO org.apache.hadoop.yarn.server.nodemanager.ContainerExecutor: Exception from container-launch.
2017-08-11 14:42:31,653 INFO org.apache.hadoop.yarn.server.nodemanager.ContainerExecutor: Container id: container_1502433676680_0001_01_000001
2017-08-11 14:42:31,653 INFO org.apache.hadoop.yarn.server.nodemanager.ContainerExecutor: Exit code: 1
2017-08-11 14:42:31,653 INFO org.apache.hadoop.yarn.server.nodemanager.ContainerExecutor: Stack trace: ExitCodeException exitCode=1:
2017-08-11 14:42:31,653 INFO org.apache.hadoop.yarn.server.nodemanager.ContainerExecutor:     at org.apache.hadoop.util.Shell.runCommand(Shell.java:575)
2017-08-11 14:42:31,653 INFO org.apache.hadoop.yarn.server.nodemanager.ContainerExecutor:     at org.apache.hadoop.util.Shell.run(Shell.java:478)
2017-08-11 14:42:31,653 INFO org.apache.hadoop.yarn.server.nodemanager.ContainerExecutor:     at org.apache.hadoop.util.Shell$ShellCommandExecutor.execute(Shell.java:766)
2017-08-11 14:42:31,653 INFO org.apache.hadoop.yarn.server.nodemanager.ContainerExecutor:     at org.apache.hadoop.yarn.server.nodemanager.DefaultContainerExecutor.launchContainer(DefaultContainerExecutor.java:212)
2017-08-11 14:42:31,653 INFO org.apache.hadoop.yarn.server.nodemanager.ContainerExecutor:     at org.apache.hadoop.yarn.server.nodemanager.containermanager.launcher.ContainerLaunch.call(ContainerLaunch.java:302)
2017-08-11 14:42:31,653 INFO org.apache.hadoop.yarn.server.nodemanager.ContainerExecutor:     at org.apache.hadoop.yarn.server.nodemanager.containermanager.launcher.ContainerLaunch.call(ContainerLaunch.java:82)
2017-08-11 14:42:31,653 INFO org.apache.hadoop.yarn.server.nodemanager.ContainerExecutor:     at java.util.concurrent.FutureTask.run(FutureTask.java:262)
2017-08-11 14:42:31,653 INFO org.apache.hadoop.yarn.server.nodemanager.ContainerExecutor:     at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145)
2017-08-11 14:42:31,653 INFO org.apache.hadoop.yarn.server.nodemanager.ContainerExecutor:     at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
2017-08-11 14:42:31,653 INFO org.apache.hadoop.yarn.server.nodemanager.ContainerExecutor:     at java.lang.Thread.run(Thread.java:745)
2017-08-11 14:42:31,654 WARN org.apache.hadoop.yarn.server.nodemanager.containermanager.launcher.ContainerLaunch: Container exited with a non-zero exit code 1
2017-08-11 14:42:31,655 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.container.Container: Container container_1502433676680_0001_01_000001 transitioned from RUNNING to EXITED_WITH_FAILURE
2017-08-11 14:42:31,655 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.launcher.ContainerLaunch: Cleaning up container container_1502433676680_0001_01_000001
2017-08-11 14:42:31,677 INFO org.apache.hadoop.yarn.server.nodemanager.DefaultContainerExecutor: Deleting absolute path : /tmp/hadoop-hduser/nm-local-dir/usercache/hduser/appcache/application_1502433676680_0001/container_1502433676680_0001_01_000001
2017-08-11 14:42:31,688 WARN org.apache.hadoop.yarn.server.nodemanager.NMAuditLogger: USER=hduser    OPERATION=Container Finished - Failed    TARGET=ContainerImpl    RESULT=FAILURE    DESCRIPTION=Container failed with state: EXITED_WITH_FAILURE    APPID=application_1502433676680_0001    CONTAINERID=container_1502433676680_0001_01_000001
2017-08-11 14:42:31,691 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.container.Container: Container container_1502433676680_0001_01_000001 transitioned from EXITED_WITH_FAILURE to DONE
2017-08-11 14:42:31,692 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.application.Application: Removing container_1502433676680_0001_01_000001 from application application_1502433676680_0001
2017-08-11 14:42:31,692 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl: Neither virutal-memory nor physical-memory monitoring is needed. Not running the monitor-thread
2017-08-11 14:42:31,693 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.logaggregation.AppLogAggregatorImpl: Considering container container_1502433676680_0001_01_000001 for log-aggregation
2017-08-11 14:42:31,693 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.AuxServices: Got event CONTAINER_STOP for appId application_1502433676680_0001
2017-08-11 14:42:32,699 INFO org.apache.hadoop.yarn.server.nodemanager.NodeStatusUpdaterImpl: Removed completed containers from NM context: [container_1502433676680_0001_01_000001]
2017-08-11 14:42:38,728 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.application.Application: Application application_1502433676680_0001 transitioned from RUNNING to APPLICATION_RESOURCES_CLEANINGUP
2017-08-11 14:42:38,729 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.AuxServices: Got event APPLICATION_STOP for appId application_1502433676680_0001
2017-08-11 14:42:38,731 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.application.Application: Application application_1502433676680_0001 transitioned from APPLICATION_RESOURCES_CLEANINGUP to FINISHED
2017-08-11 14:42:38,731 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.logaggregation.AppLogAggregatorImpl: Application just finished : application_1502433676680_0001
2017-08-11 14:42:38,731 INFO org.apache.hadoop.yarn.server.nodemanager.DefaultContainerExecutor: Deleting absolute path : /tmp/hadoop-hduser/nm-local-dir/usercache/hduser/appcache/application_1502433676680_0001
2017-08-11 14:42:38,781 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.logaggregation.AppLogAggregatorImpl: Uploading logs for container container_1502433676680_0001_01_000001. Current good log dirs are /usr/local/hadoop/logs/userlogs
2017-08-11 14:42:38,809 INFO org.apache.hadoop.yarn.server.nodemanager.DefaultContainerExecutor: Deleting path : /usr/local/hadoop/logs/userlogs/application_1502433676680_0001/container_1502433676680_0001_01_000001/syslog
2017-08-11 14:42:38,809 INFO org.apache.hadoop.yarn.server.nodemanager.DefaultContainerExecutor: Deleting path : /usr/local/hadoop/logs/userlogs/application_1502433676680_0001/container_1502433676680_0001_01_000001/stderr
2017-08-11 14:42:38,809 INFO org.apache.hadoop.yarn.server.nodemanager.DefaultContainerExecutor: Deleting path : /usr/local/hadoop/logs/userlogs/application_1502433676680_0001/container_1502433676680_0001_01_000001/stdout
2017-08-11 14:42:38,957 INFO org.apache.hadoop.yarn.server.nodemanager.DefaultContainerExecutor: Deleting path : /usr/local/hadoop/logs/userlogs/application_1502433676680_0001
已邀请:

要回复问题请先登录注册