【大数据】Hadoop-Yarn常用运维命令使用
2023-09-11 14:21:26 时间
Yarn命令
查看任务
列出所有Application
yarn application -list
根据Application状态过滤
yarn application -list -appStates
Kill掉Application
yarn application -kill <ApplicationId>
查看集群负载和资源情况
使用yarn top命令查看,和linux的top类似
yarn top
NodeManager(s): 3 total, 3 active, 0 unhealthy, 0 decommissioned, 0 lost, 0 rebooted
Queue(s) Applications: 1 running, 33 submitted, 0 pending, 31 completed, 0 killed, 1 failed
Queue(s) Mem(GB): 17 available, 6 allocated, 0 pending, 0 reserved
Queue(s) VCores: 21 available, 2 allocated, 0 pending, 0 reserved
Queue(s) Containers: 2 allocated, 0 pending, 0 reserved
application_1676450522732_0035 root spark default 0 2 0 2 0 6G 0G 76 232 10.00 00:00:00 org.ap
yarn logs查看日志
查询Application日志
yarn logs -applicationId <ApplicationId>
查看am日志
bin/yarn logs -am [1,2] -applicationId <ApplicationId>
yarn applicationattempt查看尝试运行的任务
yarn applicationattempt -list <ApplicationId>
打印ApplicationAttemp状态
yarn applicationattempt -status <ApplicationAttemptId>
yarn container查看容器
列出所有Container
yarn container -list <ApplicationAttemptId>
打印Container状态
只有在任务跑的途中才能看到container的状态
yarn container -status <ContainerId>
yarn node查看节点状态
列出所有节点
yarn node -list -all
yarn rmadmin更新配置
加载队列配置
yarn rmadmin -refreshQueues
yarn queue查看队列
打印队列信息
yarn queue -status <QueueName>
希望对正在查看文章的您有所帮助,记得关注、评论、收藏,谢谢您
相关文章
- 报错:Tez Compression codec com.hadoop.compression.lzo.LzoCodec not found.
- 报错:HDFS IO error org.apache.hadoop.security.AccessControlException: Permission denied: user=root, access=WRITE, inode="/yk/dl/alarm_his":hdfs:supergroup:drwxr-xr-x
- Mac下配置Hadoop环境
- Hadoop框架:HDFS简介与Shell管理命令
- centos安装配置hadoop超详细过程(含故障排除)
- org.apache.hadoop.fs.FSError: java.io.IOException: 设备上没有空间 at org.apache.hadoop.fs.RawLocalFileSyste
- 【Hadoop】新建hadoop用户以及用户组,给予sudo权限(转)
- 《Hadoop实战手册》一1.2 使用Hadoop shell命令导入和导出数据到HDFS
- 《Hadoop MapReduce实战手册》一2.3 添加一个新的DataNode
- 创建Hadoop用户
- 《深入理解大数据:大数据处理与编程实践》一一2.2 单机和单机伪分布式Hadoop系统安装基本步骤
- Deploy custom service on non hadoop node with Apache Ambari
- 《Spark与Hadoop大数据分析》一一第3章 深入剖析Apache Spark
- 《Hadoop集群与安全》一1.1 选择Hadoop集群硬件
- Windows下Hadoop的环境安装[转]
- Zookeeper的作用,在Hadoop及hbase中具体作用
- 【大数据Hadoop】macbookpro m1/m2 arm 编译hadoop-3.3.1