Retrying task after failure: Waiting for lock. org.apache.iceberg.hive.HiveTableOperations$WaitingForLockException: Waiting for lock.
Apache for hive org lock Task After failure
2023-09-14 08:57:20 时间
执行spark任务居然碰到了hive中表的被锁了,导致写数据时失败,这个还真是头一次碰到过这回事。
错误信息如下:
22/09/04 21:02:28 WARN Tasks: Retrying task after failure: Waiting for lock.
org.apache.iceberg.hive.HiveTableOperations$WaitingForLockException: Waiting for lock.
at org.apache.iceberg.hive.HiveTableOperations.lambda$acquireLock$9(HiveTableOperations.java:460)
at org.apache.iceberg.util.Tasks$Builder.runTaskWithRetry(Tasks.java:404)
at org.apache.iceberg.util.Tasks$Builder.runSingleThreaded(Tasks.java:214)
at org.apache.iceberg.util.Tasks$Builder.run(Tasks.java:198)
at org.apache.iceberg.hive.HiveTableOperations.acquireLock(HiveTableOperations.java:454)
at org.apache.iceberg.hive.HiveTableOperations.doCommit(HiveTableOperations.java:226)
at org.apache.iceberg.BaseMetastoreTableOperations.commit(BaseMetastoreTableOperations.java:127)
at org.apache.iceberg.SnapshotProducer.lambda$commit$2(SnapshotProducer.java:304)
at org.apache.iceberg.util.Tasks$Builder.runTaskWithRetry(Tasks.java:404)
at org.apache.iceberg.util.Tasks$Builder.runSingleThreaded(Tasks.java:214)
at org.apache.iceberg.util.Tasks$Builder.run(Tasks.java:198)
at org.apache.iceberg.util.Tasks$Builder.run(Tasks.java:190)
at org.apache.iceberg.SnapshotProducer.commit(SnapshotProducer.java:282)
at org.apache.iceberg.BaseReplacePartitions.commit(BaseReplacePartitions.java:26)
at org.apache.iceberg.spark.source.Writer.commitOperation(Writer.java:144)
at org.apache.iceberg.spark.source.Writer.replacePartitions(Writer.java:181)
at org.apache.iceberg.spark.source.Writer.commit(Writer.java:119)
at org.apache.spark.sql.execution.datasources.v2.WriteToDataSourceV2Exec.doExecute(WriteToDataSourceV2Exec.scala:76)
跑到hive的元数据库中查询时,在表HIVE_LOCKS中找到了一些信息。
根据出错信息,根据hl_table找到相关的表,查看最近的心跳时间字段,hl_last_heartbeat。
删除对应的记录即可。
delete from HIVE_LOCKS where hl_table = '出错的表名';
相关文章
- 解决Failed to execute goal org.apache.maven.plugins:maven-compiler-plugin:3.7.0:compile
- Linux—搭建Apache(httpd)服务
- nginx php apache php 对比,Apache和nginx的比较「建议收藏」
- Apache配置详解(最好的APACHE配置教程)
- 大数据架构系列:Apache Kylin 4.0
- 腾讯云大数据“数智话”技术沙龙 第一期—云数据仓库 for Apache Doris 内容回顾
- 基于 Apache Hudi + Presto + AWS S3 构建开放Lakehouse
- Apache Hudi 0.12.2发布
- apache虚拟主机配置的三种方式(小结)
- Ubuntu 18.04上安装Apache、MySQL、PHP、LAMP的完整教程
- apache用Linux服务器架设QQ五笔输入法服务:基于Apache技术(qq五笔linux)
- 服务Linux下重启Apache服务的步骤(linux重启apache)
- loopOracle中的循环编程:For Loop游标(oracle游标for)
- Linux 下 Apache 服务器安装指南(linux安装apache)
- MySQL存储过程中使用FOR循环的实现(mysql存储过程for循环)
- 循环使用Oracle数组实现For循环(oracle数组for)
- Apache Lucene 5.0发布,不再兼容3.X系列版本
- 如何理解Apache 2.0许可证中的专利许可条款?
- 六个藉藉无名但迅速崛起的Apache大数据项目
- 如何在Apache中配置MySQL数据库连接(mysql、apache)
- 浅谈apache和nginx的rewrite的区别
- win8下XAMPP中Apache模块无效(apache无法打开)的解决方法
- 如何配置apache虚拟主机的实例小结