HBase和MapReduce框架之TableMapReduceUtil类
2023-09-14 09:13:16 时间
HBase和MapReduce框架之TableMapReduceUtil类
initTableMapperJob
方法
public static void initTableMapperJob(String table,
Scan scan,
Class<? extends TableMapper> mapper,
Class<?> outputKeyClass,
Class<?> outputValueClass,
org.apache.hadoop.mapreduce.Job job,
boolean addDependencyJars,
Class<? extends org.apache.hadoop.mapreduce.InputFormat> inputFormatClass)
throws IOException
Use this before submitting a TableMap job. It will appropriately set up the job.
Parameters:
table - The table name to read from.#表名
scan - The scan instance with the columns, time range etc.#对表的扫描操作
mapper - The mapper class to use.
outputKeyClass - The class of the output key.
outputValueClass - The class of the output value.
job - The current job to adjust. Make sure the passed job is carrying all necessary HBase configuration.
addDependencyJars - upload HBase jars and jars for any of the configured job classes via the distributed cache (tmpjars).
Throws:
IOException - When setting up the details fails.
相关文章
- HBase原理、基本概念、基本架构-3
- Hbase 学习(十一)使用hive往hbase当中导入数据
- hbase源码系列(四)数据模型-表定义和列族定义的具体含义
- hbase 学习(十六)系统架构图
- Spark 如何写入HBase/Redis/MySQL/Kafka
- 大数据集群启停shell脚本:hadoop(hdfs、yarn)、hbase集群启停
- hbase学习(一)hbase单机部署和java客户端连接单机hbase
- 【图文详解】一文全面彻底搞懂HBase、LevelDB、RocksDB等NoSQL背后的存储原理:LSM-tree日志结构合并树...
- Hbase总结(五)-hbase常识及habse适合什么场景
- 1006-HBase操作实战(JAVA API状态)
- NoSQL四种——kv存储(memcache,Riak),列存储(Cassandra,Hbase),文档类(mongoDB,CouchDB),图数据库(neo4j)
- HBase和ZooKeeper
- hbase如何保证数据完整性,丢失数据该如何解决
- 关闭HBase时 no hbase master found
- 【大数据开发运维解决方案】Hadoop+Mysql+Hive+zookeeper+kafka+Hbase+Sqoop+Kylin单机伪分布式安装及官方案例详细文档