Storm-源码分析- Multimethods使用例子
2023-03-14 22:33:30 时间
1. storm通过multimethods来区分local和distributed模式
当调用launch-worker的时候, clojure会自动根据defmulti里面定义的fn来判断是调用哪个版本的launch-worker
(defmulti launch-worker (fn [supervisor & _] (cluster-mode (:conf supervisor))))
(defmethod launch-worker :distributed [supervisor storm-id port worker-id] (let [conf (:conf supervisor) storm-home (System/getProperty "storm.home") stormroot (supervisor-stormdist-root conf storm-id) stormjar (supervisor-stormjar-path stormroot) storm-conf (read-supervisor-storm-conf conf storm-id) classpath (add-to-classpath (current-classpath) [stormjar]) childopts (.replaceAll (str (conf WORKER-CHILDOPTS) " " (storm-conf TOPOLOGY-WORKER-CHILDOPTS)) "%ID%" (str port)) logfilename (str "worker-" port ".log") command (str "java -server " childopts " -Djava.library.path=" (conf JAVA-LIBRARY-PATH) " -Dlogfile.name=" logfilename " -Dstorm.home=" storm-home " -Dlogback.configurationFile=" storm-home "/logback/cluster.xml" " -cp " classpath " backtype.storm.daemon.worker " (java.net.URLEncoder/encode storm-id) " " (:assignment-id supervisor) " " port " " worker-id)] (log-message "Launching worker with command: " command) (launch-process command :environment {"LD_LIBRARY_PATH" (conf JAVA-LIBRARY-PATH)}) ))
(defmethod launch-worker :local [supervisor storm-id port worker-id] (let [conf (:conf supervisor) pid (uuid) worker (worker/mk-worker conf (:shared-context supervisor) storm-id (:assignment-id supervisor) port worker-id)] (psim/register-process pid worker) (swap! (:worker-thread-pids-atom supervisor) assoc worker-id pid) ))
2. storm通过multimethods来区分blot和spout
在executor.clj中通过multimethods来区分blot和spout不同的创建逻辑
(defmulti mk-threads executor-selector) (defmulti mk-executor-stats executor-selector) (defmulti close-component executor-selector)
本文章摘自博客园,原文发布日期:2013-06-28
相关文章
- 聊聊 iOS16 中的三种新字体宽度样式
- Sourcery 的 Swift Package 命令行插件
- Kotlin Flow响应式编程,基础知识入门
- 死磕操作系统!谷歌重磅发布开源KataOS,网友:「谷歌坟场」喜+1
- 速度与安全可兼得!改造异步布局大幅提升客户端布局性能
- 深入理解 Android Studio Sync 流程
- Sendable 和 @Sendable 闭包代码实例详解
- 一文让你理清PrimaryScrollController
- iOS 16“实时活动”适配灵动岛:显示比分或外卖进度等!
- iOS基于Speech框架的语音识别波浪动图实现
- iOS16新功能被曝耗电严重,暂时别用了!
- 信息架构如何设计?5000字干货帮你快速掌握!
- 免费!批量!无需联网!提取图片文字就靠它!
- 实现模块化应用的本地化
- 如何评测端到端音视频质量?
- iOS 16正式版大翻车,引来果粉无数吐槽!
- SwiftUI 之 HStack 和 VStack 的切换
- Alibaba.com瘦包40MB—业界最全的iOS包大小技术总结
- iOS16值不值得更新,看这几个功能你喜不喜欢。
- iOS 16正式版将至:六大新功能绝了