Storm(流计算)环境安装及配置

Storm 集群安装和配置

Summary of the steps for setting up a Storm cluster:

Set up a Zookeeper cluster
Install dependencies on Nimbus and worker machines
Download and extract a Storm release to Nimbus and worker machines
Fill in mandatory configurations into storm.yaml
Launch daemons under supervision using “storm” script and a supervisor of your choice

配置：

源代码入口：

1
2
3

bin/storm nimbus                                   org.apache.storm.daemon.nimbus
bin/storm supervisor                              org.apache.storm.daemon.supervisor
bin/storm ui                                             org.apache.storm.ui.core

运行测试案例：

1	bin/storm jar examples/storm-starter/storm-starter-topologies-1.0.2.jar org.apache.storm.starter.WordCountTopology

nimbus 与 supervisor之间通过zookeeper 进行通信

1 2	[zk: localhost:2181(CONNECTED) 9] ls /storm [backpressure, workerbeats, nimbuses, supervisors, errors, logconfigs, storms, assignments, leader-lock, blobstore]

Integration With External Systems, and Other Libraries

Flux Data Driven Topology Builder
Apache Kafka Integration
Apache HBase Integration
Apache HDFS Integration
Apache Hive Integration
JDBC Integration
Redis Integration
Event Hubs Intergration
Kestrel Intergration

2017-07-19