Heron Run Notes

Running on YARN:

bin/heron submit yarn ~/.heron/examples/heron-streamlet-examples.jar com.twitter.heron.examples.streamlet.WindowedWordCountTopology WindowedWordCountTopologyNew --extra-launch-classpath /etc/hadoop/conf:/usr/lib/hadoop/lib/*:/usr/lib/hadoop/.//*:/usr/lib/hadoop-hdfs/./:/usr/lib/hadoop-hdfs/lib/*:/usr/lib/hadoop-hdfs/.//*:/usr/lib/hadoop-yarn/lib/*:/usr/lib/hadoop-yarn/.//*:/usr/lib/hadoop-mapreduce/lib/*:/usr/lib/hadoop-mapreduce/.//*:/usr/lib/hadoop-lzo/lib/*:/usr/share/aws/aws-java-sdk/*:/usr/share/aws/emr/emrfs/conf:/usr/share/aws/emr/emrfs/lib/*:/usr/share/aws/emr/emrfs/auxlib/*:/usr/share/aws/emr/ddb/lib/emr-ddb-hadoop.jar:/usr/share/aws/emr/goodies/lib/emr-hadoop-goodies.jar:/usr/share/aws/emr/kinesis/lib/emr-kinesis-hadoop.jar:/usr/share/aws/emr/cloudwatch-sink/lib/*:$PWD/classpath --verbose

Update classpath files:

[hadoop@ip-172-31-94-21 ~]$ ls classpath/
commons-cli-1.4.jar  curator-client-2.12.0.jar  curator-framework-2.11.1.jar  protobuf-java-3.3.1.jar