Inherited Parameters
Any included
.properties files will be treated as properties that are shared amongst the individual jobs of the flow. The properties are resolved in a hierarchical manner by directory.system.properties baz.job myflow/ myflow.properties foo.job
That directory structure will be preserved when running in Azkaban. The
baz job will inherit only from system.properties. The jobsfoo will inherit from myflow.properties, which in turn will inherit from system.properties.
Parameter Substitution
Azkaban allows for replacing of parameters. Whenever a
${parameter} is found in a properties or job file, Azkaban will attempt to replace that parameter. # shared.properties replaceparameter=bar
# myjob.job
param1=mytest
foo=${replaceparameter}
param2=${param1}
In the previous example, before
myjob is run, foo will equal bar and param2 will equal mytest.Embedded flow
A flow can also be included as a node in other flow as an embedded flow. To create an embedded flow, simply create a
.job file withtype=flow and flow.name set to the name of the end action of the embedded flow.# subflow.job
type=flow
flow.name=endSubflow
How I can fetch the logs of the inner nodes in case the project has embedded flows?
ReplyDelete