Workflow data passing

[jkolczasty]

Need more clarification how data passing works in workflow.

Trying to evaluate case, when one job (shell script) generates output (e.g. valid JSON on stdout) and it's used in input data in following job. Currently nothing is working for me, 2nd scripts in {{data.input}} shows just {}

Tested few options like "Interpret JSON Output" and "Data passthru". Nothing works for me. Btw didn't found any documentation about that options.

[jhuckaby]

I'm so sorry you are having trouble. I'm still working on the documentation, and working on some tutorial videos as well.

To pass data between jobs, you just need to make sure you format it correctly when printing, e.g. in shell:

#!/bin/bash

echo '{ "xy":1, "data": { "foo": "bar" } }'

You have to remember the xy property set to 1, so xyOps knows this is a JSON message it needs to "eat", and the data you want to pass needs to be wrapped in a data object, as shown above. Also, the whole thing must be compacted onto a single line.

When you connect this job to another one in a workflow like this:

The second job can read from STDIN and the data will be in the data object, which is inside the input object:

#!/bin/bash

data=$(cat)
echo "Data: $data"

Job output of the second job shown here:

As you can see it receives the entire Job object via STDIN, which is quite verbose and has a lot of properties, but the input.data is right there:

"input":{"data":{"foo":"bar"},"files":[]}

Relevant docs are here:

• https://docs.xyops.io/#Docs/workflows/data-passing-between-nodes
• https://docs.xyops.io/#Docs/plugins/input
• https://docs.xyops.io/#Docs/plugins/output-data
• https://docs.xyops.io/#Docs/xywp

Hope this helps, and I will work on improving the docs.