File tree Expand file tree Collapse file tree
Utils/Dataflow/data4es/batch_stage Expand file tree Collapse file tree Original file line number Diff line number Diff line change 1- source ../../shell_lib/eop_filter
2-
3- cmd=" ./stage.py -m s"
4- cmd_batch2=" ./stage.py -b 2 -m s"
5- cmd_batch100=" ./stage.py -b 100 -m s"
1+ cmd=" ./stage.py -m s -E $1 "
2+ cmd_batch2=" ./stage.py -b 2 -m s -E $1 "
3+ cmd_batch100=" ./stage.py -b 100 -m s -E $1 "
64
75# Various tests that should produce the same results.
86
97# Stage chains.
10- # these differ by size without eop_filter at the end
11- cat inp | $cmd | eop_filter | $cmd | eop_filter > outp1
12- cat inp | $cmd_batch2 | eop_filter | $cmd_batch2 | eop_filter > outp2
13- cat inp | $cmd_batch100 | eop_filter | $cmd_batch100 | eop_filter > outp100
14- cat inp | $cmd | eop_filter | $cmd_batch2 | eop_filter > outp12
15- cat inp | $cmd_batch2 | eop_filter | $cmd | eop_filter > outp21
8+ cat inp | $cmd " " | $cmd " " > outp1
9+ cat inp | $cmd_batch2 " " | $cmd_batch2 " " > outp2
10+ cat inp | $cmd_batch100 " " | $cmd_batch100 " " > outp100
11+ cat inp | $cmd " " | $cmd_batch2 " " > outp12
12+ cat inp | $cmd_batch2 " " | $cmd " " > outp21
You can’t perform that action at this time.
0 commit comments