How does batch-output enable parallelism?

Run several copies of a downstream node, each with a different batch range. The platform processes those slices together instead of one serial pass.

Can it batch a folder of files?

Yes. Supply folder instead of (or alongside) file and use the same START_LINE,END_LINE batch string to select a contiguous group of files.

When should I use batch-output-v2 instead?

For new workflows. v2 adds explicit lines and files modes plus built-in parallel batch processing on the same START,END idea.

Does batch-output run a scanner or probe?

No. It only slices input. Wire the selected batch into httpx, a port scanner, or another consumer that does the real work.

What does the node write?

A FILE and a FOLDER holding the selected slice, ready for the next node in the graph.

Updated Jul 15, 2026

Utilities

Carve a line or folder range for parallel workers

Extract file or folder lines by START_LINE,END_LINE batch range.

Split a huge list for parallel runs Throttle a slow downstream tool Resume from a known offset

overview

What batch-output does

batch-output turns a large producer output into even pieces. Give it a file and a START_LINE,END_LINE batch string; it returns only that slice as FILE and FOLDER.

Operators reach for it when one scanner pass over a million-line list will not finish. Pair ranges such as 1,5000 and 5001,10000 with parallel copies of the downstream node.

It slices input only. Prefer batch-output-v2 for new graphs when you want explicit lines or files modes and built-in parallel batch handling.

use cases

Where batch-output fits

Split a huge list for parallel runs

Carve a million-line target file into fixed ranges and feed each range to its own copy of a scanner so the work runs in parallel.

Throttle a slow downstream tool

Pass one batch at a time into an expensive node to keep a single run inside time or resource limits instead of processing everything at once.

Resume from a known offset

Pick up where a previous run stopped by selecting the next START_LINE,END_LINE range rather than reprocessing the whole list.

Process a folder of inputs in groups

Apply the same range logic to a folder so files are handled in batches when one node should not take the entire set.

reference

batch-output inputs and flags

3 inputs

Name	Type	Flag	Description
file	FILE	·	File from which to extract batches.
batch	STRING	·	START_LINE,END_LINE range to extract from the file or folder input.
folder	FOLDER	·	Folder with files from which to extract batches.

Showing key inputs. batch-output exposes 3 inputs in total.

example

Run batch-output

batch-output · command

# extract lines 1-5000 from a large target list for one parallel workerbatch-output targets.txt 1,5000 > batch-01.txt

sample output

api.example.comapp.example.comstaging.example.comdev.example.commail.example.comvpn.example.com198.51.100.10198.51.100.24203.0.113.5203.0.113.88

guidance

Choosing batch-output

Use batch-output to split a large file or folder into ranges so heavy work fans out across parallel nodes. It slices input; it runs no scanner. Place it ahead of the consumer you want to parallelize. For a newer engine with explicit modes, see batch-output-v2.

batch-output-v2

Newer rewrite with explicit lines and files modes plus parallel batch processing. Prefer it for new workflows.

duplicut

Removes duplicate lines from large lists. Shrinks input rather than slicing it.

prefix-file-lines

Transforms each line rather than selecting a range. Sibling list-manipulation utility.

faq

batch-output questions

Put START_LINE,END_LINE in the batch input, for example 1,5000. batch-output returns only the lines or folder entries inside that inclusive range.

Run batch-output yourself

A large target list feeds batch-output, which slices it into a line range and passes that batch to httpx so probing runs on a manageable chunk.

Open batch-output in the library Build a workflow with it

Facts on this page come from the live Trickest tool library.