loading
Loading content
loading
Utilities
Extract file or folder lines by START_LINE,END_LINE batch range.
overview
batch-output turns a large producer output into even pieces. Give it a file and a START_LINE,END_LINE batch string; it returns only that slice as FILE and FOLDER.
Operators reach for it when one scanner pass over a million-line list will not finish. Pair ranges such as 1,5000 and 5001,10000 with parallel copies of the downstream node.
It slices input only. Prefer batch-output-v2 for new graphs when you want explicit lines or files modes and built-in parallel batch handling.
use cases
Carve a million-line target file into fixed ranges and feed each range to its own copy of a scanner so the work runs in parallel.
Pass one batch at a time into an expensive node to keep a single run inside time or resource limits instead of processing everything at once.
Pick up where a previous run stopped by selecting the next START_LINE,END_LINE range rather than reprocessing the whole list.
Apply the same range logic to a folder so files are handled in batches when one node should not take the entire set.
reference
| Name | Type | Flag | Description |
|---|---|---|---|
| file | FILE | · | File from which to extract batches. |
| batch | STRING | · | START_LINE,END_LINE range to extract from the file or folder input. |
| folder | FOLDER | · | Folder with files from which to extract batches. |
Showing key inputs. batch-output exposes 3 inputs in total.
example
# extract lines 1-5000 from a large target list for one parallel workerbatch-output targets.txt 1,5000 > batch-01.txtapi.example.comapp.example.comstaging.example.comdev.example.commail.example.comvpn.example.com198.51.100.10198.51.100.24203.0.113.5203.0.113.88guidance
Use batch-output to split a large file or folder into ranges so heavy work fans out across parallel nodes. It slices input; it runs no scanner. Place it ahead of the consumer you want to parallelize. For a newer engine with explicit modes, see batch-output-v2.
Newer rewrite with explicit lines and files modes plus parallel batch processing. Prefer it for new workflows.
Removes duplicate lines from large lists. Shrinks input rather than slicing it.
Transforms each line rather than selecting a range. Sibling list-manipulation utility.
faq
related
Spider a URL and return a wordlist for password crackers.
Wordlist and mined-word subdomain permutation.
Import, export, and upsert workflow data against an Airtable base.
Decode Android APK files into smali sources and resources.
Check a file's values against conditions and exit with a matching code.
Authenticated Route53 hosted-zone inventory.
A large target list feeds batch-output, which slices it into a line range and passes that batch to httpx so probing runs on a manageable chunk.
Facts on this page come from the live Trickest tool library.