Utilities
Split lines or folder files into START,END batches
Extract a START,END batch from file lines or folder files.
overview
What batch-output-v2 does
batch-output-v2 is the fan-out slicer for large lists and folders. In lines mode it cuts a START,END span from a file; in files mode it cuts a span from a folder's sorted file list.
Operators use it when one serial pass over a huge target set will not finish. Pass --batch as START,END (for example 1,10) and run parallel copies of the downstream scanner on each range.
Omit --mode to auto-pick from the input you supplied (--file or --folder). The managed node writes FILE and FOLDER holding the selected slice for the next consumer.
use cases
Where batch-output-v2 fits
Fan a big list out across parallel nodes
Split a large file into START,END line ranges and feed each to its own copy of a scanner so the run finishes faster than one serial pass.
Batch a folder of inputs
Use files mode to extract a range from a sorted folder so a downstream node processes inputs in groups instead of all at once.
Let the tool pick the mode
Hand it a file or a folder and rely on auto-detection to choose lines or files mode when inputs vary across runs.
Keep heavy runs inside limits
Process one batch at a time through an expensive node to stay within time and resource budgets on very large datasets.
reference
batch-output-v2 inputs and flags
| Name | Type | Flag | Description |
|---|---|---|---|
| file | FILE | --file | Input file for lines mode (extract line range from this file). |
| folder | FOLDER | --folder | Input folder for files mode (extract file range from sorted file list). |
| batch | STRING | --batch | Batch range as START,END (e.g., "1,10" extracts items 1 through 10). |
| mode | STRING | --mode | Processing mode: 'lines' (extract lines from file) or 'files' (extract files from folder). Auto-detects if not specified. |
Showing key inputs. batch-output-v2 exposes 4 inputs in total.
example
Run batch-output-v2
# batch-output-v2: extract lines 1-100 from a host list for a parallel workerbatch-output-v2 --mode lines --file hosts.txt --batch 1,100api.example.comapp.example.comstaging.example.comdev.example.commail.example.comvpn.example.comcdn.example.comwww.example.comguidance
Choosing batch-output-v2
Use batch-output-v2 to split a file or folder into ranges for parallel processing. Prefer it over batch-output for new graphs. It slices input; it runs no scanner. Place it ahead of the consumer you want to fan out.
batch-output
Original line-range slicer. v2 adds explicit modes, folder support, and parallel processing.
duplicut
Deduplicates large lists. Shrinks the input rather than slicing it into batches.
anew
Appends only new lines. Different list utility for tracking novelty across runs.
faq
batch-output-v2 questions
related
More Utilities tools
cewl
Spider a URL and return a wordlist for password crackers.
dnsgen
Wordlist and mined-word subdomain permutation.
pup
CSS selectors over HTML, the jq counterpart for markup.
unfurl
Extract chosen URL parts from stdin into clean line lists.
whisper
Speech to txt, vtt, srt, and json from an audio file or folder.
youtube-transcript
Public caption tracks to transcript.txt and results.jsonl.
Run batch-output-v2 yourself
A large target list feeds batch-output-v2, which extracts a START,END batch and passes it to nuclei so scanning runs on one parallelizable chunk.
Facts on this page come from the live Trickest tool library.