katana
A next-generation crawling and spidering framework.
Name:katana
Category:Discovery
Publisher:trickest-mhmdiaa
Created:11/7/2022
Container:
quay.io/trickest/katana:v1.1.1-patch-2Output Type:
License:Unknown
Source:View Source
Parameters
-utarget url-listtarget url list-debugdisplay debug output-delayrequest delay between each request in seconds-depthmaximum depth to crawl (default 3)-fieldfield to display in output (url,path,fqdn,rdn,rurl,qurl,qpath,file,ufile,key,value,kv,dir,udir)-jsonlwrite output in JSONL(ines) format-proxyhttp/socks5 proxy to use-retrynumber of times to retry the request (default 1)-configpath to the katana configuration file-resumeresume scan using resume.cfg-silentdisplay output only-excludeexclude host matching specified filter ('cdn', 'private-ips', cidr, ip, regex)-headerscustom header/cookie to include in request-jsluiceenable jsluice parsing in javascript file (memory intensive)-timeouttime to wait for request in seconds (default 10)-verbosedisplay verbose output-headlessenable headless hybrid crawling (experimental)-js-crawlenable endpoint parsing / crawling in javascript file-no-scopedisables host based default scope-omit-rawomit raw requests/responses from jsonl output-strategyVisit strategy (depth-first, breadth-first) (default depth-first)-omit-bodyomit response body from jsonl output-resolverslist of custom resolver (file or comma separated)-no-sandboxstart headless chrome in --no-sandbox mode-rate-limitmaximum requests to send per second (default 150)-concurrencynumber of concurrent fetchers to use (default 10)-crawl-scopein scope url regex to be followed by crawler-field-scopepre-defined scope field (dn,rdn,fqdn) or custom regex (e.g., '(company-staging.io|company.com)') (default rdn)-form-configpath to custom form configuration file-known-filesenable crawling of known files (all,robotstxt,sitemapxml)-match-regexregex to match on output url-parallelismnumber of concurrent inputs to process (default 10)-store-fieldfield to store in per-host output (url,path,fqdn,rdn,rurl,qurl,qpath,file,ufile,key,value,kv,dir,udir)-field-configpath to custom field configuration file-filter-regexregex to filter on output url-headerscustom header/cookie to include in request-health-checkrun diagnostic check up-no-incognitostart headless chrome without incognito mode-crawl-durationmaximum duration to crawl the target for (s, m, h, d) (default s)-xhr-extractionextract xhr request url,method in jsonl output-chrome-data-dirpath to store chrome browser data-crawl-out-scopeout of scope url regex to be excluded by crawler-extension-matchmatch output for given extension (eg, -em php,html,js)-form-extractionextract form, input, textarea & select elements in jsonl output-match-conditionmatch response with dsl based condition-tls-impersonateenable experimental client hello (ja3) tls randomization-crawl-scopein scope url regex to be followed by crawler-extension-filterfilter output for given extension (eg, -ef png,css)-filter-conditionfilter response with dsl based condition-headless-optionsstart headless chrome with additional options-match-regexlist of regex to match on output url-disable-redirectsdisable following redirects (default false)-display-out-scopedisplay external endpoint from scoped crawling-filter-regexlist of regex to filter on output url-max-response-sizemaximum response size to read (default 9223372036854775807)-rate-limit-minutemaximum number of requests to send per minute-automatic-form-fillenable automatic form filling (experimental)-ignore-query-paramsIgnore crawling same path with different query-param values-crawl-out-scopeout of scope url regex to be excluded by crawler