icon icon icon icon icon icon icon
Recon and Vulnerability Scanner via Trickest and GitHub
back to posts

Recon and Vulnerability Scanner via Trickest and GitHub

automation asm vulnerability scanning cve recon
August 19, 2022
4 mins read
Mohammed Diaa display picture

Mohammed Diaa

Head of Workflows

This blog post will demonstrate how to create a synergy between GitHub Actions and Trickest Platform. You only need to push nuclei templates and root domains to the repository and wait for new results!

Check out the GitHub Template Repository to start immediately, or keep reading to see how you can make or customize this one!

Repository Structure

  • config.yaml - Config file for trickest-cli (Set the repository name initially)
  • domains.txt - List of root domains (tld domains list (example.com))
  • hostnames.txt - List of hostnames found for root domains provided (Updated by the workflow, if updated manually, will be propagated through the entire workflow)
  • servers.txt - List of available servers for found hostnames (Web servers found from hostnames)
  • reports.txt - List of vulnerabilities found for found servers (Vulnerabilities found)
  • blacklist.txt - List of strings to exclude from all results (Blacklist hostnames and servers grep -vFf)
  • templates (folder) - Place where you push nuclei templates (Folders supported)

Setting Up Configuration

1. Trickest Token & GitHub Deploy Key

Set up the TRICKEST_TOKEN variable to the secrets.

Set up a GitHub deploy key with write access to your Bug Bounty Setup repository and add the private SSH key to the SSH_KEY action secret.

GitHub action secrets

2. Config File

Replace REPOSITORY_NAME with your GitHub repository name inside the config.yaml file.

inputs:   
  string-to-file-1.string: REPOSITORY_NAME
  recursively-cat-all-5:
    file:
      - id_rsa
machines:
  large: 1

3. Root Domains

All of the domains will be picked up automatically by the workflow. You will need to push the new root domain names to the domains.txt file.

echo "trickest.com" > domains.txt

4. Nuclei Templates

All of the nuclei templates will be picked up automatically by the workflow. Push the new nuclei templates to the templates folder.

cd templates
wget "https://raw.githubusercontent.com/projectdiscovery/nuclei-templates/master/cves/2022/CVE-2022-35416.yaml"

5. Running the workflow

The workflow is triggered on workflow_dispatch event; feel free to change the trigger the way it suits the best your use case.

Workflow Dispatch Event

<a class="" data-paperform-id="fcyiosu6"  data-popup-button="1"  data-gtm-get-started-early-access-btn="">Get Access</a>

Workflow Building

1. Workflow Repository Setup

Initially, you need to gather the data about the repository:

  • String inputs are colored purple, and you need to connect your repository name and email to the string-to-file (this file will be used as a variable value when cloning the repository inside of get-repo-data)
  • id_rsa is directly uploaded through the client/workflow and is used when cloning the repository

GitHub Repository Data

NOTE: Keep in mind that out/output.txt is reserved for the output file port, so you can cat the content of domains.txt to out/output.txt to be available for Amass and SubFinder.

2. Passive Recon

Now that you have your root domains, you should use SubFinder and Amass to get all of the results from passive sources. Their outputs will be merged through recursively-cat-all-1 with additional sort -n | uniq, which will cat and deduplicate your results.

Passive Recon

3. Active Recon

This part consists of getting all the results from Passive Recon and then:

  • Executing dsieve with the 2:4 flag for subdomain levels to get all of the environments
  • Executing mksub to create a wordlist of potential hostnames
  • Resolving with puredns
  • Executing found brute-forced hostnames permutations with gotator
  • Resolving gotator with puredns

Active Recon

4. Servers and Scan

Finally, you’ve got your hostnames for this run, and now you can pass it to httpx to get all of the web servers. get-repo-data node will provide you with the nuclei templates you already pushed to the repository.

Servers & Scanners

5. Push The Results

Finally, the update node will get the data and push it to the repository.

Integrations are a crucial part of Attack Surface Management, check out our post on how to pick the right one.

Did somebody say diffs?

Commit messages will show what is changed, which means you will have an insight into all the new data (vulnerabilities). How awesome is that!

GitHub Diffs

Conclusion

This is just one example of a synergy between Trickest and GitHub. Get Access today and set up your repository for asset discovery and continuous vulnerability scanning of your infrastructure. It is that easy, right?

Share this post

GET STARTED WITH TRICKEST TODAY

Fill out our early access form to put yourself on the waitlist and stay in the loop.