Installation Guide for CLI & Desktop App

CLI Installation

  • Install Script (Recommended)
  • Custom Install Directory
curl -fsSL https://install.crawler.sh | sh

Downloads the correct binary for your platform (macOS ARM64 or x64) and installs it to ~/.crawler/bin/. The script automatically adds this directory to your PATH in your shell config files (.zshrc, .bashrc, etc.).

Restart your shell or run:

export PATH="\$HOME/.crawler/bin:\$PATH"

CRAWLER_INSTALL_DIR=/opt/crawler curl -fsSL https://install.crawler.sh | sh

Set CRAWLER_INSTALL_DIR to install to a custom location instead of ~/.crawler.

Verify installation

crawler --help

You should see the available subcommands: crawl, info, export, and seo.

CLI Uninstall

  1. Remove the binary and install directory

rm -rf ~/.crawler

If you used a custom install directory, remove that instead.

  1. Clean up PATH entries

Remove the # crawler.sh block from your shell config files:

  • ~/.zshrc
    • ~/.bashrc
    • ~/.bash_profile
    • ~/.profile
    • ~/.config/fish/config.fish (if using fish)

Each file will have a block like:

# crawler.sh

export PATH="\$HOME/.crawler/bin:\$PATH"

Delete those lines, then restart your shell.

Desktop App

Download the macOS desktop app (universal binary for ARM64 + Intel):

To uninstall, drag Crawler from your Applications folder to the Trash.

System Requirements

  • macOS - Apple Silicon (M1/M2/M3/M4) or Intel

Next Steps