cewl.rb

CeWL: Custom Word List Generator

CeWL will spider a target site and generate up to three lists:

• A word list of all unique words found on the target site
• A list of all email addresses found in mailto links
• A list of usernames/author details from meta data found in any documents on the site

Usage

cewl [OPTION] … URL

-h, —help:

   show help

—depth x, -d x:

   depth to spider to, default 2

—min_word_length, -m:

   minimum word length, default 3

—email, -e:

   include any email addresses found duing the spider

—meta, -a:

   include any meta data found during the spider

—no-words, -n

   don't output the wordlist

—offsite, -o:

   let the spider visit other sites

—write, -w file:

   write the words to the file

—ua, -u user-agent:

   useragent to send

—meta-temp-dir directory:

   the temporary directory used by exiftool when parsing files, default /tmp

-v

   verbose

URL: The site to spider.

Required files