Class MySpider
In: cewl.rb
Parent: Spider
TreeNode Tree MySpider MySpiderInstance dot/f_0.png

Doing this so I can override the allowed? fuction which normally checks the robots.txt file

Methods

start_at  

Public Class methods

Create an instance of MySpiderInstance rather than SpiderInstance

[Validate]