May 2011 Archives

Scrappy - The All Powerful Web Spidering, Scraping, Creeping Crawling Framework

Hello all, it has been a long while since I’ve blogged here partly due to the fact that my account was mysteriously disabled and I have only recently had it rectified.

Anyways, it has truly been an arduous journey learning Moose while re-writing Scrappy, The All Powerful Web Spidering, Scraping, Creeping Crawling Framework, but it has proven both exciting and rewarding.

About Al Newkirk

user-pic ... proud Perl hacker, ask me anything!