developing on github. (require - Zend Framework 2 & PHP 5.3)

Scraper

web-sraping component, inspired by Perl’s Web::Scraper. It provides a DSL-ish interface for traversing HTML documents and returning a neatly arranged PHP ‘s multidimensional array …

 

Http\Charset

UTF-8, when we are dealing with the HTTP response, you often hope that is so.This component is offered that convert encoding automatically from header’s charset …

 

Service\Wedata

Wedata is social database used by AutoPagerize, LDRFullFeed and other user-scrips. Diggin_Service_Wedata Component offers handling Wedata API.

 

RobotRules

Objective of this component is to provide a check on the allow of the crawler by Robots exclusion standard (robots.txt and other rules)