public interface Protocol extends FieldPluggable, Configurable
Modifier and Type | Field and Description |
---|---|
static String |
CHECK_BLOCKING
Property name.
|
static String |
CHECK_ROBOTS
Property name.
|
static String |
X_POINT_ID
The name of the extension point.
|
Modifier and Type | Method and Description |
---|---|
ProtocolOutput |
getProtocolOutput(String url,
WebPage page) |
crawlercommons.robots.BaseRobotRules |
getRobotRules(String url,
WebPage page)
Retrieve robot rules applicable for this url.
|
getFields
getConf, setConf
static final String X_POINT_ID
static final String CHECK_BLOCKING
static final String CHECK_ROBOTS
ProtocolOutput getProtocolOutput(String url, WebPage page)
Copyright © 2015 The Apache Software Foundation