public class Http extends HttpBase
| Modifier and Type | Field and Description |
|---|---|
protected static org.slf4j.Logger |
LOG |
accept, acceptCharset, acceptLanguage, BUFFER_SIZE, COOKIE, enableCookieHeader, enableIfModifiedsinceHeader, maxContent, maxCrawlDelay, maxDuration, partialAsTruncated, proxyException, proxyHost, proxyPort, proxyType, RESPONSE_TIME, responseTime, storeHttpHeaders, storeHttpRequest, storeIPAddress, timeout, tlsCheckCertificate, tlsPreferredCipherSuites, tlsPreferredProtocols, useHttp11, useHttp2, useProxy, userAgentX_POINT_ID| Constructor and Description |
|---|
Http() |
| Modifier and Type | Method and Description |
|---|---|
protected Response |
getResponse(java.net.URL url,
CrawlDatum datum,
boolean redirect) |
static void |
main(java.lang.String[] args) |
void |
setConf(Configuration conf) |
getAccept, getAcceptCharset, getAcceptLanguage, getConf, getCookie, getMaxContent, getMaxDuration, getProtocolOutput, getProxyHost, getProxyPort, getRobotRules, getTimeout, getTlsPreferredCipherSuites, getTlsPreferredProtocols, getUseHttp11, getUserAgent, isCookieEnabled, isIfModifiedSinceEnabled, isStoreHttpHeaders, isStoreHttpRequest, isStoreIPAddress, isStorePartialAsTruncated, isTlsCheckCertificates, logConf, main, processDeflateEncoded, processGzipEncoded, useProxy, useProxy, useProxypublic void setConf(Configuration conf)
setConf in interface ConfigurablesetConf in class HttpBasepublic static void main(java.lang.String[] args)
throws java.lang.Exception
java.lang.Exceptionprotected Response getResponse(java.net.URL url, CrawlDatum datum, boolean redirect) throws ProtocolException, java.io.IOException
getResponse in class HttpBaseProtocolExceptionjava.io.IOExceptionCopyright © 2019 The Apache Software Foundation