org.apache.nutch.parse

## Class ParserChecker

- java.lang.Object
- - org.apache.nutch.parse.ParserChecker

- All Implemented Interfaces:
    Configurable, Tool

      public class ParserChecker
      extends java.lang.Object
      implements Tool

  Parser checker, useful for testing parser. It also accurately reports possible fetching and parsing failures and presents protocol status signals to aid debugging. The tool enables us to retrieve the following data from any url:
  1. `contentType`: The URL `Content` type.
  2. `signature`: Digest is used to identify pages (like unique ID) and is used to remove duplicates during the dedup procedure. It is calculated using `MD5Signature` or `TextProfileSignature`.
  3. `Version`: From org.apache.nutch.parse.ParseData.
  4. `Status`: From org.apache.nutch.parse.ParseData.
  5. `Title`: of the URL
  6. `Outlinks`: associated with the URL
  7. `Content Metadata`: such as X-AspNet-Version, Date, Content-length, servedBy, Content-Type, Cache-Control, etc.
  8. `Parse Metadata`: such as CharEncodingForConversion, OriginalCharEncoding, language, etc.
  9. `ParseText`: The page parse text which varies in length depdnecing on `content.length` configuration.
  Author:
    John Xing

- - ### Constructor Summary

    Constructors
    Constructor and Description
    `ParserChecker()`

  - ### Method Summary

    All Methods Static Methods Instance Methods Concrete Methods
    Modifier and Type | Method and Description
    --- | ---
    `Configuration` | `getConf()`
    `static void` | `main(java.lang.String[] args)`
    `int` | `run(java.lang.String[] args)`
    `void` | `setConf(Configuration c)`

    - ### Methods inherited from class java.lang.Object

      `clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait`

- - ### Constructor Detail

    - #### ParserChecker

          public ParserChecker()

  - ### Method Detail

    - #### run

          public int run(java.lang.String[] args)
                  throws java.lang.Exception

      Specified by:
        `run` in interface `Tool`
      Throws:
        `java.lang.Exception`

    - #### getConf

          public Configuration getConf()

      Specified by:
        `getConf` in interface `Configurable`

    - #### setConf

          public void setConf(Configuration c)

      Specified by:
        `setConf` in interface `Configurable`

    - #### main

          public static void main(java.lang.String[] args)
                           throws java.lang.Exception

      Throws:
        `java.lang.Exception`

Copyright © 2019 The Apache Software Foundation