## Uses of Interface
org.apache.nutch.net.URLNormalizer

- Packages that use URLNormalizer
  Package | Description
  --- | ---
  org.apache.nutch.net.urlnormalizer.ajax |
  org.apache.nutch.net.urlnormalizer.basic | URL normalizer performing basic normalizations: remove default ports, e.g., port 80 for `http://` URLs remove needless slashes and dot segments in the path component remove anchors use percent-encoding (only) where needed E.g., `https://www.example.org/a/../b//./select%2Dlang.php?lang=español#anchor`is normalized to `https://www.example.org/b/select-lang.php?lang=espa%C3%B1ol` Optional and configurable normalizations are: convert Internationalized Domain Names (IDNs) uniquely either to the ASCII (Punycode) or Unicode representation, see property `urlnormalizer.basic.host.idn` remove a trailing dot from host names, see property `urlnormalizer.basic.host.trim-trailing-dot```
  org.apache.nutch.net.urlnormalizer.host | URL normalizer renaming hosts to a canonical form listed in the configuration file.
  org.apache.nutch.net.urlnormalizer.pass | URL normalizer dummy which does not change URLs.
  org.apache.nutch.net.urlnormalizer.protocol |
  org.apache.nutch.net.urlnormalizer.querystring | URL normalizer which sort the elements in the query part to avoid duplicates by permutations.
  org.apache.nutch.net.urlnormalizer.regex | URL normalizer with configurable rules based on regular expressions (`Pattern`).
  org.apache.nutch.net.urlnormalizer.slash |

- - ### Uses of URLNormalizer in org.apache.nutch.net.urlnormalizer.ajax

    Classes in org.apache.nutch.net.urlnormalizer.ajax that implement URLNormalizer
    Modifier and Type | Class and Description
    --- | ---
    `class` | `AjaxURLNormalizer` URLNormalizer capable of dealing with AJAX URL's.

  - ### Uses of URLNormalizer in org.apache.nutch.net.urlnormalizer.basic

    Classes in org.apache.nutch.net.urlnormalizer.basic that implement URLNormalizer
    Modifier and Type | Class and Description
    --- | ---
    `class` | `BasicURLNormalizer` Converts URLs to a normal form: remove dot segments in path: `/./` or `/../` remove default ports, e.g.

  - ### Uses of URLNormalizer in org.apache.nutch.net.urlnormalizer.host

    Classes in org.apache.nutch.net.urlnormalizer.host that implement URLNormalizer
    Modifier and Type | Class and Description
    --- | ---
    `class` | `HostURLNormalizer` URL normalizer for mapping hosts to their desired form.

  - ### Uses of URLNormalizer in org.apache.nutch.net.urlnormalizer.pass

    Classes in org.apache.nutch.net.urlnormalizer.pass that implement URLNormalizer
    Modifier and Type | Class and Description
    --- | ---
    `class` | `PassURLNormalizer` This URLNormalizer doesn't change urls.

  - ### Uses of URLNormalizer in org.apache.nutch.net.urlnormalizer.protocol

    Classes in org.apache.nutch.net.urlnormalizer.protocol that implement URLNormalizer
    Modifier and Type | Class and Description
    --- | ---
    `class` | `ProtocolURLNormalizer`

  - ### Uses of URLNormalizer in org.apache.nutch.net.urlnormalizer.querystring

    Classes in org.apache.nutch.net.urlnormalizer.querystring that implement URLNormalizer
    Modifier and Type | Class and Description
    --- | ---
    `class` | `QuerystringURLNormalizer` URL normalizer plugin for normalizing query strings but sorting query string parameters.

  - ### Uses of URLNormalizer in org.apache.nutch.net.urlnormalizer.regex

    Classes in org.apache.nutch.net.urlnormalizer.regex that implement URLNormalizer
    Modifier and Type | Class and Description
    --- | ---
    `class` | `RegexURLNormalizer` Allows users to do regex substitutions on all/any URLs that are encountered, which is useful for stripping session IDs from URLs.

  - ### Uses of URLNormalizer in org.apache.nutch.net.urlnormalizer.slash

    Classes in org.apache.nutch.net.urlnormalizer.slash that implement URLNormalizer
    Modifier and Type | Class and Description
    --- | ---
    `class` | `SlashURLNormalizer`

Copyright © 2021 The Apache Software Foundation