org.apache.nutch.indexer.links

## Class LinksIndexingFilter

- java.lang.Object
- - org.apache.nutch.indexer.links.LinksIndexingFilter

- All Implemented Interfaces:
    Configurable, IndexingFilter, Pluggable

      public class LinksIndexingFilter
      extends Object
      implements IndexingFilter

  An `IndexingFilter` that adds `outlinks` and `inlinks` field(s) to the document. In case that you want to ignore the outlinks that point to the same host as the URL being indexed use the following settings in your configuration file: <property> <name>index.links.outlinks.host.ignore</name> <value>true</value> </property> The same configuration is available for inlinks: <property> <name>index.links.inlinks.host.ignore</name> <value>true</value> </property> To store only the host portion of each inlink URL or outlink URL add the following to your configuration file. <property> <name>index.links.hosts.only</name> <value>false</value> </property>

- - ### Field Summary

    Fields
    Modifier and Type | Field and Description
    --- | ---
    `static String` | `LINKS_INLINKS_HOST`
    `static String` | `LINKS_ONLY_HOSTS`
    `static String` | `LINKS_OUTLINKS_HOST`

    - ### Fields inherited from interface org.apache.nutch.indexer.IndexingFilter

      `X_POINT_ID`

  - ### Constructor Summary

    Constructors
    Constructor and Description
    `LinksIndexingFilter()`

  - ### Method Summary

    All Methods Instance Methods Concrete Methods
    Modifier and Type | Method and Description
    --- | ---
    `NutchDocument` | `filter(NutchDocument doc, Parse parse, Text url, CrawlDatum datum, Inlinks inlinks)` Adds fields or otherwise modifies the document that will be indexed for a parse.
    `Configuration` | `getConf()`
    `void` | `setConf(Configuration conf)`

    - ### Methods inherited from class java.lang.Object

      `clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait`

- - ### Field Detail

    - #### LINKS_OUTLINKS_HOST

          public static final String LINKS_OUTLINKS_HOST

      See Also:
        Constant Field Values

    - #### LINKS_INLINKS_HOST

          public static final String LINKS_INLINKS_HOST

      See Also:
        Constant Field Values

    - #### LINKS_ONLY_HOSTS

          public static final String LINKS_ONLY_HOSTS

      See Also:
        Constant Field Values

  - ### Constructor Detail

    - #### LinksIndexingFilter

          public LinksIndexingFilter()

  - ### Method Detail

    - #### filter

          public NutchDocument filter(NutchDocument doc,
                                      Parse parse,
                                      Text url,
                                      CrawlDatum datum,
                                      Inlinks inlinks)
                               throws IndexingException

      Description copied from interface: `IndexingFilter`
      Adds fields or otherwise modifies the document that will be indexed for a parse. Unwanted documents can be removed from indexing by returning a null value.
      Specified by:
        `filter` in interface `IndexingFilter`
      Parameters:
        `doc` - document instance for collecting fields
        `parse` - parse data instance
        `url` - page url
        `datum` - crawl datum for the page (fetch datum from segment containing fetch status and fetch time)
        `inlinks` - page inlinks
      Returns:
        modified (or a new) document instance, or null (meaning the document should be discarded)
      Throws:
        `IndexingException`

    - #### setConf

          public void setConf(Configuration conf)

      Specified by:
        `setConf` in interface `Configurable`

    - #### getConf

          public Configuration getConf()

      Specified by:
        `getConf` in interface `Configurable`

Copyright © 2021 The Apache Software Foundation