org.apache.nutch.indexer.feed

## Class FeedIndexingFilter

- java.lang.Object
- - org.apache.nutch.indexer.feed.FeedIndexingFilter

- All Implemented Interfaces:
    Configurable, IndexingFilter, Pluggable

      public class FeedIndexingFilter
      extends java.lang.Object
      implements IndexingFilter

  Since:
    NUTCH-444 An `IndexingFilter` implementation to pull out the relevant extracted `Metadata` fields from the RSS feeds and into the index.
  Author:
    dogacan, mattmann

- - ### Field Summary

    Fields
    Modifier and Type | Field and Description
    --- | ---
    `static java.lang.String` | `dateFormatStr`

    - ### Fields inherited from interface org.apache.nutch.indexer.IndexingFilter

      `X_POINT_ID`

  - ### Constructor Summary

    Constructors
    Constructor and Description
    `FeedIndexingFilter()`

  - ### Method Summary

    All Methods Instance Methods Concrete Methods
    Modifier and Type | Method and Description
    --- | ---
    `NutchDocument` | `filter(NutchDocument doc, Parse parse, Text url, CrawlDatum datum, Inlinks inlinks)` Extracts out the relevant fields: FEED_AUTHOR FEED_TAGS FEED_PUBLISHED FEED_UPDATED FEED And sends them to the `Indexer` for indexing within the Nutch index.
    `Configuration` | `getConf()`
    `void` | `setConf(Configuration conf)` Sets the `Configuration` object used to configure this `IndexingFilter`.

    - ### Methods inherited from class java.lang.Object

      `clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait`

- - ### Field Detail

    - #### dateFormatStr

          public static final java.lang.String dateFormatStr

      See Also:
        Constant Field Values

  - ### Constructor Detail

    - #### FeedIndexingFilter

          public FeedIndexingFilter()

  - ### Method Detail

    - #### filter

          public NutchDocument filter(NutchDocument doc,
                                      Parse parse,
                                      Text url,
                                      CrawlDatum datum,
                                      Inlinks inlinks)
                               throws IndexingException

      Extracts out the relevant fields:
      - FEED_AUTHOR
      - FEED_TAGS
      - FEED_PUBLISHED
      - FEED_UPDATED
      - FEED
      And sends them to the `Indexer` for indexing within the Nutch index.
      Specified by:
        `filter` in interface `IndexingFilter`
      Parameters:
        `doc` - document instance for collecting fields
        `parse` - parse data instance
        `url` - page url
        `datum` - crawl datum for the page (fetch datum from segment containing fetch status and fetch time)
        `inlinks` - page inlinks
      Returns:
        modified (or a new) document instance, or null (meaning the document should be discarded)
      Throws:
        `IndexingException`

    - #### getConf

          public Configuration getConf()

      Specified by:
        `getConf` in interface `Configurable`
      Returns:
        the `Configuration` object used to configure this `IndexingFilter`.

    - #### setConf

          public void setConf(Configuration conf)

      Sets the `Configuration` object used to configure this `IndexingFilter`.
      Specified by:
        `setConf` in interface `Configurable`
      Parameters:
        `conf` - The `Configuration` object used to configure this `IndexingFilter`.

Copyright © 2019 The Apache Software Foundation