## Uses of Class
org.apache.nutch.parse.ParseData

- Packages that use ParseData
  Package | Description
  --- | ---
  org.apache.nutch.crawl | Crawl control code and tools to run the crawler.
  org.apache.nutch.parse | The `Parse` interface and related classes.
  org.apache.nutch.scoring | The `ScoringFilter` interface.
  org.apache.nutch.scoring.depth | Scoring filter to stop crawling at a configurable depth (number of "hops" from seed URLs).
  org.apache.nutch.scoring.link | Scoring filter used in conjunction with `WebGraph`.
  org.apache.nutch.scoring.opic | Scoring filter implementing a variant of the Online Page Importance Computation (OPIC) algorithm.
  org.apache.nutch.scoring.similarity |
  org.apache.nutch.scoring.similarity.cosine | Implements the cosine similarity metric for scoring relevant documents
  org.apache.nutch.scoring.tld | Top Level Domain Scoring plugin.
  org.apache.nutch.scoring.urlmeta | URL Meta Tag Scoring Plugin
  org.apache.nutch.segment | A segment stores all data from on generate/fetch/update cycle: fetch list, protocol status, raw content, parsed content, and extracted outgoing links.
  org.apache.nutch.tools | Miscellaneous tools.

- - ### Uses of ParseData in org.apache.nutch.crawl

    Methods in org.apache.nutch.crawl with parameters of type ParseData
    Modifier and Type | Method and Description
    --- | ---
    `void` | LinkDb.LinkDbMapper.`map(Text key, ParseData parseData, Mapper.Context context)`

  - ### Uses of ParseData in org.apache.nutch.parse

    Methods in org.apache.nutch.parse that return ParseData
    Modifier and Type | Method and Description
    --- | ---
    `ParseData` | Parse.`getData()` Other data extracted from the page.
    `ParseData` | ParseImpl.`getData()`
    `static ParseData` | ParseData.`read(DataInput in)`

    Methods in org.apache.nutch.parse with parameters of type ParseData
    Modifier and Type | Method and Description
    --- | ---
    `void` | ParseResult.`put(String key, ParseText text, ParseData data)` Store a result of parsing.
    `void` | ParseResult.`put(Text key, ParseText text, ParseData data)` Store a result of parsing.

    Constructors in org.apache.nutch.parse with parameters of type ParseData
    Constructor and Description
    `ParseImpl(ParseText text, ParseData data)`
    `ParseImpl(ParseText text, ParseData data, boolean isCanonical)`
    `ParseImpl(String text, ParseData data)`

  - ### Uses of ParseData in org.apache.nutch.scoring

    Methods in org.apache.nutch.scoring with parameters of type ParseData
    Modifier and Type | Method and Description
    --- | ---
    `CrawlDatum` | ScoringFilter.`distributeScoreToOutlinks(Text fromUrl, ParseData parseData, Collection<Map.Entry<Text,CrawlDatum>> targets, CrawlDatum adjust, int allCount)` Distribute score value from the current page to all its outlinked pages.
    `CrawlDatum` | ScoringFilters.`distributeScoreToOutlinks(Text fromUrl, ParseData parseData, Collection<Map.Entry<Text,CrawlDatum>> targets, CrawlDatum adjust, int allCount)`
    `CrawlDatum` | AbstractScoringFilter.`distributeScoreToOutlinks(Text fromUrl, ParseData parseData, Collection<Map.Entry<Text,CrawlDatum>> targets, CrawlDatum adjust, int allCount)`

  - ### Uses of ParseData in org.apache.nutch.scoring.depth

    Methods in org.apache.nutch.scoring.depth with parameters of type ParseData
    Modifier and Type | Method and Description
    --- | ---
    `CrawlDatum` | DepthScoringFilter.`distributeScoreToOutlinks(Text fromUrl, ParseData parseData, Collection<Map.Entry<Text,CrawlDatum>> targets, CrawlDatum adjust, int allCount)`

  - ### Uses of ParseData in org.apache.nutch.scoring.link

    Methods in org.apache.nutch.scoring.link with parameters of type ParseData
    Modifier and Type | Method and Description
    --- | ---
    `CrawlDatum` | LinkAnalysisScoringFilter.`distributeScoreToOutlinks(Text fromUrl, ParseData parseData, Collection<Map.Entry<Text,CrawlDatum>> targets, CrawlDatum adjust, int allCount)`

  - ### Uses of ParseData in org.apache.nutch.scoring.opic

    Methods in org.apache.nutch.scoring.opic with parameters of type ParseData
    Modifier and Type | Method and Description
    --- | ---
    `CrawlDatum` | OPICScoringFilter.`distributeScoreToOutlinks(Text fromUrl, ParseData parseData, Collection<Map.Entry<Text,CrawlDatum>> targets, CrawlDatum adjust, int allCount)` Get a float value from Fetcher.SCORE_KEY, divide it by the number of outlinks and apply.

  - ### Uses of ParseData in org.apache.nutch.scoring.similarity

    Methods in org.apache.nutch.scoring.similarity with parameters of type ParseData
    Modifier and Type | Method and Description
    --- | ---
    `CrawlDatum` | SimilarityScoringFilter.`distributeScoreToOutlinks(Text fromUrl, ParseData parseData, Collection<Map.Entry<Text,CrawlDatum>> targets, CrawlDatum adjust, int allCount)`
    `CrawlDatum` | SimilarityModel.`distributeScoreToOutlinks(Text fromUrl, ParseData parseData, Collection<Map.Entry<Text,CrawlDatum>> targets, CrawlDatum adjust, int allCount)`

  - ### Uses of ParseData in org.apache.nutch.scoring.similarity.cosine

    Methods in org.apache.nutch.scoring.similarity.cosine with parameters of type ParseData
    Modifier and Type | Method and Description
    --- | ---
    `CrawlDatum` | CosineSimilarity.`distributeScoreToOutlinks(Text fromUrl, ParseData parseData, Collection<Map.Entry<Text,CrawlDatum>> targets, CrawlDatum adjust, int allCount)`

  - ### Uses of ParseData in org.apache.nutch.scoring.tld

    Methods in org.apache.nutch.scoring.tld with parameters of type ParseData
    Modifier and Type | Method and Description
    --- | ---
    `CrawlDatum` | TLDScoringFilter.`distributeScoreToOutlink(Text fromUrl, Text toUrl, ParseData parseData, CrawlDatum target, CrawlDatum adjust, int allCount, int validCount)`
    `CrawlDatum` | TLDScoringFilter.`distributeScoreToOutlinks(Text fromUrl, ParseData parseData, Collection<Map.Entry<Text,CrawlDatum>> targets, CrawlDatum adjust, int allCount)`

  - ### Uses of ParseData in org.apache.nutch.scoring.urlmeta

    Methods in org.apache.nutch.scoring.urlmeta with parameters of type ParseData
    Modifier and Type | Method and Description
    --- | ---
    `CrawlDatum` | URLMetaScoringFilter.`distributeScoreToOutlinks(Text fromUrl, ParseData parseData, Collection<Map.Entry<Text,CrawlDatum>> targets, CrawlDatum adjust, int allCount)` This will take the metatags that you have listed in your "urlmeta.tags" property, and looks for them inside the parseData object.

  - ### Uses of ParseData in org.apache.nutch.segment

    Methods in org.apache.nutch.segment with parameters of type ParseData
    Modifier and Type | Method and Description
    --- | ---
    `boolean` | SegmentMergeFilters.`filter(Text key, CrawlDatum generateData, CrawlDatum fetchData, CrawlDatum sigData, Content content, ParseData parseData, ParseText parseText, Collection<CrawlDatum> linked)` Iterates over all `SegmentMergeFilter` extensions and if any of them returns false, it will return false as well.
    `boolean` | SegmentMergeFilter.`filter(Text key, CrawlDatum generateData, CrawlDatum fetchData, CrawlDatum sigData, Content content, ParseData parseData, ParseText parseText, Collection<CrawlDatum> linked)` The filtering method which gets all information being merged for a given key (URL).

  - ### Uses of ParseData in org.apache.nutch.tools

    Methods in org.apache.nutch.tools with parameters of type ParseData
    Modifier and Type | Method and Description
    --- | ---
    `String` | CommonCrawlFormat.`getJsonData(String url, Content content, Metadata metadata, ParseData parseData)` Returns a string representation of the JSON structure of the URL content takes into account the parsed metadata about the URL
    `String` | AbstractCommonCrawlFormat.`getJsonData(String url, Content content, Metadata metadata, ParseData parseData)`
    `String` | CommonCrawlFormatWARC.`getJsonData(String url, Content content, Metadata metadata, ParseData parseData)`

    Constructors in org.apache.nutch.tools with parameters of type ParseData
    Constructor and Description
    `CommonCrawlFormatWARC(String url, Content content, Metadata metadata, Configuration nutchConf, CommonCrawlConfig config, ParseData parseData)`

Copyright © 2021 The Apache Software Foundation