de.l3s.boilerpipe.filters.english.NumWordsRulesClassifier

All Implemented Interfaces:: BoilerpipeFilter

public class NumWordsRulesClassifier extends Object implements BoilerpipeFilter

Classifies TextBlocks as content/not-content through rules that have been determined using the C4.8 machine learning algorithm, as described in the paper "Boilerplate Detection using Shallow Text Features" (WSDM 2010), particularly using number of words per block and link density per block.

Author:: Christian Kohlschütter

Field Summary

Fields

Modifier and Type

Field

Description

static final NumWordsRulesClassifier

INSTANCE
Constructor Summary

Constructors

Constructor

Description

NumWordsRulesClassifier()
Method Summary

Modifier and Type

Method

Description

protected boolean

classify(TextBlock prev, TextBlock curr, TextBlock next)

static NumWordsRulesClassifier

getInstance()

Returns the singleton instance for RulebasedBoilerpipeClassifier.

boolean

process(TextDocument doc)

Processes the given document doc.

Methods inherited from class java.lang.Object
clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Field Details
- INSTANCE
  
  public static final NumWordsRulesClassifier INSTANCE
Constructor Details
- NumWordsRulesClassifier
  
  public NumWordsRulesClassifier()
Method Details
- getInstance
  
  public static NumWordsRulesClassifier getInstance()
  
  Returns the singleton instance for RulebasedBoilerpipeClassifier.
- process
  
  public boolean process(TextDocument doc) throws BoilerpipeProcessingException
  
  Description copied from interface: BoilerpipeFilter
  
  Processes the given document doc.
  
  Specified by:
  
  process in interface BoilerpipeFilter
  
  Parameters:
  
  doc - The TextDocument that is to be processed.
  
  Returns:
  
  true if changes have been made to the TextDocument.
  
  Throws:
  
  BoilerpipeProcessingException
- classify
  
  protected boolean classify(TextBlock prev, TextBlock curr, TextBlock next)

Class NumWordsRulesClassifier

Field Summary

Constructor Summary

Method Summary

Methods inherited from class java.lang.Object

Field Details

INSTANCE

Constructor Details

NumWordsRulesClassifier

Method Details

getInstance

process

classify