Uses of Interface
de.l3s.boilerpipe.BoilerpipeFilter
Packages that use BoilerpipeFilter
Package
Description
The Boilerpipe top-level package.
This package contains some standard extractors (i.e., completely piped BoilerpipeFilters)
The BoilerpipeFilters in this package have only been tested on English text.
The BoilerpipeFilters in this package are pure heuristics.
The BoilerpipeFilters in this package are straight-forward and probably not really specific to English.
-
Uses of BoilerpipeFilter in de.l3s.boilerpipe
Subinterfaces of BoilerpipeFilter in de.l3s.boilerpipeModifier and TypeInterfaceDescriptioninterfaceDescribes a complete filter pipeline. -
Uses of BoilerpipeFilter in de.l3s.boilerpipe.extractors
Classes in de.l3s.boilerpipe.extractors that implement BoilerpipeFilterModifier and TypeClassDescriptionfinal classA full-text extractor which is tuned towards news articles.final classA full-text extractor which is tuned towards extracting sentences from news articles.classclassA quite generic full-text extractor.classThe base class of Extractors.final classMarks everything as content.final classA full-text extractor which extracts the largest text component of a page.final classA full-text extractor which extracts the largest text component of a page.classA quite generic full-text extractor solely based upon the number of words per block (the current, the previous and the next block).Fields in de.l3s.boilerpipe.extractors declared as BoilerpipeFilterModifier and TypeFieldDescriptionstatic final BoilerpipeFilterCanolaExtractor.CLASSIFIERThe actual classifier, exposed. -
Uses of BoilerpipeFilter in de.l3s.boilerpipe.filters.english
Classes in de.l3s.boilerpipe.filters.english that implement BoilerpipeFilterModifier and TypeClassDescriptionclassClassifiesTextBlocks as content/not-content through rules that have been determined using the C4.8 machine learning algorithm, as described in the paper "Boilerplate Detection using Shallow Text Features", particularly using text densities and link densities.final classMarks all blocks as "non-content" that occur after blocks that have been markedDefaultLabels.INDICATES_END_OF_TEXT.final classMarks all blocks as "non-content" that occur after blocks that have been markedDefaultLabels.INDICATES_END_OF_TEXT, and after any content block.final classKeeps the largestTextBlockonly (by the number of words).final classKeeps only those content blocks which contain at least k full-text words (measured byHeuristicFilterBase.getNumFullTextWords(TextBlock)).classClassifiesTextBlocks as content/not-content through rules that have been determined using the C4.8 machine learning algorithm, as described in the paper "Boilerplate Detection using Shallow Text Features" (WSDM 2010), particularly using number of words per block and link density per block.classFinds blocks which are potentially indicating the end of an article text and marks them withDefaultLabels.INDICATES_END_OF_TEXT. -
Uses of BoilerpipeFilter in de.l3s.boilerpipe.filters.heuristics
Classes in de.l3s.boilerpipe.filters.heuristics that implement BoilerpipeFilterModifier and TypeClassDescriptionfinal classAdds the labels of the preceding block to the current block, optionally adding a prefix.classfinal classFuses adjacent blocks if their distance (in blocks) does not exceed a certain limit.final classfinal classMarksTextBlocks which contain parts of the HTML<TITLE>tag, using some heuristics which are quite specific to the news domain.final classMarks allTextBlocks "content" which are between the headline and the part that has already been marked content, if they are markedDefaultLabels.MIGHT_BE_CONTENT.final classKeeps the largestTextBlockonly (by the number of words).final classFuses adjacent blocks if their labels are equal.classMerges two subsequent blocks if their text densities are equal. -
Uses of BoilerpipeFilter in de.l3s.boilerpipe.filters.simple
Classes in de.l3s.boilerpipe.filters.simple that implement BoilerpipeFilterModifier and TypeClassDescriptionfinal classRemovesTextBlocks which have explicitly been marked as "not content".final classReverts the "isContent" flag for allTextBlocksfinal classMarks all blocks that contain a given label as "boilerplate".final classMarks all blocks that contain a given label as "content".final classMarks all blocks as content.final classKeeps only blocks that have at least one segment fragment ("clause") with at least k words (default: 5).final classKeeps only those content blocks which contain at least k words.final classSplits TextBlocks at paragraph boundaries.class