Package de.l3s.boilerpipe.filters.heuristics
package de.l3s.boilerpipe.filters.heuristics
The BoilerpipeFilters in this package are pure heuristics.
-
ClassesClassDescriptionAdds the labels of the preceding block to the current block, optionally adding a prefix.Fuses adjacent blocks if their distance (in blocks) does not exceed a certain limit.Marks
TextBlocks which contain parts of the HTML<TITLE>tag, using some heuristics which are quite specific to the news domain.Marks allTextBlocks "content" which are between the headline and the part that has already been marked content, if they are markedDefaultLabels.MIGHT_BE_CONTENT.Keeps the largestTextBlockonly (by the number of words).Fuses adjacent blocks if their labels are equal.Merges two subsequent blocks if their text densities are equal.