Class UniqueTokenFilter


  • public final class UniqueTokenFilter
    extends TokenFilter
    Filters out tokens with same text as the previous token. This token filter is implemented using Apache Lucene.
    • Constructor Detail

      • UniqueTokenFilter

        public UniqueTokenFilter​(String name)
        Constructor of UniqueTokenFilter.
        Parameters:
        name - The name of the token filter. It must only contain letters, digits, spaces, dashes or underscores, can only start and end with alphanumeric characters, and is limited to 128 characters.
    • Method Detail

      • isOnlyOnSamePosition

        public Boolean isOnlyOnSamePosition()
        Get the onlyOnSamePosition property: A value indicating whether to remove duplicates only at the same position. Default is false.
        Returns:
        the onlyOnSamePosition value.
      • setOnlyOnSamePosition

        public UniqueTokenFilter setOnlyOnSamePosition​(Boolean onlyOnSamePosition)
        Set the onlyOnSamePosition property: A value indicating whether to remove duplicates only at the same position. Default is false.
        Parameters:
        onlyOnSamePosition - the onlyOnSamePosition value to set.
        Returns:
        the UniqueTokenFilter object itself.