Class PatternTokenizer

Tokenizer that uses regex pattern matching to construct distinct tokens. This tokenizer is implemented using Apache Lucene.

Inheritance

System.Object

LexicalTokenizer

PatternTokenizer

Inherited Members

LexicalTokenizer.Name

Namespace: System.Dynamic.ExpandoObject

Assembly: Azure.Search.Documents.dll

Syntax

public class PatternTokenizer : Azure.Search.Documents.Indexes.Models.LexicalTokenizer

Constructors

PatternTokenizer(String)

Initializes a new instance of PatternTokenizer.

Declaration

public PatternTokenizer (string name);

Parameters

System.String name The name of the tokenizer. It must only contain letters, digits, spaces, dashes or underscores, can only start and end with alphanumeric characters, and is limited to 128 characters.

Exceptions

System.ArgumentNullException name is null.

Properties

Flags

Regular expression flags for Pattern.

Declaration

public System.Collections.Generic.IList<Azure.Search.Documents.Indexes.Models.RegexFlag> Flags { get; }

Property Value

System.Collections.Generic.IList<RegexFlag>

Group

The zero-based ordinal of the matching group in the regular expression pattern to extract into tokens. Use -1 if you want to use the entire pattern to split the input into tokens, irrespective of matching groups. Default is -1.

Declaration

public Nullable<int> Group { get; set; }

Property Value

System.Nullable<System.Int32>

Pattern

A regular expression pattern to match token separators. Default is an expression that matches one or more non-word characters.

Declaration

public string Pattern { get; set; }

Property Value

System.String