Class ASCIIFoldingFilter

    • Constructor Detail

      • ASCIIFoldingFilter

        public ASCIIFoldingFilter​(TokenStream input)
      • ASCIIFoldingFilter

        public ASCIIFoldingFilter​(TokenStream input,
                                  boolean preserveOriginal)
        Create a new ASCIIFoldingFilter.
        Parameters:
        input - TokenStream to filter
        preserveOriginal - should the original tokens be kept on the input stream with a 0 position increment from the folded tokens?
    • Method Detail

      • isPreserveOriginal

        public boolean isPreserveOriginal()
        Does the filter preserve the original tokens?
      • foldToASCII

        public void foldToASCII​(char[] input,
                                int length)
        Converts characters above ASCII to their ASCII equivalents. For example, accents are removed from accented characters.
        Parameters:
        input - The string to fold
        length - The number of characters in the input string
      • foldToASCII

        public static final int foldToASCII​(char[] input,
                                            int inputPos,
                                            char[] output,
                                            int outputPos,
                                            int length)
        Converts characters above ASCII to their ASCII equivalents. For example, accents are removed from accented characters.
        Parameters:
        input - The characters to fold
        inputPos - Index of the first character to fold
        output - The result of the folding. Should be of size >= length * 4.
        outputPos - Index of output where to put the result of the folding
        length - The number of characters to fold
        Returns:
        length of output
        NOTE: This API is for internal purposes only and might change in incompatible ways in the next release.