Search for tokenize
- Search 9.5.x for tokenize
- Search 8.9.x for tokenize
- Search 10.3.x for tokenize
- Search 11.x for tokenize
- Search main for tokenize
- Other projects
| Title | Object type | File name | Summary |
|---|---|---|---|
| SearchTokenizerTestCase | class | modules/ |
Test the CJK tokenizer. |
| SearchTokenizerTestCase::code2utf | function | modules/ |
Like PHP chr() function, but for unicode characters. |
| SearchTokenizerTestCase::getInfo | function | modules/ |
|
| SearchTokenizerTestCase::setUp | function | modules/ |
Sets up a Drupal site for running functional and integration tests. |
| SearchTokenizerTestCase::testNoTokenizer | function | modules/ |
Verifies that strings of non-CJK characters are not tokenized. |
| SearchTokenizerTestCase::testTokenizer | function | modules/ |
Verifies that strings of CJK characters are tokenized. |
| _locale_import_tokenize_formula | function | includes/ |
Backward compatible implementation of token_get_all() for formula parsing |
Buggy or inaccurate documentation? Please file an issue. Need support? Need help programming? Connect with the Drupal community.