This is an automated email from the ASF dual-hosted git repository. davsclaus pushed a commit to branch main in repository https://gitbox.apache.org/repos/asf/camel.git
The following commit(s) were added to refs/heads/main by this push: new 708c76a CAMEL-16861: Polished tokenize language 708c76a is described below commit 708c76a96ae0eaa880e45b62d97ee8af2f7716c5 Author: Claus Ibsen <claus.ib...@gmail.com> AuthorDate: Tue Sep 14 10:34:41 2021 +0200 CAMEL-16861: Polished tokenize language --- .../docs/modules/languages/pages/tokenize-language.adoc | 15 +++++++++------ 1 file changed, 9 insertions(+), 6 deletions(-) diff --git a/core/camel-core-languages/src/main/docs/modules/languages/pages/tokenize-language.adoc b/core/camel-core-languages/src/main/docs/modules/languages/pages/tokenize-language.adoc index 97f118c..b072b00 100644 --- a/core/camel-core-languages/src/main/docs/modules/languages/pages/tokenize-language.adoc +++ b/core/camel-core-languages/src/main/docs/modules/languages/pages/tokenize-language.adoc @@ -9,17 +9,18 @@ include::{cq-version}@camel-quarkus:ROOT:partial$reference/languages/tokenize.ad *Since Camel {since}* -The tokenizer language is a built-in language in camel-core, which is -most often used with the Splitter EIP to split -a message using a token-based strategy. +The tokenizer language is a built-in language in `camel-core`, which is +most often used with the xref:{eip-vc}:eips:split-eip.adoc[Split] EIP +to split a message using a token-based strategy. The tokenizer language is intended to tokenize text documents using a specified delimiter pattern. It can also be used to tokenize XML documents with some limited capability. For a truly XML-aware -tokenization, the use of the XMLTokenizer +tokenization, the use of the xref:xtokenize-language.adoc[XML Tokenize] language is recommended as it offers a faster, more efficient tokenization specifically for XML documents. + == Tokenize Options // language options: START @@ -45,9 +46,11 @@ The Tokenize language supports 11 options, which are listed below. // language options: END -== Example usage +== Example -The following example shows how to take a request from the *direct:a* endpoint the split it into pieces using an Expression, then forward each piece to *direct:b* +The following example shows how to take a request from the direct:a endpoint +then split it into pieces using an xref:manual::expression.adoc[Expression], +then forward each piece to direct:b: [source,xml] ----