Updated tokenize() description to clarify how the delim string is used.

diff --git a/langref/node11.html b/langref/node11.html
index 11d2018d630f44472863fdbd237119354a9a4edf..8f31a7e83012f9082b19d875217b713f8360ff75 100644 (file)
--- a/langref/node11.html
+++ b/langref/node11.html
@@ -2405,11 +2405,12 @@ General syntax:
 tokenize:string (input:string, delim:string)
 </PRE>
 </DD>
-</DL>This function returns the next token in the given input string. The tokens
-are assumed to be divided by the first character in the delim string. If
-the input string is non-NULL, it returns the first token. If the input string
+</DL>This function returns the next token in the given input string, where 
+the tokens are delimited by one of the characters in the delim string.
+If the input string is non-NULL, it returns the first token. If the input string
 is NULL, it returns the next token in the string passed in the previous call
-to tokenize. It returns NULL when no more tokens are available.
+to tokenize. If no delimiter is found, the entire remaining input string
+is returned.  It returns NULL when no more tokens are available.
 
 <P>
 

diff --git a/langref/node14.html b/langref/node14.html
index 2ad3a47f57720688783d58f88a74f581cbbead12..ea278195291e5b1e9c38876a597a2543c4926c89 100644 (file)
--- a/langref/node14.html
+++ b/langref/node14.html
@@ -68,7 +68,7 @@ Mathematics Department, Macquarie University, Sydney.
 The command line arguments were: <BR>
  <STRONG>latex2html</STRONG> <TT>-noaddress -show_section_numbers -local_icons -split 4 langref.tex -dir ../../htdocs/langref</TT>
 <P>
-The translation was initiated by root on 2007-09-11
+The translation was initiated by root on 2007-10-11
 <BR><HR>
 
 </BODY>