AdvanceToNextToken(struct sStringTokenizer)

From NWN Lexicon
Jump to: navigation, search

Advances the string tokenizer to the next token.

struct sStringTokenizer AdvanceToNextToken(
    struct sStringTokenizer stTok


The string tokenizer used to split up the string.


This function advances the string tokenizer stTok, which is used to split up the string, to the next token.

It updates the internal state of stTok and returns the updated state.

Note that in order to get any subsequent tokens, you must pass the UPDATED stTok to AdvanceToNextToken(). If you forget to pass the updated stTok to AdvanceToNextToken(), for instance by passing an "older" non-updated version to AdvanceToNextToken(), this function will always return the same "old" next token of the "older" non-updated stTok.

You get the next token string from the updated stTok by calling GetNextToken(), supplying the updated stTok as argument.

AdvanceToNextToken() should always be used in combination with HasMoreTokens(), which checks whether there actually are any more tokens remaining for the current state of stTok.


Keep in mind that the functions in x0_i0_stringlib are not very efficient. They do a lot of unnecessary string manipulations and unnecessary string parameter passing; string operations and string parameter passing (into or out of NWScript functions) are amongst the most inefficient operations in NWScript.

For the purpose of string tokenization by the functions provided in x0_i0_stringlib, a token is any substring (including empty substrings!) within the original string enclosed by the specified delimiter (e.g. every token has one delimiter to the left, one to the right and NO delimiters within). Any non-empty original string is treated as if it were enclosed within a pair of (virtual) delimiters to its left and right. Thus, unless the original string is empty, the number of tokens is always one higher than the number of delimiters contained within the original string. A non-empty string with no delimiters therefore consists out of one token, which is equal to the original string. An empty string has no tokens, although an empty token will be returned on request.


sString = "I|am|sloppy||programmer";
sDelimiter = "|";

Token[0] = "I";
Token[1] = "am";
Token[2] = "sloppy";
Token[3] = "";
Token[4] = "programmer";

sString contains five tokens and four delimiters.


#include "x0_i0_stringlib"




Information icon.png This article is in need of examples. You can help the NWN Lexicon by showing how to use this code effectively.

See Also

functions:  GetNextToken, HasMoreTokens

author: motu99, editor: Mistress