token_doc.go

/*
	The token package provides functions which tokenise, or provide for the 
	manipulation of tokenised strings.  Functions allow for multiple token
	separators, and quote aware tokenisation which provide greater flexibility
	over the simple strings Split and SplitN functions. 
*/
package token