From 186790fa320182c34277aa09a868fc9376dd3e4a Mon Sep 17 00:00:00 2001 From: "K. Noel Belcourt" Date: Thu, 10 Jun 2010 02:27:48 +0000 Subject: [PATCH 1/3] Fix one XML validation warning. [SVN r62708] --- introduc.htm | 2 +- 1 file changed, 1 insertion(+), 1 deletion(-) diff --git a/introduc.htm b/introduc.htm index a5c91c7f..40c3980d 100644 --- a/introduc.htm +++ b/introduc.htm @@ -12,7 +12,7 @@

C++ Boost

+ "86"/>

Introduction

From 3cb98b9b50b91b986c93f6032c6e649362242df6 Mon Sep 17 00:00:00 2001 From: "K. Noel Belcourt" Date: Thu, 10 Jun 2010 02:24:31 +0000 Subject: [PATCH 2/3] Fixed ticket 2672 by applying (and slightly modifying the attached patch. The page now seems to validate correctly. [SVN r62707] --- introduc.htm | 30 ++++++++++++++---------------- 1 file changed, 14 insertions(+), 16 deletions(-) diff --git a/introduc.htm b/introduc.htm index 40c3980d..8a30f663 100644 --- a/introduc.htm +++ b/introduc.htm @@ -16,9 +16,9 @@

Introduction

-

The boost Tokenizer package provides a flexible and easy to - use way to break of a string or other character sequence into a series of - tokens. Below is a simple example that will break up a phrase into +

The Boost Tokenizer package provides a flexible and + easy-to-use way to break a string or other character sequence into a series + of tokens. Below is a simple example that will break up a phrase into words.

@@ -40,19 +40,19 @@

Introduction

-

You can choose how the string gets broken up. You do this - by specifying the TokenizerFunction. If you do not specify anything, the - default TokenizerFunction is char_delimiters_separator<char> which +

You can choose how the string gets parsed by using the + TokenizerFunction. If you do not specify anything, the default + TokenizerFunction is char_delimiters_separator<char> which defaults to breaking up a string based on space and punctuation. Here is an - example of using another TokenizerFunction called escaped_list_separator. - This TokenizerFunction parses a superset of comma separated value (csv) - lines. The format looks like this

+ example using another TokenizerFunction called + escaped_list_separator. This TokenizerFunction parses a superset + of comma-separated value (CSV) lines. The format looks like this:

Field 1,"putting quotes around fields, allows commas",Field 3

Below is an example that will break the previous line into - its 3 fields

+ its three fields.

@@ -73,13 +73,11 @@ 
Introduction
-

Finally, for some TokenizerFunctions you have to pass in +

Finally, for some TokenizerFunctions you have to pass something into the constructor in order to do anything interesting. An - example is offset_separator. This class breaks a string into tokens based - on offsets for example

- -

12252001 when parsed using offsets of 2,2,4 becomes 12 25 - 2001. Below is an example to parse this.

+ example is the offset_separator. This class breaks a string into tokens based + on offsets. For example, when 12252001 is parsed using offsets of + 2,2,4 it becomes 12 25 2001. Below is the code used.


From ce180d65816c04c2aa71b11595a128856f697b92 Mon Sep 17 00:00:00 2001
From: "K. Noel Belcourt" 
Date: Thu, 10 Jun 2010 17:53:31 +0000
Subject: [PATCH 3/3] Tokenizer documentation fixes for ticket 2672.

Applied these changes.

The revision date should be changed from ''25 December, 2006'' to ''9 June
2010''. You could also change the webbot element from ''s-format="%d %B,
%Y"'' to ''s-format="%d %B %Y"''. The comma is superfluous in that format.

[SVN r62752]
---
 introduc.htm | 2 +-
 1 file changed, 1 insertion(+), 1 deletion(-)

diff --git a/introduc.htm b/introduc.htm
index 8a30f663..6c526812 100644
--- a/introduc.htm
+++ b/introduc.htm
@@ -108,7 +108,7 @@ 
Introduction

   height="31" width="88">

 
   
Revised 
-  25 December, 2006

+  9 June 2010

 
   
Copyright © 2001 John R. Bandela