Switch branches/tags
Nothing to show
Commits on May 22, 2009
  1. Doing some creative renaming. Object literals should probably have a …

    …first-class type, rather than hiding behind an obtuse '{' operator.
    committed May 22, 2009
Commits on May 21, 2009
  1. Added support for '(' as a calling operator. Not sure how it will han…

    …dle loop structures ('for' in particular), but I'll worry about that when _anything_ in my code can handle loop structures. :)
    committed May 21, 2009
Commits on May 19, 2009
  1. Added call syntax ('.' and '[')

    committed May 19, 2009
  2. Added a variety of operators, and tests for a few of them. Trying to …

    …work out how to deal with multiple statements (';', '\n'), etc.
    committed May 19, 2009
Commits on Feb 22, 2009
  1. Added `` so that this behaves like a package, and made som…

    …e iterabilization changes to `TokenList`
    committed Feb 22, 2009
Commits on Nov 27, 2008
  1. Throwing everything away after reading through…

    …SS21/syndata.html#tokenization.  I ought be using the specified tokens.  I'll start on that.  Maybe even tonight.
    committed Nov 27, 2008
Commits on Nov 25, 2008
  1. Rethinking how I'm tokenizing selectors. The initial method wouldn't …

    …scale. This method probably won't either, but I'm working on it. :)
    committed Nov 25, 2008
Commits on Nov 24, 2008
Commits on Nov 23, 2008
  1. Crap. I need to come up with a mechanism for distinguishing `.class :…

    …pseudoclass` from `.class:pseudoclass` in the tokenizer. Probably requires smarter tokens. Bleh.
    committed Nov 23, 2008
Commits on Nov 22, 2008
  1. You knew it was coming. I'm still stumped on factory pattern in pytho…

    …nm so I'm starting on a CSS tokenizer for the JS tokenizer to play with.
    committed Nov 22, 2008
  2. Changed `self.XXX.match( c )` to call `self.cur_char_is( XXX )` for c…

    …onsistancy with `self.next_char_is( XXX )`. We like self-documenting code.
    committed Nov 22, 2008
  3. More refactorings: pulling code out of JavaScriptTokenizer that can p…

    …robably be used generically (e.g. quoted strings, numbers, and identifiers), and setting up class variables to allow customization rather than diving straight into overriding.
    committed Nov 22, 2008
  4. Pulled the "Tokenizer" functionality out into an abstract class, and …

    …subclassed it to produce "JavaScriptTokenizer". Obviously, this means I'll be building tokenizers for other languages.
    committed Nov 22, 2008
Commits on Nov 20, 2008
  1. Starting on a factory method. Need to do more research, as this doesn…

    …'t make sense in Python. :)
    committed Nov 20, 2008
Commits on Nov 19, 2008
  1. Starting on the parser.

    committed Nov 19, 2008
  2. Changed `Tokenizer.tokenize` to call `__token_generator`, which uses …

    …the magical `yield` construct. Python is kinda cool.
    committed Nov 19, 2008
  3. Refactoring.

    - Added `TokenList` class to carry the tokenized list.
    - Added equality and inequality checking to Token and TokenList
    - Changed `Tokenizer.tokenize` to return a `TokenList`
    - Reworked tests to match new return values and capabilities (e.g. removed the hideous, hideous, hideous string comparison check)
    committed Nov 19, 2008
  4. Changing `__next_is` to `__next_char_is`, as I might need to add a `n…

    …ext_token` method, and ought be explicit about what's being nexted.
    committed Nov 19, 2008
Commits on Nov 18, 2008
  1. I think I've now more or less fully ported the tokenizer. Let's get s…

    …tarted on the parser, shall we?
    committed Nov 18, 2008
  2. Adding the original JavaScript files so I know what it is that I'm su…

    …pposed to be porting. Next step: strings.
    committed Nov 18, 2008
Commits on Nov 17, 2008
  1. I lied. The next step was unit tests and refactoring. The _next_ next…

    … step is "everything else."
    committed Nov 17, 2008
  2. I've got a partially functional tokenizer that parses out identifiers…

    …, numbers, and everything else. Next step: work on the everything else bit. :)
    committed Nov 17, 2008