Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

Record next/prev token probabilities #1

Closed
hinrik opened this issue Jan 24, 2010 · 1 comment
Closed

Record next/prev token probabilities #1

hinrik opened this issue Jan 24, 2010 · 1 comment
Labels
enhancement

Comments

@hinrik
Copy link
Owner

hinrik commented Jan 24, 2010

Hailo does not currently rank next/previous tokens based on how likely they are to appear compared to other tokens.
@hinrik
Copy link
Owner Author

hinrik commented Jan 26, 2010

I just implemented this.

hinrik added a commit that referenced this issue May 6, 2011
@hinrik
Match "#1" and "#1234" as single tokens
b0d7a17
hinrik added a commit that referenced this issue May 7, 2011
@hinrik
v0.69
fb7b1e6 
    - Scored engine: Prefer shorter replies, like MegaHAL/cobe do

    - Word tokenizer:
        * Improve matching/capitalization of filenames and domain names
        * Match timestamps as single tokens
        * Match IRC nicks (<foobar>, <@foobar>, etc) as single tokens
        * Match IRC channel names (#foo, &bar, +baz)
        * Match various prefixes and postfixes with numbers
        * Match "#1" and "#1234" as single tokens
        * Match </foo> as a single token

    - Depend on MouseX::Getopt 0.33 to fix test failures
This issue was closed.
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Assignees
No one assigned
Labels
enhancement
Projects
None yet
Milestone
No milestone
Development

No branches or pull requests
1 participant
@hinrik