Can't get the startWith and RerunLastFailures features to work

[forceedge01]

Fitnesse documentation details a way to run last failed tests from the command line here
http://fitnesse.org/FitNesse.FullReferenceGuide.UserGuide.WritingAcceptanceTests.TestSuites.TagsAndFilters

This would be incredibly useful in debugging tests and quickly running the failed ones again. I get an error when executing this via CLI or web.

Bootstrapping FitNesse, the fully integrated standalone wiki and acceptance testing framework.
root page: fitnesse.wiki.fs.FileSystemPage at ./FitNesseRoot#latest
logger: none
authenticator: fitnesse.authentication.PromiscuousAuthenticator
page factory: fitnesse.html.template.PageFactory
page theme: bootstrap
Starting FitNesse on port: 8085
Executing command: RerunLastFailures?suite&format=text
-----Command Output-----
java.lang.Exception: error loading page: 404
	at fitnesse.FitNesse.executeSingleCommand(FitNesse.java:91)
	at fitnesseMain.FitNesseMain.executeSingleCommand(FitNesseMain.java:121)
	at fitnesseMain.FitNesseMain.launch(FitNesseMain.java:95)
	at fitnesseMain.FitNesseMain.launchFitNesse(FitNesseMain.java:75)
	at fitnesseMain.FitNesseMain.launchFitNesse(FitNesseMain.java:54)
	at fitnesseMain.FitNesseMain.main(FitNesseMain.java:34)
make: *** [tests] Error 1

Any thoughts on this? I did run tests that have failed already and they show up in the history of Fitnesse.