need instructions on how to run grader from command line

[tansaku]

In situations where a live grader is not available it's important that users can run the grader locally from the command line to check a possible solution.

One can do that directly with rspec like so:

bundle exec rspec -r ../hw-oracle-of-bacon/lib/oracle_of_bacon.rb autograder/oracle_of_bacon_spec.rb

but this won't generate a grade per se. We should check we can grade from the command line and document the process

[armandofox]

the main rag wiki would be a good place to document this
could also be useful for students to self-test their code

Armando Fox
Professor, Computer Science Division
Faculty Advisor, UC Berkeley MOOCLab
fox .at. cs .dot. berkeley .dot. edu
581 Soda Hall MC#1776, Berkeley, CA 94720-1776
+1.510.642.6820 / http://www.cs.berkeley.edu/~fox

TAKE MY CLASS FOR FREE VIA edX: http://saas-class.org
LIKE IT ON FACEBOOK: http://facebook.com/saas-class
TRY MY BOOK (NOT FREE): http://www.saasbook.info (goes with the course)

On Jan 18, 2016, at 2:37 AM, Sam Joseph notifications@github.com wrote:

In situations where a live grader is not available it's important that users can run the grader locally from the command line to check a possible solution.

One can do that directly with rspec like so:

bundle exec rspec -r ../hw-oracle-of-bacon/lib/oracle_of_bacon.rb autograder/oracle_of_bacon_spec.rb
but this won't generate a grade per se. We should check we can grade from the command line and document the process

—
Reply to this email directly or view it on GitHub.

[zhangaaron]

Was working on a version of command line grader to simplify testing of the autograder in continuous integration. This is also another use of it I haven't thought of and a great idea.

[tansaku]

@zhangaaron we had the ability to run from the command line in the previous system through a series of scripts in the root directory - I'm sure there's a better solution

[tansaku]

@zhangaaron I was about to start working on making a command line interface, but you mention you were already working on a version, which gives me pause for thought. We have related issues here, specifically:

• CI failing on individual assignment repos, e.g. https://github.com/saasbook/hw-refactoring-legacy-code-ci
• assignment solutions exposed within this repo: too much data exposed here #70

I guess I'm going to switch to writing up some engineering flow documentation, on the offchance that I'll be duplicating work you've already started. In the meantime could you share any code you've started on for a command line grader?