Skip to content

Commit

Permalink
allow timers at 10us resolution on server
Browse files Browse the repository at this point in the history
  • Loading branch information
mmoskal committed Apr 15, 2024
1 parent 7304094 commit 07afdaf
Showing 1 changed file with 1 addition and 1 deletion.
2 changes: 1 addition & 1 deletion scripts/host.sh
Original file line number Diff line number Diff line change
Expand Up @@ -65,7 +65,7 @@ fi
if [ "$INNER" = "model" ] ; then
echo "in server for $MODEL in $FOLDER"
PREF="cd $FOLDER && CUDA_VISIBLE_DEVICES=$CUDA_VISIBLE_DEVICES"
ARGS="--port $FWD_PORT --shm-prefix /aici-${MODEL}-"
ARGS="--port $FWD_PORT --shm-prefix /aici-${MODEL}- -A--wasm-timer-resolution-us=10"
if [ "$CPP" -eq 1 ] ; then
docker_cmd "$PREF /workspaces/aici/rllm/rllm-llamacpp/server.sh --loop --cuda $MODEL $ARGS"
else
Expand Down

0 comments on commit 07afdaf

Please sign in to comment.