Skip to content

Bug launching multiple instances of the same model at the same time #221

@bzamanlooy

Description

@bzamanlooy

Describe the bug

When launching multiple vec-inf instances in quick succession (e.g. in a for-loop), vec-inf status fails with:
Error: Status check failed: Expecting value: line 1 column 1 (char 0)

the log shows:
mv: cannot move 'temp.json' to '/h/behnzaman/.vec-inf-logs/Qwen3/Qwen3-32B.25829/Qwen3-32B.25829.json': No such file or directory

To Reproduce

for i in {1..20}; do
vec-inf launch Qwen3-32B
done

Expected behavior

Each launch should succeed independently without file conflicts.

Additional context

  • This appears to be a race condition on the shared temp.json (or similar temp file used for job setup).
  • Adding sleep between launches avoids the issue.

Metadata

Metadata

Assignees

Labels

No labels
No labels

Type

No type

Projects

No projects

Milestone

No milestone

Relationships

None yet

Development

No branches or pull requests

Issue actions