Skip to content
This repository was archived by the owner on Jul 4, 2025. It is now read-only.

[CI] Update nitro options for init and inference #147

Merged
merged 4 commits into from
Nov 17, 2023
Merged

[CI] Update nitro options for init and inference #147

merged 4 commits into from
Nov 17, 2023

Conversation

@hiro-v
Copy link
Contributor

@hiro-v hiro-v commented Nov 17, 2023 •
edited
Loading

  • Changed Nitro custom port in CI to 5000
  • Changed Nitro only runs in 1 thread in CI
  • Changed Inference call to 127.0.0.1:5000
  • Changed Chat completion max_token to 50 to reduce CI time
  • Added -j $(sysctl -n hw.ncp) to Mac cmake
  • Added -j "%NUMBER_OF_PROCESSORS%" to Windows cmake

@hiro-v hiro-v added P1: important Important feature / fix type: ci labels Nov 17, 2023
@hiro-v hiro-v added this to the Nitro v0.2.0 milestone Nov 17, 2023
@hiro-v hiro-v requested review from hiento09 and tikikun November 17, 2023 02:24
@hiro-v hiro-v self-assigned this Nov 17, 2023
tikikun
tikikun approved these changes Nov 17, 2023
View reviewed changes
Copy link
Contributor

@tikikun tikikun left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

lgtm

@hiro-v hiro-v merged commit ce99d50 into main Nov 17, 2023
@hiro-v hiro-v deleted the fix_ci_nitro_custom_port branch November 17, 2023 06:50
Sign up for free to subscribe to this conversation on GitHub. Already have an account? Sign in.

Reviewers

2 more reviewers

@tikikun tikikun tikikun approved these changes

@hiento09 hiento09 hiento09 approved these changes

Reviewers whose approvals may not affect merge requirements

Assignees

@hiro-v hiro-v

Labels

P1: important Important feature / fix

Projects

No open projects
Menlo
Archived in project

Milestone

Nitro v0.2.0

Development

Successfully merging this pull request may close these issues.

4 participants

@hiro-v @tikikun @hiento09