This repository has been archived by the owner on Sep 18, 2024. It is now read-only.
WARNING(GPUScheduler) gpu_metrics file does not exist! #4888
Unanswered
MacieJayDaaaaa
asked this question in
Q&A
Replies: 0 comments
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
-
When i use nni with a gpu,there is a waring in the nnimanager log,and the trail is always waiting.
1[2022-05-26 20:21:ee]INFo (NNIDataStore) Datastore initialization done2[2022-05-26 28:21:00] INFO (RestServer) RestServer start
3[2022-05-26 20:21:00] INFo (RestServer) RestServer base port is 8080
4[2022-05-26 20:21:00] INFo (main) Rest server listening on: http: //0.0.0.0:80805[2022-05-26 20:21:04] INFO (NNIManager) starting experiment: buk2sx7z
6[2022-05-26 20:21:04] INFO (NNIManager) Setup training service...
7 [2022-85-26 20:21:04] INFO (LocalTrainingService) Construct local machine training service.8[2022-85-2620:21:04] INFO (NNIManager) Setup tuner. . .
9[2822-85-26 20:21:04] INFO(NNIManager)change NNINanager status from:INITIALIZED to: RUNNING10[2022-05-26 20:21:04] INFO (NNIManager) Add event listeners
11[2022-85-26 20:21:04] INFo (LocalTrainingService) Run local machine training service.12[2022-85-26 20:21:05] INFO (NIManager)NNIManager received command from dispatcher: ID,13[2022-85-26 20:21:05] INFO (NNIManagen)NIManager received command from dispatcher: TR,
{ " parameter_id": e,"parameter_source": "algorithm"" "parameters": {"batchsize": 16,
"learning_rate": 0.04894713248699054}, "parameter_index": 0}
14[2022-85-26 20:21:06] WARNING (GPUScheduler) gpu_metrics file does not exist!15[2022-05-26 20:21:09] INFO(NNIManager) submitTrialJob: form: {
16
sequenceId: e,
17
hyperParameters: {
18
value: " ["parameter_id" : 0, "parameter_source": "algorithm", "parameters": {"batchsize": 16,"learning_rate": 0.04894713248699054}, "parameter_index" : 0}',
19
index: e
20
},
21 placementConstraint: { type: "one ', gpus: [] }22}
23[2022-05-26 20:21:11] WARNING(GPUScheduler) gpu_metrics file does not exist!24[2022-05-26 20:21:16] WARNING(GPUScheduler) gpu_metrics file does not exist!
Beta Was this translation helpful? Give feedback.
All reactions