Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Object Detection training issue #997

Closed
arafattehsin opened this issue Sep 13, 2020 · 4 comments
Closed

Object Detection training issue #997

arafattehsin opened this issue Sep 13, 2020 · 4 comments

Comments

@arafattehsin
Copy link

System information

  • Windows 10 2004 (19041.329):
  • .NET Core 3.1:

Issue

  • Trying to train a new Object Detection model
  • As soon as it tries to upload, it gave me an error
  • It should have been uploaded successfully

Source code / logs

2020-09-14 00:05:05.4877 DEBUG Set log file path to C:\Users\ArafatTehsin\AppData\Local\Temp\MLVSTools\logs\586f1204-3d6d-422e-8981-f35a6848f6c4.txt (Microsoft.ML.ModelBuilder.Utils.Logger.Debug) 2020-09-14 00:05:15.2614 DEBUG EnvironmentTab_DataContextChanged (Microsoft.ML.ModelBuilder.Utils.Logger.Debug) 2020-09-14 00:05:16.7554 DEBUG Current user is null (Microsoft.ML.ModelBuilder.Utils.Logger.Debug) 2020-09-14 00:05:17.6054 DEBUG Current user is null (Microsoft.ML.ModelBuilder.Utils.Logger.Debug) 2020-09-14 00:05:20.3100 DEBUG Current user is not null (Microsoft.ML.ModelBuilder.Utils.Logger.Debug) 2020-09-14 00:05:20.3400 DEBUG Current user is not null (Microsoft.ML.ModelBuilder.Utils.Logger.Debug) 2020-09-14 00:05:20.3510 DEBUG Current user is not null (Microsoft.ML.ModelBuilder.Utils.Logger.Debug) 2020-09-14 00:05:20.3510 DEBUG Current user is not null (Microsoft.ML.ModelBuilder.Utils.Logger.Debug) 2020-09-14 00:05:22.0270 DEBUG Disposing AutoMLService Client (Microsoft.ML.ModelBuilder.Utils.Logger.Debug) 2020-09-14 00:05:22.2740 DEBUG Disposing AutoMLService Client (Microsoft.ML.ModelBuilder.Utils.Logger.Debug) 2020-09-14 00:05:22.3940 DEBUG Disposing AutoMLService Client (Microsoft.ML.ModelBuilder.Utils.Logger.Debug) 2020-09-14 00:05:22.5580 DEBUG Disposing AutoMLService Client (Microsoft.ML.ModelBuilder.Utils.Logger.Debug) 2020-09-14 00:05:23.7289 DEBUG Disposing AutoMLService Client (Microsoft.ML.ModelBuilder.Utils.Logger.Debug) 2020-09-14 00:05:28.3407 DEBUG Disposing AutoMLService Client (Microsoft.ML.ModelBuilder.Utils.Logger.Debug) 2020-09-14 00:05:38.3436 DEBUG CreateExperimentAsync (Microsoft.ML.ModelBuilder.Utils.Logger.Debug) 2020-09-14 00:05:38.3436 DEBUG Disposing AutoMLService Client (Microsoft.ML.ModelBuilder.Utils.Logger.Debug) 2020-09-14 00:05:57.9158 DEBUG Disposing AutoMLService Client (Microsoft.ML.ModelBuilder.Utils.Logger.Debug) 2020-09-14 00:05:58.3028 DEBUG start uploading files.... (Microsoft.ML.ModelBuilder.Utils.Logger.Debug) 2020-09-14 00:05:58.7988 DEBUG Info (Microsoft.ML.ModelBuilder.Utils.Logger.Debug) 2020-09-14 00:05:58.7988 DEBUG INFO: Scanning... (Microsoft.ML.ModelBuilder.Utils.Logger.Debug) 2020-09-14 00:05:58.7988 DEBUG Info (Microsoft.ML.ModelBuilder.Utils.Logger.Debug) 2020-09-14 00:05:58.7988 DEBUG INFO: Any empty folders will not be processed, because source and/or destination doesn't have full folder support (Microsoft.ML.ModelBuilder.Utils.Logger.Debug) 2020-09-14 00:05:58.7988 DEBUG Init (Microsoft.ML.ModelBuilder.Utils.Logger.Debug) 2020-09-14 00:05:58.7988 DEBUG {"LogFileLocation":"C:\\Users\\ArafatTehsin\\.azcopy\\f75a048b-773c-6648-43e0-1c6e9c438a67.log","JobID":"f75a048b-773c-6648-43e0-1c6e9c438a67","IsCleanupJob":false} (Microsoft.ML.ModelBuilder.Utils.Logger.Debug) 2020-09-14 00:05:58.8448 DEBUG Progress (Microsoft.ML.ModelBuilder.Utils.Logger.Debug) 2020-09-14 00:05:58.8448 DEBUG {"ErrorMsg":"","ActiveConnections":"0","CompleteJobOrdered":true,"JobStatus":"InProgress","TotalTransfers":"31","FileTransfers":"31","FolderPropertyTransfers":"0","TransfersCompleted":"0","TransfersFailed":"0","TransfersSkipped":"0","BytesOverWire":"0","TotalBytesTransferred":"0","TotalBytesEnumerated":"1804234","TotalBytesExpected":"1804234","PercentComplete":"0","AverageIOPS":"0","AverageE2EMilliseconds":"0","ServerBusyPercentage":"0","NetworkErrorPercentage":"0","FailedTransfers":[],"SkippedTransfers":null,"PerfConstraint":0,"PerformanceAdvice":null,"IsCleanupJob":false} (Microsoft.ML.ModelBuilder.Utils.Logger.Debug) 2020-09-14 00:05:58.8448 INFO Uploading... Total Transfers: 31, Transfers Completed: 0, Transfers Skipped: 0, Transfers Failed: 0 (Microsoft.ML.ModelBuilder.Utils.Logger.Info) 2020-09-14 00:06:00.1418 DEBUG Info (Microsoft.ML.ModelBuilder.Utils.Logger.Debug) 2020-09-14 00:06:00.1418 DEBUG INFO: azcopy.exe: A newer version 10.6.0 is available to download (Microsoft.ML.ModelBuilder.Utils.Logger.Debug) 2020-09-14 00:06:00.7518 DEBUG EndOfJob (Microsoft.ML.ModelBuilder.Utils.Logger.Debug) 2020-09-14 00:06:00.7518 DEBUG {"ErrorMsg":"","ActiveConnections":"0","CompleteJobOrdered":true,"JobStatus":"CompletedWithSkipped","TotalTransfers":"31","FileTransfers":"31","FolderPropertyTransfers":"0","TransfersCompleted":"0","TransfersFailed":"0","TransfersSkipped":"31","BytesOverWire":"0","TotalBytesTransferred":"0","TotalBytesEnumerated":"1804234","TotalBytesExpected":"0","PercentComplete":"100","AverageIOPS":"11","AverageE2EMilliseconds":"239","ServerBusyPercentage":"0","NetworkErrorPercentage":"0","FailedTransfers":[],"SkippedTransfers":[{"Src":"\\\\?\\C:\\Users\\ArafatTehsin\\Downloads\\flower_photos\\flower_photos\\flower_photos\\data\\159079265_d77a9ac920_n.jpg","Dst":"https://mlnet6358200191.blob.core.windows.net/azureml-blobstore-1e85adf5-e15a-4501-bf92-a2bb126227e9/vott-json-export/159079265_d77a9ac920_n.jpg","IsFolderProperties":false,"TransferStatus":"SkippedEntityAlreadyExists","ErrorCode":"0"},{"Src":"\\\\?\\C:\\Users\\ArafatTehsin\\Downloads\\flower_photos\\flower_photos\\flower_photos\\data\\323872063_7264e7e018_m.jpg","Dst":"https://mlnet6358200191.blob.core.windows.net/azureml-blobstore-1e85adf5-e15a-4501-bf92-a2bb126227e9/vott-json-export/323872063_7264e7e018_m.jpg","IsFolderProperties":false,"TransferStatus":"SkippedEntityAlreadyExists","ErrorCode":"0"},{"Src":"\\\\?\\C:\\Users\\ArafatTehsin\\Downloads\\flower_photos\\flower_photos\\flower_photos\\data\\118974357_0faa23cce9_n.jpg","Dst":"https://mlnet6358200191.blob.core.windows.net/azureml-blobstore-1e85adf5-e15a-4501-bf92-a2bb126227e9/vott-json-export/118974357_0faa23cce9_n.jpg","IsFolderProperties":false,"TransferStatus":"SkippedEntityAlreadyExists","ErrorCode":"0"},{"Src":"\\\\?\\C:\\Users\\ArafatTehsin\\Downloads\\flower_photos\\flower_photos\\flower_photos\\data\\134409839_71069a95d1_m.jpg","Dst":"https://mlnet6358200191.blob.core.windows.net/azureml-blobstore-1e85adf5-e15a-4501-bf92-a2bb126227e9/vott-json-export/134409839_71069a95d1_m.jpg","IsFolderProperties":false,"TransferStatus":"SkippedEntityAlreadyExists","ErrorCode":"0"},{"Src":"\\\\?\\C:\\Users\\ArafatTehsin\\Downloads\\flower_photos\\flower_photos\\flower_photos\\data\\43474673_7bb4465a86.jpg","Dst":"https://mlnet6358200191.blob.core.windows.net/azureml-blobstore-1e85adf5-e15a-4501-bf92-a2bb126227e9/vott-json-export/43474673_7bb4465a86.jpg","IsFolderProperties":false,"TransferStatus":"SkippedEntityAlreadyExists","ErrorCode":"0"},{"Src":"\\\\?\\C:\\Users\\ArafatTehsin\\Downloads\\flower_photos\\flower_photos\\flower_photos\\data\\568715474_bdb64ccc32.jpg","Dst":"https://mlnet6358200191.blob.core.windows.net/azureml-blobstore-1e85adf5-e15a-4501-bf92-a2bb126227e9/vott-json-export/568715474_bdb64ccc32.jpg","IsFolderProperties":false,"TransferStatus":"SkippedEntityAlreadyExists","ErrorCode":"0"},{"Src":"\\\\?\\C:\\Users\\ArafatTehsin\\Downloads\\flower_photos\\flower_photos\\flower_photos\\data\\494803274_f84f21d53a.jpg","Dst":"https://mlnet6358200191.blob.core.windows.net/azureml-blobstore-1e85adf5-e15a-4501-bf92-a2bb126227e9/vott-json-export/494803274_f84f21d53a.jpg","IsFolderProperties":false,"TransferStatus":"SkippedEntityAlreadyExists","ErrorCode":"0"},{"Src":"\\\\?\\C:\\Users\\ArafatTehsin\\Downloads\\flower_photos\\flower_photos\\flower_photos\\data\\21652746_cc379e0eea_m.jpg","Dst":"https://mlnet6358200191.blob.core.windows.net/azureml-blobstore-1e85adf5-e15a-4501-bf92-a2bb126227e9/vott-json-export/21652746_cc379e0eea_m.jpg","IsFolderProperties":false,"TransferStatus":"SkippedEntityAlreadyExists","ErrorCode":"0"},{"Src":"\\\\?\\C:\\Users\\ArafatTehsin\\Downloads\\flower_photos\\flower_photos\\flower_photos\\data\\568715474_bdb64ccc32.jpg","Dst":"https://mlnet6358200191.blob.core.windows.net/azureml-blobstore-1e85adf5-e15a-4501-bf92-a2bb126227e9/vott-json-export/568715474_bdb64ccc32.jpg","IsFolderProperties":false,"TransferStatus":"SkippedEntityAlreadyExists","ErrorCode":"0"},{"Src":"\\\\?\\C:\\Users\\ArafatTehsin\\Downloads\\flower_photos\\flower_photos\\flower_photos\\data\\5794835_d15905c7c8_n.jpg","Dst":"https://mlnet6358200191.blob.core.windows.net/azureml-blobstore-1e85adf5-e15a-4501-bf92-a2bb126227e9/vott-json-export/5794835_d15905c7c8_n.jpg","IsFolderProperties":false,"TransferStatus":"SkippedEntityAlreadyExists","ErrorCode":"0"},{"Src":"\\\\?\\C:\\Users\\ArafatTehsin\\Downloads\\flower_photos\\flower_photos\\flower_photos\\data\\184682920_97ae41ce60_m.jpg","Dst":"https://mlnet6358200191.blob.core.windows.net/azureml-blobstore-1e85adf5-e15a-4501-bf92-a2bb126227e9/vott-json-export/184682920_97ae41ce60_m.jpg","IsFolderProperties":false,"TransferStatus":"SkippedEntityAlreadyExists","ErrorCode":"0"},{"Src":"\\\\?\\C:\\Users\\ArafatTehsin\\Downloads\\flower_photos\\flower_photos\\flower_photos\\data\\184682652_c927a49226_m.jpg","Dst":"https://mlnet6358200191.blob.core.windows.net/azureml-blobstore-1e85adf5-e15a-4501-bf92-a2bb126227e9/vott-json-export/184682652_c927a49226_m.jpg","IsFolderProperties":false,"TransferStatus":"SkippedEntityAlreadyExists","ErrorCode":"0"},{"Src":"\\\\?\\C:\\Users\\ArafatTehsin\\Downloads\\flower_photos\\flower_photos\\flower_photos\\data\\184682652_c927a49226_m.jpg","Dst":"https://mlnet6358200191.blob.core.windows.net/azureml-blobstore-1e85adf5-e15a-4501-bf92-a2bb126227e9/vott-json-export/184682652_c927a49226_m.jpg","IsFolderProperties":false,"TransferStatus":"SkippedEntityAlreadyExists","ErrorCode":"0"},{"Src":"\\\\?\\C:\\Users\\ArafatTehsin\\Downloads\\flower_photos\\flower_photos\\flower_photos\\data\\11642632_1e7627a2cc.jpg","Dst":"https://mlnet6358200191.blob.core.windows.net/azureml-blobstore-1e85adf5-e15a-4501-bf92-a2bb126227e9/vott-json-export/11642632_1e7627a2cc.jpg","IsFolderProperties":false,"TransferStatus":"SkippedEntityAlreadyExists","ErrorCode":"0"},{"Src":"\\\\?\\C:\\Users\\ArafatTehsin\\Downloads\\flower_photos\\flower_photos\\flower_photos\\data\\5794839_200acd910c_n.jpg","Dst":"https://mlnet6358200191.blob.core.windows.net/azureml-blobstore-1e85adf5-e15a-4501-bf92-a2bb126227e9/vott-json-export/5794839_200acd910c_n.jpg","IsFolderProperties":false,"TransferStatus":"SkippedEntityAlreadyExists","ErrorCode":"0"},{"Src":"\\\\?\\C:\\Users\\ArafatTehsin\\Downloads\\flower_photos\\flower_photos\\flower_photos\\data\\568715474_bdb64ccc32.jpg","Dst":"https://mlnet6358200191.blob.core.windows.net/azureml-blobstore-1e85adf5-e15a-4501-bf92-a2bb126227e9/vott-json-export/568715474_bdb64ccc32.jpg","IsFolderProperties":false,"TransferStatus":"SkippedEntityAlreadyExists","ErrorCode":"0"},{"Src":"\\\\?\\C:\\Users\\ArafatTehsin\\Downloads\\flower_photos\\flower_photos\\flower_photos\\data\\160954292_6c2b4fda65_n.jpg","Dst":"https://mlnet6358200191.blob.core.windows.net/azureml-blobstore-1e85adf5-e15a-4501-bf92-a2bb126227e9/vott-json-export/160954292_6c2b4fda65_n.jpg","IsFolderProperties":false,"TransferStatus":"SkippedEntityAlreadyExists","ErrorCode":"0"},{"Src":"\\\\?\\C:\\Users\\ArafatTehsin\\Downloads\\flower_photos\\flower_photos\\flower_photos\\data\\25360380_1a881a5648.jpg","Dst":"https://mlnet6358200191.blob.core.windows.net/azureml-blobstore-1e85adf5-e15a-4501-bf92-a2bb126227e9/vott-json-export/25360380_1a881a5648.jpg","IsFolderProperties":false,"TransferStatus":"SkippedEntityAlreadyExists","ErrorCode":"0"},{"Src":"\\\\?\\C:\\Users\\ArafatTehsin\\Downloads\\flower_photos\\flower_photos\\flower_photos\\data\\295257304_de893fc94d.jpg","Dst":"https://mlnet6358200191.blob.core.windows.net/azureml-blobstore-1e85adf5-e15a-4501-bf92-a2bb126227e9/vott-json-export/295257304_de893fc94d.jpg","IsFolderProperties":false,"TransferStatus":"SkippedEntityAlreadyExists","ErrorCode":"0"},{"Src":"\\\\?\\C:\\Users\\ArafatTehsin\\Downloads\\flower_photos\\flower_photos\\flower_photos\\data\\145303599_2627e23815_n.jpg","Dst":"https://mlnet6358200191.blob.core.windows.net/azureml-blobstore-1e85adf5-e15a-4501-bf92-a2bb126227e9/vott-json-export/145303599_2627e23815_n.jpg","IsFolderProperties":false,"TransferStatus":"SkippedEntityAlreadyExists","ErrorCode":"0"},{"Src":"\\\\?\\C:\\Users\\ArafatTehsin\\Downloads\\flower_photos\\flower_photos\\flower_photos\\data\\5794839_200acd910c_n.jpg","Dst":"https://mlnet6358200191.blob.core.windows.net/azureml-blobstore-1e85adf5-e15a-4501-bf92-a2bb126227e9/vott-json-export/5794839_200acd910c_n.jpg","IsFolderProperties":false,"TransferStatus":"SkippedEntityAlreadyExists","ErrorCode":"0"},{"Src":"\\\\?\\C:\\Users\\ArafatTehsin\\Downloads\\flower_photos\\flower_photos\\flower_photos\\data\\5794839_200acd910c_n.jpg","Dst":"https://mlnet6358200191.blob.core.windows.net/azureml-blobstore-1e85adf5-e15a-4501-bf92-a2bb126227e9/vott-json-export/5794839_200acd910c_n.jpg","IsFolderProperties":false,"TransferStatus":"SkippedEntityAlreadyExists","ErrorCode":"0"},{"Src":"\\\\?\\C:\\Users\\ArafatTehsin\\Downloads\\flower_photos\\flower_photos\\flower_photos\\data\\184682652_c927a49226_m.jpg","Dst":"https://mlnet6358200191.blob.core.windows.net/azureml-blobstore-1e85adf5-e15a-4501-bf92-a2bb126227e9/vott-json-export/184682652_c927a49226_m.jpg","IsFolderProperties":false,"TransferStatus":"SkippedEntityAlreadyExists","ErrorCode":"0"},{"Src":"\\\\?\\C:\\Users\\ArafatTehsin\\Downloads\\flower_photos\\flower_photos\\flower_photos\\data\\175638423_058c07afb9.jpg","Dst":"https://mlnet6358200191.blob.core.windows.net/azureml-blobstore-1e85adf5-e15a-4501-bf92-a2bb126227e9/vott-json-export/175638423_058c07afb9.jpg","IsFolderProperties":false,"TransferStatus":"SkippedEntityAlreadyExists","ErrorCode":"0"},{"Src":"\\\\?\\C:\\Users\\ArafatTehsin\\Downloads\\flower_photos\\flower_photos\\flower_photos\\data\\40410814_fba3837226_n.jpg","Dst":"https://mlnet6358200191.blob.core.windows.net/azureml-blobstore-1e85adf5-e15a-4501-bf92-a2bb126227e9/vott-json-export/40410814_fba3837226_n.jpg","IsFolderProperties":false,"TransferStatus":"SkippedEntityAlreadyExists","ErrorCode":"0"},{"Src":"\\\\?\\C:\\Users\\ArafatTehsin\\Downloads\\flower_photos\\flower_photos\\flower_photos\\data\\295257304_de893fc94d.jpg","Dst":"https://mlnet6358200191.blob.core.windows.net/azureml-blobstore-1e85adf5-e15a-4501-bf92-a2bb126227e9/vott-json-export/295257304_de893fc94d.jpg","IsFolderProperties":false,"TransferStatus":"SkippedEntityAlreadyExists","ErrorCode":"0"},{"Src":"\\\\?\\C:\\Users\\ArafatTehsin\\Downloads\\flower_photos\\flower_photos\\flower_photos\\data\\145303599_2627e23815_n.jpg","Dst":"https://mlnet6358200191.blob.core.windows.net/azureml-blobstore-1e85adf5-e15a-4501-bf92-a2bb126227e9/vott-json-export/145303599_2627e23815_n.jpg","IsFolderProperties":false,"TransferStatus":"SkippedEntityAlreadyExists","ErrorCode":"0"},{"Src":"\\\\?\\C:\\Users\\ArafatTehsin\\Downloads\\flower_photos\\flower_photos\\flower_photos\\data\\15207766_fc2f1d692c_n.jpg","Dst":"https://mlnet6358200191.blob.core.windows.net/azureml-blobstore-1e85adf5-e15a-4501-bf92-a2bb126227e9/vott-json-export/15207766_fc2f1d692c_n.jpg","IsFolderProperties":false,"TransferStatus":"SkippedEntityAlreadyExists","ErrorCode":"0"},{"Src":"\\\\?\\C:\\Users\\ArafatTehsin\\Downloads\\flower_photos\\flower_photos\\flower_photos\\data\\58636535_bc53ef0a21_m.jpg","Dst":"https://mlnet6358200191.blob.core.windows.net/azureml-blobstore-1e85adf5-e15a-4501-bf92-a2bb126227e9/vott-json-export/58636535_bc53ef0a21_m.jpg","IsFolderProperties":false,"TransferStatus":"SkippedEntityAlreadyExists","ErrorCode":"0"},{"Src":"\\\\?\\C:\\Users\\ArafatTehsin\\Downloads\\flower_photos\\flower_photos\\flower_photos\\data\\25360380_1a881a5648.jpg","Dst":"https://mlnet6358200191.blob.core.windows.net/azureml-blobstore-1e85adf5-e15a-4501-bf92-a2bb126227e9/vott-json-export/25360380_1a881a5648.jpg","IsFolderProperties":false,"TransferStatus":"SkippedEntityAlreadyExists","ErrorCode":"0"},{"Src":"\\\\?\\C:\\Users\\ArafatTehsin\\Downloads\\flower_photos\\flower_photos\\flower_photos\\data\\298670754_f25edda891.jpg","Dst":"https://mlnet6358200191.blob.core.windows.net/azureml-blobstore-1e85adf5-e15a-4501-bf92-a2bb126227e9/vott-json-export/298670754_f25edda891.jpg","IsFolderProperties":false,"TransferStatus":"SkippedEntityAlreadyExists","ErrorCode":"0"}],"PerfConstraint":0,"PerformanceAdvice":[],"IsCleanupJob":false} (Microsoft.ML.ModelBuilder.Utils.Logger.Debug) 2020-09-14 00:06:00.7518 INFO Completed... Total Transfers: 31, Transfers Completed: 0, Transfers Skipped: 31, Transfers Failed: 0 (Microsoft.ML.ModelBuilder.Utils.Logger.Info) 2020-09-14 00:06:00.7978 DEBUG Info (Microsoft.ML.ModelBuilder.Utils.Logger.Debug) 2020-09-14 00:06:00.7978 DEBUG INFO: Scanning... (Microsoft.ML.ModelBuilder.Utils.Logger.Debug) 2020-09-14 00:06:00.7978 DEBUG Info (Microsoft.ML.ModelBuilder.Utils.Logger.Debug) 2020-09-14 00:06:00.7978 DEBUG INFO: Any empty folders will not be processed, because source and/or destination doesn't have full folder support (Microsoft.ML.ModelBuilder.Utils.Logger.Debug) 2020-09-14 00:06:00.8138 DEBUG Init (Microsoft.ML.ModelBuilder.Utils.Logger.Debug) 2020-09-14 00:06:00.8138 DEBUG {"LogFileLocation":"C:\\Users\\ArafatTehsin\\.azcopy\\cefa2a24-5164-9941-558c-58f293b6c3e7.log","JobID":"cefa2a24-5164-9941-558c-58f293b6c3e7","IsCleanupJob":false} (Microsoft.ML.ModelBuilder.Utils.Logger.Debug) 2020-09-14 00:06:00.8138 DEBUG Progress (Microsoft.ML.ModelBuilder.Utils.Logger.Debug) 2020-09-14 00:06:00.8138 DEBUG {"ErrorMsg":"","ActiveConnections":"0","CompleteJobOrdered":true,"JobStatus":"InProgress","TotalTransfers":"1","FileTransfers":"1","FolderPropertyTransfers":"0","TransfersCompleted":"0","TransfersFailed":"0","TransfersSkipped":"0","BytesOverWire":"0","TotalBytesTransferred":"0","TotalBytesEnumerated":"7853","TotalBytesExpected":"7853","PercentComplete":"0","AverageIOPS":"0","AverageE2EMilliseconds":"0","ServerBusyPercentage":"0","NetworkErrorPercentage":"0","FailedTransfers":[],"SkippedTransfers":null,"PerfConstraint":0,"PerformanceAdvice":null,"IsCleanupJob":false} (Microsoft.ML.ModelBuilder.Utils.Logger.Debug) 2020-09-14 00:06:00.8138 INFO Uploading... Total Transfers: 1, Transfers Completed: 0, Transfers Skipped: 0, Transfers Failed: 0 (Microsoft.ML.ModelBuilder.Utils.Logger.Info) 2020-09-14 00:06:01.9559 DEBUG Info (Microsoft.ML.ModelBuilder.Utils.Logger.Debug) 2020-09-14 00:06:01.9559 DEBUG INFO: azcopy.exe: A newer version 10.6.0 is available to download (Microsoft.ML.ModelBuilder.Utils.Logger.Debug) 2020-09-14 00:06:02.8168 DEBUG EndOfJob (Microsoft.ML.ModelBuilder.Utils.Logger.Debug) 2020-09-14 00:06:02.8168 DEBUG {"ErrorMsg":"","ActiveConnections":"0","CompleteJobOrdered":true,"JobStatus":"Completed","TotalTransfers":"1","FileTransfers":"1","FolderPropertyTransfers":"0","TransfersCompleted":"1","TransfersFailed":"0","TransfersSkipped":"0","BytesOverWire":"7853","TotalBytesTransferred":"7853","TotalBytesEnumerated":"7853","TotalBytesExpected":"7853","PercentComplete":"100","AverageIOPS":"0","AverageE2EMilliseconds":"58","ServerBusyPercentage":"0","NetworkErrorPercentage":"0","FailedTransfers":[],"SkippedTransfers":null,"PerfConstraint":0,"PerformanceAdvice":[],"IsCleanupJob":false} (Microsoft.ML.ModelBuilder.Utils.Logger.Debug) 2020-09-14 00:06:02.8168 INFO Completed... Total Transfers: 1, Transfers Completed: 1, Transfers Skipped: 0, Transfers Failed: 0 (Microsoft.ML.ModelBuilder.Utils.Logger.Info) 2020-09-14 00:06:02.8308 DEBUG Disposing AutoMLService Client (Microsoft.ML.ModelBuilder.Utils.Logger.Debug) 2020-09-14 00:06:03.6466 INFO Verifying parameters: workspace.. (Microsoft.ML.ModelBuilder.Utils.Logger.Info) 2020-09-14 00:06:04.1366 INFO Ok, experiment.. (Microsoft.ML.ModelBuilder.Utils.Logger.Info) 2020-09-14 00:06:04.4278 INFO Ok, compute target.. (Microsoft.ML.ModelBuilder.Utils.Logger.Info) 2020-09-14 00:06:05.1466 INFO One or more errors occurred. (Microsoft.ML.ModelBuilder.Utils.Logger.Info) 2020-09-14 00:06:05.2166 DEBUG Disposing AutoMLService Client (Microsoft.ML.ModelBuilder.Utils.Logger.Debug) 2020-09-14 00:06:05.2166 DEBUG One or more errors occurred. at System.Threading.Tasks.Task1.GetResultCore(Boolean waitCompletionNotification)
at Azure.MachineLearning.Services.Compute.ComputeTargetPageFetcher.FetchNextPage() in //src/Microsoft.ML.AzureMLClient/Compute/ComputeTargetPageFetcher.cs:line 35
at Azure.MachineLearning.Services.LazyEnumerator1.<GetEnumerator>d__9.MoveNext() in /_/src/Microsoft.ML.AzureMLClient/LazyEnumerator.cs:line 26 at System.Linq.Enumerable.WhereEnumerableIterator1.MoveNext()
at System.Linq.Enumerable.FirstOrDefault[TSource](IEnumerable1 source) at AzureML.AutoMLRunnerImages.<RunAutoMLAsync>d__27.MoveNext() in /_/src/Microsoft.ML.ModelBuilder.AutoMLService/RemoteAutoML/AutoMLRunnerImages.cs:line 237 --- End of stack trace from previous location where exception was thrown --- at System.Runtime.ExceptionServices.ExceptionDispatchInfo.Throw() at System.Runtime.CompilerServices.TaskAwaiter.HandleNonSuccessAndDebuggerNotification(Task task) at Microsoft.ML.ModelBuilder.AutoMLService.Experiments.AzureImageClassificationExperiment.<ExecuteAsync>d__13.MoveNext() in /_/src/Microsoft.ML.ModelBuilder.AutoMLService/Experiments/AzureImageClassificationExperiment.cs:line 69 --- End of stack trace from previous location where exception was thrown --- at System.Runtime.ExceptionServices.ExceptionDispatchInfo.Throw() at System.Runtime.CompilerServices.TaskAwaiter.HandleNonSuccessAndDebuggerNotification(Task task) at Microsoft.ML.ModelBuilder.AutoMLEngine.<StartTrainingAsync>d__26.MoveNext() in /_/src/Microsoft.ML.ModelBuilder.AutoMLService/AutoMLEngineService/AutoMLEngine.cs:line 134 (Microsoft.ML.ModelBuilder.Utils.Logger.Debug) 2020-09-14 00:06:20.0545 DEBUG Open Log FileC:\Users\ArafatTehsin\AppData\Local\Temp\MLVSTools\logs\586f1204-3d6d-422e-8981-f35a6848f6c4.txt (Microsoft.ML.ModelBuilder.Utils.Logger.Debug) 2020-09-14 00:32:49.8240 DEBUG Disposing AutoMLService Client (Microsoft.ML.ModelBuilder.Utils.Logger.Debug) 2020-09-14 00:32:49.8430 DEBUG start uploading files.... (Microsoft.ML.ModelBuilder.Utils.Logger.Debug) 2020-09-14 00:32:49.9010 DEBUG Info (Microsoft.ML.ModelBuilder.Utils.Logger.Debug) 2020-09-14 00:32:49.9010 DEBUG INFO: Scanning... (Microsoft.ML.ModelBuilder.Utils.Logger.Debug) 2020-09-14 00:32:49.9040 DEBUG Info (Microsoft.ML.ModelBuilder.Utils.Logger.Debug) 2020-09-14 00:32:49.9040 DEBUG INFO: Any empty folders will not be processed, because source and/or destination doesn't have full folder support (Microsoft.ML.ModelBuilder.Utils.Logger.Debug) 2020-09-14 00:32:49.9040 DEBUG Init (Microsoft.ML.ModelBuilder.Utils.Logger.Debug) 2020-09-14 00:32:49.9040 DEBUG Progress (Microsoft.ML.ModelBuilder.Utils.Logger.Debug) 2020-09-14 00:32:49.9040 DEBUG {"LogFileLocation":"C:\\Users\\ArafatTehsin\\.azcopy\\c69f4094-bd83-d14c-627f-f7064f101a98.log","JobID":"c69f4094-bd83-d14c-627f-f7064f101a98","IsCleanupJob":false} (Microsoft.ML.ModelBuilder.Utils.Logger.Debug) 2020-09-14 00:32:49.9040 DEBUG {"ErrorMsg":"","ActiveConnections":"0","CompleteJobOrdered":true,"JobStatus":"InProgress","TotalTransfers":"31","FileTransfers":"31","FolderPropertyTransfers":"0","TransfersCompleted":"0","TransfersFailed":"0","TransfersSkipped":"0","BytesOverWire":"0","TotalBytesTransferred":"0","TotalBytesEnumerated":"1804234","TotalBytesExpected":"1804234","PercentComplete":"0","AverageIOPS":"0","AverageE2EMilliseconds":"0","ServerBusyPercentage":"0","NetworkErrorPercentage":"0","FailedTransfers":[],"SkippedTransfers":null,"PerfConstraint":0,"PerformanceAdvice":null,"IsCleanupJob":false} (Microsoft.ML.ModelBuilder.Utils.Logger.Debug) 2020-09-14 00:32:49.9200 INFO Uploading... Total Transfers: 31, Transfers Completed: 0, Transfers Skipped: 0, Transfers Failed: 0 (Microsoft.ML.ModelBuilder.Utils.Logger.Info) 2020-09-14 00:32:50.9623 DEBUG Info (Microsoft.ML.ModelBuilder.Utils.Logger.Debug) 2020-09-14 00:32:50.9623 DEBUG INFO: azcopy.exe: A newer version 10.6.0 is available to download (Microsoft.ML.ModelBuilder.Utils.Logger.Debug) 2020-09-14 00:32:51.9224 DEBUG EndOfJob (Microsoft.ML.ModelBuilder.Utils.Logger.Debug) 2020-09-14 00:32:51.9224 DEBUG {"ErrorMsg":"","ActiveConnections":"0","CompleteJobOrdered":true,"JobStatus":"CompletedWithSkipped","TotalTransfers":"31","FileTransfers":"31","FolderPropertyTransfers":"0","TransfersCompleted":"0","TransfersFailed":"0","TransfersSkipped":"31","BytesOverWire":"0","TotalBytesTransferred":"0","TotalBytesEnumerated":"1804234","TotalBytesExpected":"0","PercentComplete":"100","AverageIOPS":"10","AverageE2EMilliseconds":"264","ServerBusyPercentage":"0","NetworkErrorPercentage":"0","FailedTransfers":[],"SkippedTransfers":[{"Src":"\\\\?\\C:\\Users\\ArafatTehsin\\Downloads\\flower_photos\\flower_photos\\flower_photos\\data\\494803274_f84f21d53a.jpg","Dst":"https://mlnet6358200191.blob.core.windows.net/azureml-blobstore-1e85adf5-e15a-4501-bf92-a2bb126227e9/vott-json-export/494803274_f84f21d53a.jpg","IsFolderProperties":false,"TransferStatus":"SkippedEntityAlreadyExists","ErrorCode":"0"},{"Src":"\\\\?\\C:\\Users\\ArafatTehsin\\Downloads\\flower_photos\\flower_photos\\flower_photos\\data\\145303599_2627e23815_n.jpg","Dst":"https://mlnet6358200191.blob.core.windows.net/azureml-blobstore-1e85adf5-e15a-4501-bf92-a2bb126227e9/vott-json-export/145303599_2627e23815_n.jpg","IsFolderProperties":false,"TransferStatus":"SkippedEntityAlreadyExists","ErrorCode":"0"},{"Src":"\\\\?\\C:\\Users\\ArafatTehsin\\Downloads\\flower_photos\\flower_photos\\flower_photos\\data\\21652746_cc379e0eea_m.jpg","Dst":"https://mlnet6358200191.blob.core.windows.net/azureml-blobstore-1e85adf5-e15a-4501-bf92-a2bb126227e9/vott-json-export/21652746_cc379e0eea_m.jpg","IsFolderProperties":false,"TransferStatus":"SkippedEntityAlreadyExists","ErrorCode":"0"},{"Src":"\\\\?\\C:\\Users\\ArafatTehsin\\Downloads\\flower_photos\\flower_photos\\flower_photos\\data\\5794839_200acd910c_n.jpg","Dst":"https://mlnet6358200191.blob.core.windows.net/azureml-blobstore-1e85adf5-e15a-4501-bf92-a2bb126227e9/vott-json-export/5794839_200acd910c_n.jpg","IsFolderProperties":false,"TransferStatus":"SkippedEntityAlreadyExists","ErrorCode":"0"},{"Src":"\\\\?\\C:\\Users\\ArafatTehsin\\Downloads\\flower_photos\\flower_photos\\flower_photos\\data\\184682652_c927a49226_m.jpg","Dst":"https://mlnet6358200191.blob.core.windows.net/azureml-blobstore-1e85adf5-e15a-4501-bf92-a2bb126227e9/vott-json-export/184682652_c927a49226_m.jpg","IsFolderProperties":false,"TransferStatus":"SkippedEntityAlreadyExists","ErrorCode":"0"},{"Src":"\\\\?\\C:\\Users\\ArafatTehsin\\Downloads\\flower_photos\\flower_photos\\flower_photos\\data\\134409839_71069a95d1_m.jpg","Dst":"https://mlnet6358200191.blob.core.windows.net/azureml-blobstore-1e85adf5-e15a-4501-bf92-a2bb126227e9/vott-json-export/134409839_71069a95d1_m.jpg","IsFolderProperties":false,"TransferStatus":"SkippedEntityAlreadyExists","ErrorCode":"0"},{"Src":"\\\\?\\C:\\Users\\ArafatTehsin\\Downloads\\flower_photos\\flower_photos\\flower_photos\\data\\323872063_7264e7e018_m.jpg","Dst":"https://mlnet6358200191.blob.core.windows.net/azureml-blobstore-1e85adf5-e15a-4501-bf92-a2bb126227e9/vott-json-export/323872063_7264e7e018_m.jpg","IsFolderProperties":false,"TransferStatus":"SkippedEntityAlreadyExists","ErrorCode":"0"},{"Src":"\\\\?\\C:\\Users\\ArafatTehsin\\Downloads\\flower_photos\\flower_photos\\flower_photos\\data\\568715474_bdb64ccc32.jpg","Dst":"https://mlnet6358200191.blob.core.windows.net/azureml-blobstore-1e85adf5-e15a-4501-bf92-a2bb126227e9/vott-json-export/568715474_bdb64ccc32.jpg","IsFolderProperties":false,"TransferStatus":"SkippedEntityAlreadyExists","ErrorCode":"0"},{"Src":"\\\\?\\C:\\Users\\ArafatTehsin\\Downloads\\flower_photos\\flower_photos\\flower_photos\\data\\43474673_7bb4465a86.jpg","Dst":"https://mlnet6358200191.blob.core.windows.net/azureml-blobstore-1e85adf5-e15a-4501-bf92-a2bb126227e9/vott-json-export/43474673_7bb4465a86.jpg","IsFolderProperties":false,"TransferStatus":"SkippedEntityAlreadyExists","ErrorCode":"0"},{"Src":"\\\\?\\C:\\Users\\ArafatTehsin\\Downloads\\flower_photos\\flower_photos\\flower_photos\\data\\40410814_fba3837226_n.jpg","Dst":"https://mlnet6358200191.blob.core.windows.net/azureml-blobstore-1e85adf5-e15a-4501-bf92-a2bb126227e9/vott-json-export/40410814_fba3837226_n.jpg","IsFolderProperties":false,"TransferStatus":"SkippedEntityAlreadyExists","ErrorCode":"0"},{"Src":"\\\\?\\C:\\Users\\ArafatTehsin\\Downloads\\flower_photos\\flower_photos\\flower_photos\\data\\159079265_d77a9ac920_n.jpg","Dst":"https://mlnet6358200191.blob.core.windows.net/azureml-blobstore-1e85adf5-e15a-4501-bf92-a2bb126227e9/vott-json-export/159079265_d77a9ac920_n.jpg","IsFolderProperties":false,"TransferStatus":"SkippedEntityAlreadyExists","ErrorCode":"0"},{"Src":"\\\\?\\C:\\Users\\ArafatTehsin\\Downloads\\flower_photos\\flower_photos\\flower_photos\\data\\5794839_200acd910c_n.jpg","Dst":"https://mlnet6358200191.blob.core.windows.net/azureml-blobstore-1e85adf5-e15a-4501-bf92-a2bb126227e9/vott-json-export/5794839_200acd910c_n.jpg","IsFolderProperties":false,"TransferStatus":"SkippedEntityAlreadyExists","ErrorCode":"0"},{"Src":"\\\\?\\C:\\Users\\ArafatTehsin\\Downloads\\flower_photos\\flower_photos\\flower_photos\\data\\25360380_1a881a5648.jpg","Dst":"https://mlnet6358200191.blob.core.windows.net/azureml-blobstore-1e85adf5-e15a-4501-bf92-a2bb126227e9/vott-json-export/25360380_1a881a5648.jpg","IsFolderProperties":false,"TransferStatus":"SkippedEntityAlreadyExists","ErrorCode":"0"},{"Src":"\\\\?\\C:\\Users\\ArafatTehsin\\Downloads\\flower_photos\\flower_photos\\flower_photos\\data\\175638423_058c07afb9.jpg","Dst":"https://mlnet6358200191.blob.core.windows.net/azureml-blobstore-1e85adf5-e15a-4501-bf92-a2bb126227e9/vott-json-export/175638423_058c07afb9.jpg","IsFolderProperties":false,"TransferStatus":"SkippedEntityAlreadyExists","ErrorCode":"0"},{"Src":"\\\\?\\C:\\Users\\ArafatTehsin\\Downloads\\flower_photos\\flower_photos\\flower_photos\\data\\15207766_fc2f1d692c_n.jpg","Dst":"https://mlnet6358200191.blob.core.windows.net/azureml-blobstore-1e85adf5-e15a-4501-bf92-a2bb126227e9/vott-json-export/15207766_fc2f1d692c_n.jpg","IsFolderProperties":false,"TransferStatus":"SkippedEntityAlreadyExists","ErrorCode":"0"},{"Src":"\\\\?\\C:\\Users\\ArafatTehsin\\Downloads\\flower_photos\\flower_photos\\flower_photos\\data\\25360380_1a881a5648.jpg","Dst":"https://mlnet6358200191.blob.core.windows.net/azureml-blobstore-1e85adf5-e15a-4501-bf92-a2bb126227e9/vott-json-export/25360380_1a881a5648.jpg","IsFolderProperties":false,"TransferStatus":"SkippedEntityAlreadyExists","ErrorCode":"0"},{"Src":"\\\\?\\C:\\Users\\ArafatTehsin\\Downloads\\flower_photos\\flower_photos\\flower_photos\\data\\184682920_97ae41ce60_m.jpg","Dst":"https://mlnet6358200191.blob.core.windows.net/azureml-blobstore-1e85adf5-e15a-4501-bf92-a2bb126227e9/vott-json-export/184682920_97ae41ce60_m.jpg","IsFolderProperties":false,"TransferStatus":"SkippedEntityAlreadyExists","ErrorCode":"0"},{"Src":"\\\\?\\C:\\Users\\ArafatTehsin\\Downloads\\flower_photos\\flower_photos\\flower_photos\\data\\568715474_bdb64ccc32.jpg","Dst":"https://mlnet6358200191.blob.core.windows.net/azureml-blobstore-1e85adf5-e15a-4501-bf92-a2bb126227e9/vott-json-export/568715474_bdb64ccc32.jpg","IsFolderProperties":false,"TransferStatus":"SkippedEntityAlreadyExists","ErrorCode":"0"},{"Src":"\\\\?\\C:\\Users\\ArafatTehsin\\Downloads\\flower_photos\\flower_photos\\flower_photos\\data\\160954292_6c2b4fda65_n.jpg","Dst":"https://mlnet6358200191.blob.core.windows.net/azureml-blobstore-1e85adf5-e15a-4501-bf92-a2bb126227e9/vott-json-export/160954292_6c2b4fda65_n.jpg","IsFolderProperties":false,"TransferStatus":"SkippedEntityAlreadyExists","ErrorCode":"0"},{"Src":"\\\\?\\C:\\Users\\ArafatTehsin\\Downloads\\flower_photos\\flower_photos\\flower_photos\\data\\58636535_bc53ef0a21_m.jpg","Dst":"https://mlnet6358200191.blob.core.windows.net/azureml-blobstore-1e85adf5-e15a-4501-bf92-a2bb126227e9/vott-json-export/58636535_bc53ef0a21_m.jpg","IsFolderProperties":false,"TransferStatus":"SkippedEntityAlreadyExists","ErrorCode":"0"},{"Src":"\\\\?\\C:\\Users\\ArafatTehsin\\Downloads\\flower_photos\\flower_photos\\flower_photos\\data\\295257304_de893fc94d.jpg","Dst":"https://mlnet6358200191.blob.core.windows.net/azureml-blobstore-1e85adf5-e15a-4501-bf92-a2bb126227e9/vott-json-export/295257304_de893fc94d.jpg","IsFolderProperties":false,"TransferStatus":"SkippedEntityAlreadyExists","ErrorCode":"0"},{"Src":"\\\\?\\C:\\Users\\ArafatTehsin\\Downloads\\flower_photos\\flower_photos\\flower_photos\\data\\184682652_c927a49226_m.jpg","Dst":"https://mlnet6358200191.blob.core.windows.net/azureml-blobstore-1e85adf5-e15a-4501-bf92-a2bb126227e9/vott-json-export/184682652_c927a49226_m.jpg","IsFolderProperties":false,"TransferStatus":"SkippedEntityAlreadyExists","ErrorCode":"0"},{"Src":"\\\\?\\C:\\Users\\ArafatTehsin\\Downloads\\flower_photos\\flower_photos\\flower_photos\\data\\5794835_d15905c7c8_n.jpg","Dst":"https://mlnet6358200191.blob.core.windows.net/azureml-blobstore-1e85adf5-e15a-4501-bf92-a2bb126227e9/vott-json-export/5794835_d15905c7c8_n.jpg","IsFolderProperties":false,"TransferStatus":"SkippedEntityAlreadyExists","ErrorCode":"0"},{"Src":"\\\\?\\C:\\Users\\ArafatTehsin\\Downloads\\flower_photos\\flower_photos\\flower_photos\\data\\5794839_200acd910c_n.jpg","Dst":"https://mlnet6358200191.blob.core.windows.net/azureml-blobstore-1e85adf5-e15a-4501-bf92-a2bb126227e9/vott-json-export/5794839_200acd910c_n.jpg","IsFolderProperties":false,"TransferStatus":"SkippedEntityAlreadyExists","ErrorCode":"0"},{"Src":"\\\\?\\C:\\Users\\ArafatTehsin\\Downloads\\flower_photos\\flower_photos\\flower_photos\\data\\298670754_f25edda891.jpg","Dst":"https://mlnet6358200191.blob.core.windows.net/azureml-blobstore-1e85adf5-e15a-4501-bf92-a2bb126227e9/vott-json-export/298670754_f25edda891.jpg","IsFolderProperties":false,"TransferStatus":"SkippedEntityAlreadyExists","ErrorCode":"0"},{"Src":"\\\\?\\C:\\Users\\ArafatTehsin\\Downloads\\flower_photos\\flower_photos\\flower_photos\\data\\184682652_c927a49226_m.jpg","Dst":"https://mlnet6358200191.blob.core.windows.net/azureml-blobstore-1e85adf5-e15a-4501-bf92-a2bb126227e9/vott-json-export/184682652_c927a49226_m.jpg","IsFolderProperties":false,"TransferStatus":"SkippedEntityAlreadyExists","ErrorCode":"0"},{"Src":"\\\\?\\C:\\Users\\ArafatTehsin\\Downloads\\flower_photos\\flower_photos\\flower_photos\\data\\568715474_bdb64ccc32.jpg","Dst":"https://mlnet6358200191.blob.core.windows.net/azureml-blobstore-1e85adf5-e15a-4501-bf92-a2bb126227e9/vott-json-export/568715474_bdb64ccc32.jpg","IsFolderProperties":false,"TransferStatus":"SkippedEntityAlreadyExists","ErrorCode":"0"},{"Src":"\\\\?\\C:\\Users\\ArafatTehsin\\Downloads\\flower_photos\\flower_photos\\flower_photos\\data\\11642632_1e7627a2cc.jpg","Dst":"https://mlnet6358200191.blob.core.windows.net/azureml-blobstore-1e85adf5-e15a-4501-bf92-a2bb126227e9/vott-json-export/11642632_1e7627a2cc.jpg","IsFolderProperties":false,"TransferStatus":"SkippedEntityAlreadyExists","ErrorCode":"0"},{"Src":"\\\\?\\C:\\Users\\ArafatTehsin\\Downloads\\flower_photos\\flower_photos\\flower_photos\\data\\145303599_2627e23815_n.jpg","Dst":"https://mlnet6358200191.blob.core.windows.net/azureml-blobstore-1e85adf5-e15a-4501-bf92-a2bb126227e9/vott-json-export/145303599_2627e23815_n.jpg","IsFolderProperties":false,"TransferStatus":"SkippedEntityAlreadyExists","ErrorCode":"0"},{"Src":"\\\\?\\C:\\Users\\ArafatTehsin\\Downloads\\flower_photos\\flower_photos\\flower_photos\\data\\295257304_de893fc94d.jpg","Dst":"https://mlnet6358200191.blob.core.windows.net/azureml-blobstore-1e85adf5-e15a-4501-bf92-a2bb126227e9/vott-json-export/295257304_de893fc94d.jpg","IsFolderProperties":false,"TransferStatus":"SkippedEntityAlreadyExists","ErrorCode":"0"},{"Src":"\\\\?\\C:\\Users\\ArafatTehsin\\Downloads\\flower_photos\\flower_photos\\flower_photos\\data\\118974357_0faa23cce9_n.jpg","Dst":"https://mlnet6358200191.blob.core.windows.net/azureml-blobstore-1e85adf5-e15a-4501-bf92-a2bb126227e9/vott-json-export/118974357_0faa23cce9_n.jpg","IsFolderProperties":false,"TransferStatus":"SkippedEntityAlreadyExists","ErrorCode":"0"}],"PerfConstraint":0,"PerformanceAdvice":[],"IsCleanupJob":false} (Microsoft.ML.ModelBuilder.Utils.Logger.Debug) 2020-09-14 00:32:51.9224 INFO Completed... Total Transfers: 31, Transfers Completed: 0, Transfers Skipped: 31, Transfers Failed: 0 (Microsoft.ML.ModelBuilder.Utils.Logger.Info) 2020-09-14 00:32:51.9774 DEBUG Info (Microsoft.ML.ModelBuilder.Utils.Logger.Debug) 2020-09-14 00:32:51.9774 DEBUG INFO: Scanning... (Microsoft.ML.ModelBuilder.Utils.Logger.Debug) 2020-09-14 00:32:51.9774 DEBUG Info (Microsoft.ML.ModelBuilder.Utils.Logger.Debug) 2020-09-14 00:32:51.9774 DEBUG INFO: Any empty folders will not be processed, because source and/or destination doesn't have full folder support (Microsoft.ML.ModelBuilder.Utils.Logger.Debug) 2020-09-14 00:32:51.9874 DEBUG Init (Microsoft.ML.ModelBuilder.Utils.Logger.Debug) 2020-09-14 00:32:51.9874 DEBUG {"LogFileLocation":"C:\\Users\\ArafatTehsin\\.azcopy\\326608b9-c6d5-7341-5ae5-846f6af74537.log","JobID":"326608b9-c6d5-7341-5ae5-846f6af74537","IsCleanupJob":false} (Microsoft.ML.ModelBuilder.Utils.Logger.Debug) 2020-09-14 00:32:51.9874 DEBUG Progress (Microsoft.ML.ModelBuilder.Utils.Logger.Debug) 2020-09-14 00:32:51.9874 DEBUG {"ErrorMsg":"","ActiveConnections":"0","CompleteJobOrdered":true,"JobStatus":"InProgress","TotalTransfers":"1","FileTransfers":"1","FolderPropertyTransfers":"0","TransfersCompleted":"0","TransfersFailed":"0","TransfersSkipped":"0","BytesOverWire":"0","TotalBytesTransferred":"0","TotalBytesEnumerated":"7853","TotalBytesExpected":"7853","PercentComplete":"0","AverageIOPS":"0","AverageE2EMilliseconds":"0","ServerBusyPercentage":"0","NetworkErrorPercentage":"0","FailedTransfers":[],"SkippedTransfers":null,"PerfConstraint":0,"PerformanceAdvice":null,"IsCleanupJob":false} (Microsoft.ML.ModelBuilder.Utils.Logger.Debug) 2020-09-14 00:32:51.9874 INFO Uploading... Total Transfers: 1, Transfers Completed: 0, Transfers Skipped: 0, Transfers Failed: 0 (Microsoft.ML.ModelBuilder.Utils.Logger.Info) 2020-09-14 00:32:52.9996 DEBUG Info (Microsoft.ML.ModelBuilder.Utils.Logger.Debug) 2020-09-14 00:32:52.9996 DEBUG INFO: azcopy.exe: A newer version 10.6.0 is available to download (Microsoft.ML.ModelBuilder.Utils.Logger.Debug) 2020-09-14 00:32:53.9885 DEBUG EndOfJob (Microsoft.ML.ModelBuilder.Utils.Logger.Debug) 2020-09-14 00:32:53.9885 DEBUG {"ErrorMsg":"","ActiveConnections":"0","CompleteJobOrdered":true,"JobStatus":"Completed","TotalTransfers":"1","FileTransfers":"1","FolderPropertyTransfers":"0","TransfersCompleted":"1","TransfersFailed":"0","TransfersSkipped":"0","BytesOverWire":"7853","TotalBytesTransferred":"7853","TotalBytesEnumerated":"7853","TotalBytesExpected":"7853","PercentComplete":"100","AverageIOPS":"0","AverageE2EMilliseconds":"62","ServerBusyPercentage":"0","NetworkErrorPercentage":"0","FailedTransfers":[],"SkippedTransfers":null,"PerfConstraint":0,"PerformanceAdvice":[],"IsCleanupJob":false} (Microsoft.ML.ModelBuilder.Utils.Logger.Debug) 2020-09-14 00:32:53.9885 INFO Completed... Total Transfers: 1, Transfers Completed: 1, Transfers Skipped: 0, Transfers Failed: 0 (Microsoft.ML.ModelBuilder.Utils.Logger.Info) 2020-09-14 00:32:54.0025 DEBUG Disposing AutoMLService Client (Microsoft.ML.ModelBuilder.Utils.Logger.Debug) 2020-09-14 00:32:57.0398 INFO Verifying parameters: workspace.. (Microsoft.ML.ModelBuilder.Utils.Logger.Info) 2020-09-14 00:32:57.7631 INFO Ok, experiment.. (Microsoft.ML.ModelBuilder.Utils.Logger.Info) 2020-09-14 00:33:01.3849 INFO Ok, compute target.. (Microsoft.ML.ModelBuilder.Utils.Logger.Info) 2020-09-14 00:33:01.6823 INFO One or more errors occurred. (Microsoft.ML.ModelBuilder.Utils.Logger.Info) 2020-09-14 00:33:01.6823 DEBUG Disposing AutoMLService Client (Microsoft.ML.ModelBuilder.Utils.Logger.Debug) 2020-09-14 00:33:01.6853 DEBUG One or more errors occurred. at System.Threading.Tasks.Task1.GetResultCore(Boolean waitCompletionNotification)
at Azure.MachineLearning.Services.Compute.ComputeTargetPageFetcher.FetchNextPage() in /
/src/Microsoft.ML.AzureMLClient/Compute/ComputeTargetPageFetcher.cs:line 35
at Azure.MachineLearning.Services.LazyEnumerator1.<GetEnumerator>d__9.MoveNext() in /_/src/Microsoft.ML.AzureMLClient/LazyEnumerator.cs:line 26 at System.Linq.Enumerable.WhereEnumerableIterator1.MoveNext()
at System.Linq.Enumerable.FirstOrDefault[TSource](IEnumerable1 source) at AzureML.AutoMLRunnerImages.<RunAutoMLAsync>d__27.MoveNext() in /_/src/Microsoft.ML.ModelBuilder.AutoMLService/RemoteAutoML/AutoMLRunnerImages.cs:line 237 --- End of stack trace from previous location where exception was thrown --- at System.Runtime.ExceptionServices.ExceptionDispatchInfo.Throw() at System.Runtime.CompilerServices.TaskAwaiter.HandleNonSuccessAndDebuggerNotification(Task task) at Microsoft.ML.ModelBuilder.AutoMLService.Experiments.AzureImageClassificationExperiment.<ExecuteAsync>d__13.MoveNext() in /_/src/Microsoft.ML.ModelBuilder.AutoMLService/Experiments/AzureImageClassificationExperiment.cs:line 69 --- End of stack trace from previous location where exception was thrown --- at System.Runtime.ExceptionServices.ExceptionDispatchInfo.Throw() at System.Runtime.CompilerServices.TaskAwaiter.HandleNonSuccessAndDebuggerNotification(Task task) at Microsoft.ML.ModelBuilder.AutoMLEngine.<StartTrainingAsync>d__26.MoveNext() in /_/src/Microsoft.ML.ModelBuilder.AutoMLService/AutoMLEngineService/AutoMLEngine.cs:line 134 (Microsoft.ML.ModelBuilder.Utils.Logger.Debug) 2020-09-14 00:33:04.7768 DEBUG Open Log FileC:\Users\ArafatTehsin\AppData\Local\Temp\MLVSTools\logs\586f1204-3d6d-422e-8981-f35a6848f6c4.txt (Microsoft.ML.ModelBuilder.Utils.Logger.Debug)

@harishsk
Copy link

Hi @arafattehsin This seems to be a Model Builder issue and I am transferring it over that repo.

@harishsk harishsk transferred this issue from dotnet/machinelearning Sep 14, 2020
@LittleLittleCloud
Copy link
Contributor

Looks like a dup of #991

@zewditu
Copy link

zewditu commented Sep 16, 2020

Did you use a dedicated machine? if not could you try that ?

@arafattehsin
Copy link
Author

Thanks @zewditu - Dedicated machine worked well! Please do not forget to include this in your upcoming docs.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

4 participants