Azure SQL Migration Extension in Disconnected Environment #22558

pvandermaas-apriva · 2023-03-31T00:48:35Z

Issue Type: Bug

Attempting to run the Azure SQL Migration Extension in Azure Data Studio on an Azure VM in a restricted environment (no internet access) and witnessing the following behavior:

Steps:
Connect to Source Server
Right-click -> Manage
General -> Azure SQL Migration

Error in notification popup:

Failed to start Sql Migration Service: Error: Request error: Error
at ClientRequest. (c:\Users<userfolder>.azuredatastudio\extensions\microsoft.sql-migration-1.4.2\dist\main.js:2:7448)
at ClientRequest.emit (node:events:538:35)
at TLSSocket.socketErrorListener (node:_http_client:442:9)
at TLSSocket.emit (node:events:526:28)
at emitErrorNT (node:internal/streams/destroy:157:8)
at emitErrorCloseNT (node:internal/streams/destroy:122:3)
at process.processTicksAndRejections (node:internal/process/task_queues:83:21)

Close tab, repeat
Connect to Source Server
Right-click -> Manage
General -> Azure SQL Migration
Azure SQL Migration tab now has content
New Migration (or, "Migrate to Azure SQL" link in welcome screen)

Hangs with "Waiting for SqlMigrationProvider component to start." in the notification popup. Never resolves or times-out.

Is this extension supported in a disconnected environment? If not, is there an available list of hostnames/domains that I can request from my network team to allow access? I am interested in the assessment information, including SKU recommendations. TIA.

Extension version: 1.4.2
Azure Data Studio version: azuredatastudio 1.42.0 (22f384e, 2023-03-17T18:15:48.982Z)
OS version: Windows_NT x64 10.0.17763
Restricted Mode: No
Preview Features: Enabled

System Info

Item	Value
CPUs	Intel(R) Xeon(R) Platinum 8272CL CPU @ 2.60GHz (4 x 2594)
GPU Status	2d_canvas: unavailable_software canvas_oop_rasterization: disabled_off direct_rendering_display_compositor: disabled_off_ok gpu_compositing: disabled_software multiple_raster_threads: enabled_on opengl: disabled_off rasterization: disabled_software raw_draw: disabled_off_ok skia_renderer: enabled_on video_decode: disabled_software video_encode: disabled_software vulkan: disabled_off webgl: unavailable_software webgl2: unavailable_software webgpu: disabled_off
Load (avg)	undefined
Memory (System)	32.00GB (11.22GB free)
Process Argv
Screen Reader	no
VM	0%

The text was updated successfully, but these errors were encountered:

cap-dm · 2023-04-03T23:11:10Z

Just to add to the above, I'm seeing the same behaviour in my environment.
We have:

Dev VMs on premise
SQL instances on premise
Azure SQL MI
Private routes from on prem into Azure.
Proxy between the Dev VMs and the wider internet, but not between the Dev VMs and everything else mentioned.

Default behaviour throws an exception (different to above) because I'm not authenticating to the proxy. If I fully disable the proxy in Settings > Proxy Support > Off, I get the above exception encountered by pvandermaas-apriva. I got it to load the Azure SQL Migration window once (Proxy Support off, but I think the main app was successfully communicating with the proxy), but then I hung on 'Waiting for SqlMigrationProvider component to start.'

Azure Data Studio is v1.42.0 (user setup, win 2016), Azure SQL Migration v1.4.2.

Note: sorry for the brand new account. I made it specifically to comment on this.

Charles-Gagnon · 2023-04-03T23:19:35Z

@alanrenmsft Have we tested the service downloader in a proxy environment? The comment from @cap-dm sounds like a separate issue where they have their proxy set up but it still doesn't download the service binaries.

@cap-dm Can you confirm that other parts of ADS function with the proxy settings you have - a specific example would be the extension gallery loading and displaying the marketplace extensions.

pvandermaas-apriva · 2023-04-03T23:20:12Z

@cap-dm, FWIW I stumbled onto using DmaCmd.exe and SqlAssessment.exe, included with the Data Migration Assistant. I believe it will allow collection of perf metrics ~~that can then be copied down and uploaded from my less-restricted workstation~~. That said, I'm actually in the process of collecting perf data as I type this, ~~so this approach may not actually work,~~ but am giving it a shot. More info can be found here:
https://learn.microsoft.com/en-us/sql/dma/dma-sku-recommend-sql-db?view=sql-server-ver16

quick update: I was able to get the SKU recommendations from the within the disconnected environment; no need to copy down the perf data.
edit to add:

can get SKU recommendations from the CLI tools
DmaCmd.exe appears to still require external access

alanrenmsft · 2023-04-04T04:52:03Z

so just to confirm, the issue is resolved now, right?

cap-dm · 2023-04-04T05:10:49Z

@cap-dm Can you confirm that other parts of ADS function with the proxy settings you have - a specific example would be the extension gallery loading and displaying the marketplace extensions.

Oh I know I'm having proxy issues! It was more that I was seeing the same errors as pvandermaas-apriva while experiencing them, so I was throwing some weight behind the SQL Migration Extension (SME) having issues when it was in a disconnected environment.

Now I'm going to have to apologise because I can't quite remember the sequence of events before finding this ticket.

I know I was able to browse to and download the (SME). I don't think I changed any proxy settings prior to this
Once it was down and I launched it I encountered the problems as described above
I have tried many proxy settings, but I was finding either ADS or SME would work correctly not both. I finally managed to get both ADS and SME work by nuking all http.proxy* settings in settings.json and restarting the application. I'm actually astounded this works, but here we are.

I would suggest that both ADS and SME get some more graceful handling of connectivity and proxy issues, it was a pain to debug as those traces don't really tell the end user much.

pvandermaas-apriva · 2023-04-04T15:42:23Z

so just to confirm, the issue is resolved now, right?

Not for me. I was able to get to my end goal a different way (CLI tools), but the issue with the Azure SQL Migration extension for ADS still exists.

Charles-Gagnon · 2023-04-04T16:59:51Z

We're working on making this experience better, but for the time being these steps should work for getting the extension functioning:

Open ADS and run the "Extensions: Open Extensions Folder" command
Look for the latest "microsoft.sql-migration-*" folder (e.g. microsoft.sql-migration-1.4.2)
In there look for a config.json file and open it
Get the version from the "version": "*.*.*.*", line (e.g. "version": "4.5.0.37")
Download the zip/tar.gz that corresponds to your OS and replace the *.*.*.* in the links below with that version and copy it to the machine that ADS is installed on.

Windows: https://github.com/Microsoft/sqltoolsservice/releases/download/*.*.*.*/microsoft.sqltools.migration-win-x64-net7.0.zip
Windows (x86): https://github.com/Microsoft/sqltoolsservice/releases/download/*.*.*.*/microsoft.sqltools.migration-win-x86-net7.0.zip
OSX: https://github.com/Microsoft/sqltoolsservice/releases/download/*.*.*.*/microsoft.sqltools.migration-osx-x64-net7.0.tar.gz
Linux: https://github.com/Microsoft/sqltoolsservice/releases/download/*.*.*.*/microsoft.sqltools.migration-rhel-x64-net7.0.tar.gz

e.g. for Windows with version 4.5.0.37 it would be https://github.com/Microsoft/sqltoolsservice/releases/download/4.5.0.38/microsoft.sqltools.migration-win-x64-net7.0.zip

Unzip the contents
Back in the extension folder make sure the following path exists <Path to Extension Folder>/migrationService/<Platform>/<Version> (e.g. %USERPROFILE%\.azuredatastudio\extensions\microsoft.sql-migration-1.4.2\migrationService\Windows\4.5.0.37)
Copy the unzipped contents from above into this new folder. Verify the path is correct by checking that <Path to Extension Folder>/migrationService/<Platform>/<Version>/MicrosoftSqlToolsMigration.exe exists (e.g. %USERPROFILE%\.azuredatastudio\extensions\microsoft.sql-migration-1.4.2\migrationService\Windows\4.5.0.37\MicrosoftSqlToolsMigration.exe
Reload ADS - the Migration extension should start up correctly

Note that you'll need to do this each time a new version of the service is available - so if you hit the error again follow the instructions above (there will likely be a new version you have to download but the rest of the steps are the same)

Charles-Gagnon · 2023-04-04T17:01:14Z

@alanrenmsft @cssuh So two things we should be following up on:

Does ADS service downloader respect proxy settings?
If it can't download the service zip it should show an error with a link for the user to download manually, and ideally link to some instructions in our wiki or something with the steps I outlined above

alanrenmsft · 2023-04-04T17:10:02Z

There are different scenarios:

Disconnected environment
Extensions need to have platform specific installer which includes the service binaries (similar to vscode-mssql extension)
Internet access with proxy
Service downloader needs to respect the proxy settings.

I will create issues to track these work items.

alanrenmsft · 2023-04-04T17:25:46Z

#22610

…wnload (#22846) Add troubleshooting links to error message when SQL-Migration fails to download the MigrationService as seen in this issue: #22558 --------- Co-authored-by: Akshay Mata <akma@microsoft.com>

kburtram · 2023-05-08T18:19:22Z

@AkshayMata @alanrenmsft are we tracking any pending work for the May release with this issue? Or should we move or close it?

Edit: nevermind, I see this is not in the May release milestone 😄 though please close if this is resolved. Thanks!

alanrenmsft · 2023-05-08T18:29:56Z

I have a follow up work item.

sanjeevreddy22 · 2023-06-26T10:51:11Z

We're working on making this experience better, but for the time being these steps should work for getting the extension functioning:

Open ADS and run the "Extensions: Open Extensions Folder" command

Look for the latest "microsoft.sql-migration-*" folder (e.g. microsoft.sql-migration-1.4.2)

In there look for a config.json file and open it

Get the version from the "version": "*.*.*.*", line (e.g. "version": "4.5.0.37")

Download the zip/tar.gz that corresponds to your OS and replace the *.*.*.* in the links below with that version and copy it to the machine that ADS is installed on.

Windows: https://github.com/Microsoft/sqltoolsservice/releases/download/*.*.*.*/microsoft.sqltools.migration-win-x64-net7.0.zip Windows (x86): https://github.com/Microsoft/sqltoolsservice/releases/download/*.*.*.*/microsoft.sqltools.migration-win-x86-net7.0.zip OSX: https://github.com/Microsoft/sqltoolsservice/releases/download/*.*.*.*/microsoft.sqltools.migration-osx-x64-net7.0.tar.gz Linux: https://github.com/Microsoft/sqltoolsservice/releases/download/*.*.*.*/microsoft.sqltools.migration-rhel-x64-net7.0.tar.gz

e.g. for Windows with version 4.5.0.37 it would be https://github.com/Microsoft/sqltoolsservice/releases/download/4.5.0.38/microsoft.sqltools.migration-win-x64-net7.0.zip

Unzip the contents

Back in the extension folder make sure the following path exists <Path to Extension Folder>/migrationService/<Platform>/<Version> (e.g. %USERPROFILE%\.azuredatastudio\extensions\microsoft.sql-migration-1.4.2\migrationService\Windows\4.5.0.37)

Copy the unzipped contents from above into this new folder. Verify the path is correct by checking that <Path to Extension Folder>/migrationService/<Platform>/<Version>/MicrosoftSqlToolsMigration.exe exists (e.g. %USERPROFILE%\.azuredatastudio\extensions\microsoft.sql-migration-1.4.2\migrationService\Windows\4.5.0.37\MicrosoftSqlToolsMigration.exe

Reload ADS - the Migration extension should start up correctly

Note that you'll need to do this each time a new version of the service is available - so if you hit the error again follow the instructions above (there will likely be a new version you have to download but the rest of the steps are the same)

Hi , I have tried the above method but, still i am not able to use the migration extension. i don't have internet on VM. Cloud you please help me.

kisantia · 2023-07-10T22:57:25Z

@raymondtruong @brian-harris is this issue planned for the July release? Please move it out of the July milestone if it isn't. Thanks!

kisantia · 2023-09-11T18:30:52Z

@raymondtruong @brian-harris any updates on this issue? I'll move it to the backlog if there aren't any plans to work on this

brian-harris · 2023-09-11T19:26:48Z

is there anything that can be done on the SQL-Migration extension side? or is this all ADS?

kisantia · 2023-09-11T20:26:48Z

@brian-harris the issue Alan linked above is completed. Is there anything else that needs to be done for this issue?

brian-harris · 2023-09-11T21:05:04Z

I will assign to someone to verify it is fixed.

kisantia · 2023-09-13T21:22:10Z

@Ramudaykumar I moved this issue to November. Please close if this is complete or add details on what else needs to be done

Ramudaykumar · 2023-10-03T09:30:26Z

If source is in local/reachable from the machine ADS is running, we can do assessment and SKU recommendation without internet connection.

Installing SQL Migration Extension in disconnected will need these steps: #22558 (comment)

alanrenmsft added Area - SQL Migration Bug Triage: Needed labels Mar 31, 2023

brian-harris assigned brian-harris and raymondtruong Apr 3, 2023

AkshayMata mentioned this issue Apr 25, 2023

[SQL-Migration] Improve error message for failed migration service download #22846

Merged

alanrenmsft added this to the July 2023 Release milestone May 8, 2023

kisantia modified the milestones: July 2023 Release, September 2023 Release Jul 11, 2023

Ramudaykumar self-assigned this Sep 12, 2023

Ramudaykumar removed the Triage: Needed label Sep 12, 2023

kisantia modified the milestones: September 2023 Release, November 2023 Release Sep 13, 2023

brian-harris mentioned this issue Sep 28, 2023

A11y_SQLMigrationControlPlane_ AzureSQLMigration _MigrationStatus_ScreenReader: Buttons present inside the table is announced as group by the screen reader. #20632

Closed

Ramudaykumar closed this as completed Oct 3, 2023

Provide feedback

Saved searches

Use saved searches to filter your results more quickly

Azure SQL Migration Extension in Disconnected Environment #22558

Azure SQL Migration Extension in Disconnected Environment #22558

pvandermaas-apriva commented Mar 31, 2023

cap-dm commented Apr 3, 2023 •

edited

Loading

Charles-Gagnon commented Apr 3, 2023

pvandermaas-apriva commented Apr 3, 2023 •

edited

Loading

alanrenmsft commented Apr 4, 2023

cap-dm commented Apr 4, 2023

pvandermaas-apriva commented Apr 4, 2023 •

edited

Loading

Charles-Gagnon commented Apr 4, 2023 •

edited

Loading

Charles-Gagnon commented Apr 4, 2023

alanrenmsft commented Apr 4, 2023 •

edited

Loading

alanrenmsft commented Apr 4, 2023

kburtram commented May 8, 2023 •

edited

Loading

alanrenmsft commented May 8, 2023

sanjeevreddy22 commented Jun 26, 2023 •

edited

Loading

kisantia commented Jul 10, 2023

kisantia commented Sep 11, 2023

brian-harris commented Sep 11, 2023

kisantia commented Sep 11, 2023

brian-harris commented Sep 11, 2023

kisantia commented Sep 13, 2023

Ramudaykumar commented Oct 3, 2023 •

edited

Loading

Azure SQL Migration Extension in Disconnected Environment #22558

Azure SQL Migration Extension in Disconnected Environment #22558

Comments

pvandermaas-apriva commented Mar 31, 2023

cap-dm commented Apr 3, 2023 • edited Loading

Charles-Gagnon commented Apr 3, 2023

pvandermaas-apriva commented Apr 3, 2023 • edited Loading

alanrenmsft commented Apr 4, 2023

cap-dm commented Apr 4, 2023

pvandermaas-apriva commented Apr 4, 2023 • edited Loading

Charles-Gagnon commented Apr 4, 2023 • edited Loading

Charles-Gagnon commented Apr 4, 2023

alanrenmsft commented Apr 4, 2023 • edited Loading

alanrenmsft commented Apr 4, 2023

kburtram commented May 8, 2023 • edited Loading

alanrenmsft commented May 8, 2023

sanjeevreddy22 commented Jun 26, 2023 • edited Loading

kisantia commented Jul 10, 2023

kisantia commented Sep 11, 2023

brian-harris commented Sep 11, 2023

kisantia commented Sep 11, 2023

brian-harris commented Sep 11, 2023

kisantia commented Sep 13, 2023

Ramudaykumar commented Oct 3, 2023 • edited Loading

cap-dm commented Apr 3, 2023 •

edited

Loading

pvandermaas-apriva commented Apr 3, 2023 •

edited

Loading

pvandermaas-apriva commented Apr 4, 2023 •

edited

Loading

Charles-Gagnon commented Apr 4, 2023 •

edited

Loading

alanrenmsft commented Apr 4, 2023 •

edited

Loading

kburtram commented May 8, 2023 •

edited

Loading

sanjeevreddy22 commented Jun 26, 2023 •

edited

Loading

Ramudaykumar commented Oct 3, 2023 •

edited

Loading