Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Chrome whitelist disables loading of local extensions #354

Open
ghost opened this issue Jun 29, 2020 · 32 comments
Open

Chrome whitelist disables loading of local extensions #354

ghost opened this issue Jun 29, 2020 · 32 comments

Comments

@ghost
Copy link

ghost commented Jun 29, 2020

Operating System: Windows 7, Windows 10
Katalon Studio Version: 7.4.0 (primarily) and 6.1.1

Google Chrome Version: 83.0.4103.116
ChromeDriver Version: 83.0.4103.39

Running a Test Case creates a dialog with the message (translated) "Error while loading the extension from: [user path]\AppData\Local\Temp\scoped_dir12345_0123456789\internal. Loading of unpacked extensions is disabled by the administrator."
This dialog pops up every time a browser window opens and must be closed manually to continue.

Same goes for the smart wait extension ( [installation path]\configuration\resources\extensions\Chrome\Smart wait) and Object Spy ( [installation path]\configuration\resources\extensions\Chrome\Object Spy\KR ) but the Object Spy cant detect / record any elements on a page, too.

Our company uses a policy (whitelist) for security reasons. That explain the message on every dialog.

Neither does the software offer a possibility to use only extensions from the company's default profile (Chrome) nor are all the named extensions on the official chrome web store.

How is it possible to execute tests / record elements from websites in Chrome with enabled whitelist?
Can the missing extensions be put on the chrome web store?
Or can Katalon Studio be configured to run without the internal extension? (because it runs fine after clicking the dialog)
ks7Win10ChromeErrorExtensionLoading

@minhthanh3145
Copy link

@GERDebeka

Is my understanding correct ? These popups don't actually prevent you from using the recording/spying, but nonetheless pop up every time ?

@ghost
Copy link
Author

ghost commented Jul 1, 2020

@minhthanh3145
partly. The popups open on every opening new window (when starting object spy too).
But the spying isn't working at all: no detection (red quare around elements) and no capture notice (area with key combination and the selector).

I added screenshots from Firefox and Chrome for comparison.
ks7win7ObjectSpyChrome
ks7win7ObjectSpyFirefox

@minhthanh3145
Copy link

@GERDebeka Ah I understand, the reason is that the extension for Firefox is packed and signed, while for Chrome it's loaded from a folder (unpacked). We will consider doing the same as Firefox for Chrome. Thank you for your report !

@Padoplin Padoplin added planning enhancement New feature or request labels Jul 13, 2020
@jonesste12
Copy link

@minhthanh3145 are you with the Katalon development team and if so, when could this fix be available? Thanks for your help.

@ghost
Copy link
Author

ghost commented Aug 14, 2020

I checked the version 7.6.4 but sadly the error remains with an small change.

  • test execution results with the same dialogs
  • web recorder shows nearby the "(...)internal" dialog a second one with a generated extensionname (see picture)

In the meantime our environment changed, so the solution needs to fit for:

  • windows 10 only (windows 7 wont be longer used by us for that purpose)
  • chrome v84.0.4147.12 64bit

@minhthanh3145
Copy link

@GERDebeka
Can you provide a screenshot for the issue with Web Recorder.

@ghost
Copy link
Author

ghost commented Aug 14, 2020

I repeat my comment, cause github don't let me edit my privious one:

I checked the version 7.6.4 but sadly the error remains with a small change.

  • test execution results with the same dialogs
  • web recorder shows nearby the "(...)internal" dialog a second one with a generated extensionname (github file attachment don't work in the moment i posted it; i loaded the picture up on this link: https://imgur.com/wO9SqlL)

In the meantime our environment changed, so the solution needs to fit for:

  • windows 10 only (windows 7 wont be longer used by us for that purpose)
  • chrome v84.0.4147.12 64bit

We are waiting with high hopes for that solution.

@minhthanh3145
Copy link

minhthanh3145 commented Aug 14, 2020

@GERDebeka

The path of the extension doesn't look right, the extension is supposed to be loaded from within Katalon Studio folder. Can you try to move Katalon Studio to another folder, re-activate it and delete lib and bin folders in your project, to eliminate the chances of caching issues.

@ghost
Copy link
Author

ghost commented Aug 14, 2020

@minhthanh3145
i tried doing what you told me. Sadly nothing new happened.

@minhthanh3145
Copy link

@GERDebeka I'll try to reproduce the problem on my side. Thank you for your report !

@martyhammer
Copy link

My organization is experiencing similar problem with unpacked extension with naming convention: C:\Users\xxx\AppData\Local\Temp\scoped_dirnnnnn_nnnnnnn\extension_abcdefg.... Loading of unpacked extensions is disabled by the administrator. In our secure Chrome configuration, we have blacklisted "" (all) and many items in Whitelist, including the initial Katalon Chrome extension. However, we cannot whitelist the new extension created by the recorded in unpacked form. If we remove the blacklist "" entry (or change it to "dummy", either way rendering the whitelist unnecessary), the error is avoided and the recorder (and playback) works correctly. We only recently purchased this software and now can get no value from it. When is a new release correcting this issue expected to be available?

@Padoplin
Copy link
Contributor

Padoplin commented Sep 16, 2020

Hello @martyhammer

We fixed this issue in version 7.6.4 which is available here. We're sorry for not updating this ticket earlier. �Please upgrade and see if the issue still persists.

Jass

@Padoplin Padoplin reopened this Sep 16, 2020
@AnshulVashisht
Copy link

AnshulVashisht commented Sep 18, 2020

Our company doesn't have this version available, please suggest the solution for "Failed to Load Extension" issue in 7.6.2 version .

@jonesste12
Copy link

Is there a way to add code to the script so that it will bypass/ignore/accept the popup thus avoiding the manual intervention of clicking Ok?

@martyhammer
Copy link

martyhammer commented Sep 29, 2020 via email

@ghost
Copy link
Author

ghost commented Sep 30, 2020

ok we had at least a partial breakthrough with the problem.

We added the ID of the extension "internal". The ID is: "nhjadcbdhpaglfenolfcepmoeifeaijd".
Set on the registry-entry: "HKEY_CURRENT_USER\Software\Policies\Google\Chrome\ExtensionInstallWhitelist" we solved with that the popup-dialog "internal".
Combined with disabling smart wait ("Project" -> "Settings"; "Execution" -> "Default,Smart Wait" = "Disable") which clear the popup-dialog "smart wait" unsatisfactory its possible tu run tests now without manuall work. *

Whats left is the function of "WebSpy" and "WebRecorder" which open the popup-dialog "KR".
We continue investigate that case and have a hunch on an other local extension "Katalon Utility" which ID we dont know.

But I personally also see it slowly like @martyhammer . We lose a lot of time here.

  • This result was confirmed yesterday with the following environment: Windows 10 64bit, Chrome v85.0.4183.121 ChromeDriver v85.0.4183.121, Katalon Studio v7.4.0, v7.6.0, v7.6.4 and v7.7.0
    regeditKatalonStudioInternal
    firefoxAddonOnWebSpy
    chromePopUpKROnWebRecorder
    chromePopUpKROnWebSpy

@duyluonganh
Copy link
Collaborator

@GERDebeka @martyhammer
We are investigating this issue.

The workaround here is:

@ghost
Copy link
Author

ghost commented Sep 30, 2020

@duyluonganh
Sorry, i can't confirm your workaround.

We had the extension "Katalon Recorder (Selenium tests generator)" (ID: "ljdobmomdgdljniojadhoplhkpialdid") on Chrome already installed and on the whitelist enabled.

After selecting your shown Button there happended nothing. No Message, PopUp or any visible reaction at all nether for WebSpy or WebRecorder. *

I watched an example on Youtube to confirm that this behavior is wrong:
On "https://youtu.be/ApbxjPnrmW0?t=195" you can see between 3:15 - 4:13 how he does what you recommend (inclusive downloading that extension) and the chrome window / the WebRecorder from KS react on mouse movement and clicks.

If there is an other workaround please share it with us.

  • This result was confirmed today with the following environment: Windows 10 64bit, Chrome v85.0.4183.121 with "Katalon Recorder (Selenium tests generator)" v5.3.1, ChromeDriver v85.0.4183.121, Katalon Studio v7.4.0, v7.6.0, v7.6.4 and v7.7.0

@duyluonganh
Copy link
Collaborator

Hi @GERDebeka

I watched an example on Youtube to confirm that this behavior is wrong:
On "https://youtu.be/ApbxjPnrmW0?t=195" you can see between 3:15 - 4:13 how he does what you recommend (inclusive downloading that extension) and the chrome window / the WebRecorder from KS react on mouse movement and clicks.

We think that his behavior was correct although his Katalon Studio version is quite old. We also record another video here: https://www.youtube.com/watch?v=hqkgkqe623w&feature=youtu.be.
Please record a video to show that this feature doesn't work in your case.

@ghost
Copy link
Author

ghost commented Oct 5, 2020

Hallo @duyluonganh

thanks for posting an video how should look now, but your visible OS was macOS right?
That's not the same environment we use (Windows 10). The problem can't be replicated (with windows registry) like that.

I attached an clip of our environment (Windows 10, Chrome and Firefox for KSE 7.4.0) and how the workaround for WebRecorder with the Katalon Recorder plugin (on the browsers) only fails on chrome (sorry for the low quality, but github doesn't allow .mp4-files and limited filesize to 10MB).
webRecorderBrokenActiveChromeOnly

I tested it with WebSpy on this configuration too; firefox works, chrome not.
I even tested it on our other versions of KSE (v7.6.0, v7.6.4 and v7.7.0); firefox works, chrome not.

An interested colleague of me tried it at home on his private windows 10 machine with KS (and no black-/whitelist on the registry for chrome); Execution, WebSpy and WebRecorder worked fine!

For now i am 99% sure that the missing peace to solve this are the IDs from the chrome Extensions.
Please tell us the IDs for the three extensions:
"[KS-Filepath]/configuration/resources/extensions/Chrome/Object Spy/KR" (for WebSpy)
"[KS-Filepath]/configuration/resources/extensions/Chrome/Recorder/KR" (for WebRecorder)
"[KS-Filepath]/configuration/resources/extensions/Chrome/Recorder/Smart Wait" (for Smart Wait)

it was possible for you to send us "nhjadcbdhpaglfenolfcepmoeifeaijd"; the ID for the extension:
"[local default Chrome profile]/extension_nhjadcbdhpaglfenolfcepmoeifeaijd" (internal)

Or even better: publish all 4 extensions on the official chrome store (next to the already existing "Katalon Recorder"; ID "ljdobmomdgdljniojadhoplhkpialdid"). That would help us for some legal regulations too!

@ghost
Copy link
Author

ghost commented Dec 10, 2020

Over two months passed since my last comment. Any progress so far?

@ccshubert
Copy link

ccshubert commented Jan 14, 2021

Using Katalon 7.6.5 and still having this problem.

  • In order to use Katalon Studio with Chrome in our controlled environment, we must disable Smart Wait.
  • This is because the Smart Wait extension is an unpacked extension...
  • ...but our controlled environment does not allow loading of unpacked extensions.
  • Using Katalon+Chrome without Smart Wait does not work with our "responsive" Web Pages.

Please create a packed, signed smart wait extension for Chrome so that Katalon can be used with Chrome in controlled environments.

FYI, our environment is a US Federal Government Department. I am sure that other Federal agencies use similar policies. So, this basically impacts the entire Federal Government - a pretty big footprint!

Update: Doesn't work with 7.8.2, either.

@jridge
Copy link

jridge commented Jan 29, 2021

I've just installed the latest version Katalon 7.9.0 and I'm running a Trial of the Enterprise edition.
Running on Win10 with Chrome version 87.0 and it still has the same issue (getting hung up on the Smart Wait).

It occurred to me that we could determine the "id" of the plugin by checking it on a machine that doesn't have the restriction on loading unpacked extensions.

That approach appeared to work and yielded the extension number for the "smart wait"

chrome://extensions/?id=loghpdeifonmghkjdanipmhkfjnkhjal

caveat - that extension came from Chrome v88, but I'm using v87 at the employer site so they could be different, but I'm guessing probably not.

Anyone configured to test my approach?
LMK

PS: used following URL to figure out how to get the extension.
https://www.bleepingcomputer.com/tutorials/how-to-find-id-for-chrome-extension/

@jridge
Copy link

jridge commented Jan 30, 2021

Initial try results in no joy. Next?

@ghost
Copy link
Author

ghost commented Feb 22, 2021

@jridge
nice idea, but unfortunately it did not work.
We added the ID "loghpdeifonmghkjdanipmhkfjnkhjal" to our registry. We also made sure that smart wait was enabled.
Result: The dialog still pops up. For test execution, web spy and web recorder.
regedit
smartWaitEnabled

After an webmeeting with the katalon support they informed us about an "All-In-One"-Extension they want to upload in the official chrome store.
For now we are waiting for that.

if anyone else has a good idea, we would still be interested in trying it out.

@martyhammer
Copy link

martyhammer commented Feb 22, 2021 via email

@ccshubert
Copy link

ccshubert commented Feb 22, 2021

Marty,

Yes, that is correct. Until Katalon publishes their extensions in the Chrome App Store, Chrome cannot be used with Katalon on machines which have a managed extension whitelist - which includes, I suspect, all Federal machines and many machines owned by larger corporations. This is a huge miss for Katalon.

Please see my issue, Please Add Chrome Object Spy, Recorder, and Smart Wait Extensions to Google Web Store So That They Can Be Whitelisted, requesting Katalon to take the necessary action.

At present, the issue appears to be stalled, and there does not appear to be a way to up-vote an issue, but at least it's out there!

Best,

Christopher C. Shubert

@hoop5318
Copy link

Dear all,
We have the same issue with the latest version of Katalon Studio this is still not solved. :-(

image
We need a solution know otherwise we can't order this product for more users.

Best regards,
Christian

@nhpthuy
Copy link
Contributor

nhpthuy commented Jun 16, 2021

Hi All,

In version 8.0.5 (download here, Katalon Studion introduced an option to Record Web with a packed extension, now available on the Chrome Web Store. See Record Web Utility using Chrome with Profile for the user guide. For the rest extensions, we're working on them so pls stay tuned.

Also, pls have a look at our Release note for further details.

Regards,
Shin

@jonesste12
Copy link

jonesste12 commented Aug 20, 2021

How do i get this download file and use it to install on a windows machine on a closed network, i need the actual executable file because my other machine does not have access to the internet

@Nam-Nguyen-Tran
Copy link
Contributor

Hi everyone,

All the utilities are bundled into Katalon Compact Utility.
Please find its information here: https://docs.katalon.com/katalon-studio/docs/katalon-compact-utility.html#configuring-and-using-katalon-compact-utility-with-chrome-profile.

Thank you all for your concerns,
Nam Nguyen.

@ccshubert
Copy link

Thanks, @Nam-Nguyen-Tran!

I have requested that our IT department approve this extension. This will address a longstanding and bothersome situation for us. I'm looking forward to trying it!

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Projects
None yet
Development

No branches or pull requests