Does not work on macOS 11

[dangh]

Related sources:

• https://news.ycombinator.com/item?id=23612772
• https://github.com/wbond/oscrypto/blob/master/oscrypto/_mac/_core_foundation_ctypes.py#L19

ST console logs:

Traceback (most recent call last):
  File "/Users/dang/Library/Application Support/Sublime Text/Installed Packages/Package Control.sublime-package/package_control/deps/oscrypto/_osx/_core_foundation.py", line 7, in <module>
ImportError: No module named 'Package Control.package_control.deps.oscrypto._osx._core_foundation_cffi'

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "/Applications/Sublime Text.app/Contents/MacOS/Lib/python33/sublime_plugin.py", line 274, in reload_plugin
    m = importlib.import_module(modulename)
  File "./python3.3/importlib/__init__.py", line 90, in import_module
  File "<frozen importlib._bootstrap>", line 1584, in _gcd_import
  File "<frozen importlib._bootstrap>", line 1565, in _find_and_load
  File "<frozen importlib._bootstrap>", line 1532, in _find_and_load_unlocked
  File "/Applications/Sublime Text.app/Contents/MacOS/Lib/python33/sublime_plugin.py", line 1425, in load_module
    exec(compile(source, source_path, 'exec'), mod.__dict__)
  File "/Users/dang/Library/Application Support/Sublime Text/Installed Packages/Package Control.sublime-package/2_bootstrap.py", line 26, in <module>
  File "<frozen importlib._bootstrap>", line 1565, in _find_and_load
  File "<frozen importlib._bootstrap>", line 1532, in _find_and_load_unlocked
  File "/Applications/Sublime Text.app/Contents/MacOS/Lib/python33/sublime_plugin.py", line 1425, in load_module
    exec(compile(source, source_path, 'exec'), mod.__dict__)
  File "/Users/dang/Library/Application Support/Sublime Text/Installed Packages/Package Control.sublime-package/package_control/bootstrap.py", line 20, in <module>
  File "<frozen importlib._bootstrap>", line 1565, in _find_and_load
  File "<frozen importlib._bootstrap>", line 1532, in _find_and_load_unlocked
  File "/Applications/Sublime Text.app/Contents/MacOS/Lib/python33/sublime_plugin.py", line 1425, in load_module
    exec(compile(source, source_path, 'exec'), mod.__dict__)
  File "/Users/dang/Library/Application Support/Sublime Text/Installed Packages/Package Control.sublime-package/package_control/download_manager.py", line 24, in <module>
  File "<frozen importlib._bootstrap>", line 1565, in _find_and_load
  File "<frozen importlib._bootstrap>", line 1532, in _find_and_load_unlocked
  File "/Applications/Sublime Text.app/Contents/MacOS/Lib/python33/sublime_plugin.py", line 1425, in load_module
    exec(compile(source, source_path, 'exec'), mod.__dict__)
  File "/Users/dang/Library/Application Support/Sublime Text/Installed Packages/Package Control.sublime-package/package_control/downloaders/__init__.py", line 3, in <module>
  File "<frozen importlib._bootstrap>", line 1565, in _find_and_load
  File "<frozen importlib._bootstrap>", line 1532, in _find_and_load_unlocked
  File "/Applications/Sublime Text.app/Contents/MacOS/Lib/python33/sublime_plugin.py", line 1425, in load_module
    exec(compile(source, source_path, 'exec'), mod.__dict__)
  File "/Users/dang/Library/Application Support/Sublime Text/Installed Packages/Package Control.sublime-package/package_control/downloaders/urllib_downloader.py", line 46, in <module>
  File "<frozen importlib._bootstrap>", line 1565, in _find_and_load
  File "<frozen importlib._bootstrap>", line 1532, in _find_and_load_unlocked
  File "/Applications/Sublime Text.app/Contents/MacOS/Lib/python33/sublime_plugin.py", line 1425, in load_module
    exec(compile(source, source_path, 'exec'), mod.__dict__)
  File "/Users/dang/Library/Application Support/Sublime Text/Installed Packages/Package Control.sublime-package/package_control/ca_certs.py", line 7, in <module>
  File "<frozen importlib._bootstrap>", line 1565, in _find_and_load
  File "<frozen importlib._bootstrap>", line 1532, in _find_and_load_unlocked
  File "/Applications/Sublime Text.app/Contents/MacOS/Lib/python33/sublime_plugin.py", line 1425, in load_module
    exec(compile(source, source_path, 'exec'), mod.__dict__)
  File "/Users/dang/Library/Application Support/Sublime Text/Installed Packages/Package Control.sublime-package/package_control/deps/oscrypto/trust_list.py", line 19, in <module>
  File "<frozen importlib._bootstrap>", line 1565, in _find_and_load
  File "<frozen importlib._bootstrap>", line 1532, in _find_and_load_unlocked
  File "/Applications/Sublime Text.app/Contents/MacOS/Lib/python33/sublime_plugin.py", line 1425, in load_module
    exec(compile(source, source_path, 'exec'), mod.__dict__)
  File "/Users/dang/Library/Application Support/Sublime Text/Installed Packages/Package Control.sublime-package/package_control/deps/oscrypto/_osx/trust_list.py", line 8, in <module>
  File "<frozen importlib._bootstrap>", line 1565, in _find_and_load
  File "<frozen importlib._bootstrap>", line 1532, in _find_and_load_unlocked
  File "/Applications/Sublime Text.app/Contents/MacOS/Lib/python33/sublime_plugin.py", line 1425, in load_module
    exec(compile(source, source_path, 'exec'), mod.__dict__)
  File "/Users/dang/Library/Application Support/Sublime Text/Installed Packages/Package Control.sublime-package/package_control/deps/oscrypto/_osx/_core_foundation.py", line 9, in <module>
  File "<frozen importlib._bootstrap>", line 1565, in _find_and_load
  File "<frozen importlib._bootstrap>", line 1532, in _find_and_load_unlocked
  File "/Applications/Sublime Text.app/Contents/MacOS/Lib/python33/sublime_plugin.py", line 1425, in load_module
    exec(compile(source, source_path, 'exec'), mod.__dict__)
  File "/Users/dang/Library/Application Support/Sublime Text/Installed Packages/Package Control.sublime-package/package_control/deps/oscrypto/_osx/_core_foundation_ctypes.py", line 21, in <module>
Package Control.package_control.deps.oscrypto.errors.LibraryNotFoundError: The library CoreFoundation could not be found

• Sublime Text version: build 4074
• OS version: 11.0 Beta (20A4299v)
• PackageControl version: 3.3.0

[AndrewHoos]

Looks like this might be related to the dynamic linker changes noted here:
https://developer.apple.com/documentation/macos-release-notes/macos-big-sur-11-beta-release-notes

[wbond]

Yeah - there will likely need to be some changes. Hopefully someone who has the macOS 11 beta installed can help find what changes will be necessary. It may just end up being that for the Mac shared libs we just try to open them rather than call find_library().

[AndrewHoos]

Why are you not just doing import Cocoa etc. Using pyobjc?

[wbond]

@AndrewHoos

• it looks like pyobjc is not pure python, and thus it would be illogical for oscrypto to use it
• I support Python 2.6 and 3.3 primarily (ST2 and ST3), it doesn't seem pyobjc supports either version currently
• pyobjc is a huge dependency
• maintaining a "distribution" of pyobjc to include with Package Control would be a ton of work

We just need to figure out what the alternative to find_library() in ctypes will be with Big Sur.

I don't have a macOS 11 VM and won't have time to set one up for a while, so I'm hoping an early adopter can help out.

[TerminalFi]

All system libraries now live in /System/Library/dyld/dyld_shared_cache_x86_64. Looking into what changes would be required to support this.

[TerminalFi]

@wbond as of right now, I think the only options are at the moment

1. Knowing the paths to the libraries you want.
2. Opening /System/Library/dyld/dyld_shared_cache_x86_64 and going through it to identify the paths of the files you want.

Once we get the path, everything is the same.

from ctypes import CDLL
core_foundation_path = "/System/Library/Frameworks/CoreFoundation.framework/Versions/A/CoreFoundation"
CoreFoundation = CDLL(core_foundation_path, use_errno=True)

[TerminalFi]

@dangh @wbond the supporting library oscrypto has been updated to support MacOS Big Sur.

@dangh Once the PR on oscrypto is merged, Package Control can be updated to fix this issue with the latest version of oscrypto

[max-mykhailenko]

@wbond may I know when you plan to release it?

[wbond]

No, I don’t have a date. This is a hobby for me that sits behind my day job and taking care of my family. As of right now most of my nights are spoken for this week.

[findyy99]

So, anyone know how to solve this bug on macOS big Sur?
Are there something specific I can do?

[TerminalFi]

@findyy99 see the referenced PR above.

[findyy99]

@TheSecEng Sorry, did you mean I need to complie the Package Control by myself?

[TerminalFi]

I just mean that there is a PR to fix this. Will Bond just needs to test and validate it first. You can do 1 of three things.

1. Wait for a new release
2. Uninstall Package Control; Clone my fork and switch to a working branch
3. Generate a new package from my branch.

If you do either 2 or 3, you won't receive updates though. I would recommend you wait for Will to push a new release. Shouldn't be too long.