Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Experimental: Support for iOS Platform #10

Open
lucoiso opened this issue Jul 1, 2022 · 13 comments
Open

Experimental: Support for iOS Platform #10

lucoiso opened this issue Jul 1, 2022 · 13 comments
Assignees
Labels
enhancement New feature or request

Comments

@lucoiso
Copy link
Owner

lucoiso commented Jul 1, 2022

This plugin currently does not support iOS platforms.
Note: I don't have an iOS device to test, so this improvement will be experimental.

@lucoiso lucoiso added the enhancement New feature or request label Jul 1, 2022
@lucoiso lucoiso self-assigned this Jul 1, 2022
@Legumtechnica
Copy link

So, Does it still support iOS?
Please let me know so that I can also help you test it on one

@lucoiso
Copy link
Owner Author

lucoiso commented Dec 18, 2022

Pushed an experimental branch: https://github.com/lucoiso/UEAzSpeech/tree/experimental/MULTI-PLATFORM

@Legumtechnica
Copy link

Will test today and let you know

@Legumtechnica
Copy link

iOS also crashes on runtime, Should I create a new issue?

@lucoiso
Copy link
Owner Author

lucoiso commented Jan 9, 2023

Hi @ishu07 ! : )
Can you try again and send me the log for iOS build? I've updated the iOS UPL file and disabled the Azure SDK logs for Android and iOS : )

iOS support is currently experimental, there is no guarantee that it will work, as I have no way to test it here, so I am trying to adapt when an error is reported after an update.

If you can test again and send me the log, that would be great. :)

@Legumtechnica
Copy link

Hi, i will try soon and report :)

lucoiso added a commit that referenced this issue Jan 28, 2023
lucoiso added a commit that referenced this issue Jan 28, 2023
lucoiso added a commit that referenced this issue Jan 28, 2023
lucoiso added a commit that referenced this issue Jan 28, 2023
lucoiso added a commit that referenced this issue Jan 29, 2023
lucoiso added a commit that referenced this issue Jan 29, 2023
lucoiso added a commit that referenced this issue Jan 29, 2023
lucoiso added a commit that referenced this issue Jan 29, 2023
…ive search by the type of the files inside plugin's binaries
lucoiso added a commit that referenced this issue Jan 30, 2023
@1165048017
Copy link

1165048017 commented Apr 10, 2023

Hi, my compuyter is Apple M1,
When build for Mac, there are some errors and the log is here:
Showing Recent Messages
ld: in /Users/xxxx/Documents/Unreal Projects/ChatGPT/Plugins/UEAzSpeech/Source/ThirdParty/AzureWrapper/libs/Mac/x64/libMicrosoft.CognitiveServices.Speech.core.a(event_helpers.cpp.o), building for macOS, but linking in object file built for Mac Catalyst, file '/Users/xxxx/Documents/Unreal Projects/ChatGPT/Plugins/UEAzSpeech/Source/ThirdParty/AzureWrapper/libs/Mac/x64/libMicrosoft.CognitiveServices.Speech.core.a' for architecture x86_64
企业微信20230410-162634@2x


I found that the lib files(.a/.dylib) for Mac platform in the ThirdParty are from different folder:
.a files from:

  1. maccatalyst-arm64
  2. maccatalyst-arm64

.dylib files from:

  1. osx-arm64
  2. osx-x64

So that when I compile the source code, it tell me that Mac catalyst is not compatible with MacOS?

@lucoiso
Copy link
Owner Author

lucoiso commented Apr 10, 2023

Hi @1165048017 ! :)

I'll check this and try some adjustments. Did you try using this branch: https://github.com/lucoiso/UEAzSpeech/tree/experimental/MULTI-PLATFORM ? Can you test it? :)

@1165048017
Copy link

@lucoiso
Yes, I check my branch again:
gitbranch

By the way, an error occured before the MacOs & Mac catalyst
mannualcopy
I just copied one of .a files from Mac folder into my Engine/Source folder and solved it.

But, after that, the MacOS & Mac catalyst problem appeared again
企业微信20230411-112343@2x

@lucoiso
Copy link
Owner Author

lucoiso commented Apr 13, 2023

Made new changes, can you try again? 👀

@1165048017
Copy link

1165048017 commented Apr 16, 2023

@lucoiso GOOD JOB, it works now;
The text to speech or audio works well on my MacOS; I will test it on my iPhone soon.
By the way! Another stupid question T_T !
I don't know how to convert the voice input from my microphone to text; I see the Speech to Text button in the sample project, should I continuously press it, or just click it and then saying something, and it will stop recording after few seconds?

——————————————
IOS crash log is here
截屏2023-04-17 01 48 25

@lucoiso
Copy link
Owner Author

lucoiso commented Apr 16, 2023

@1165048017

Disabled SDK logs for iOS, i think it's the same issue that was occurring for android, can you test it again? 😯

You can test using this branch: https://github.com/lucoiso/UEAzSpeech/tree/experimental/MULTI-PLATFORM
Or disabling Azure SDK Logs in: Project Settings -> Plugins -> AzSpeech -> Information -> Disable: Enable Azure SDK Logs

@1165048017
Copy link

1165048017 commented Apr 17, 2023

@lucoiso
The Text to speech/Text to AudioData/SoundWave and SSM to Soundwavw/viseme/speech/audio data worked in my iPhone! But Text to Wav and speech to wav crashed, maybe it have no access to save file into my phone? Because I didn't see the APP ask my phone's storage access privacy.
The crash log is here
企业微信20230417-153946@2x

Additionally, It seems like that Speech/wav to text is unavailable too in my iphone ( works well in my M1). Maybe the privacy of microphone prevent it from listening my voice.

@lucoiso lucoiso changed the title iOS support Experimental: Support for iOS Platform Apr 18, 2023
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
enhancement New feature or request
Projects
Status: In Review
Development

No branches or pull requests

3 participants