Failure when converting short string to UTF-16 error_code = 1

[tristangrichard]

Running:

Realm 4.2.0
Fabric

Fatal Exception: io.realm.exceptions.RealmError: Unrecoverable error. Failure when converting short string to UTF-16 error_code = 1; retcode = 0; StringData.size = 16; StringData.data = Ma??sonnalité; StringData as hex =  0x4d 0x61 0xffffffb6 0x40 0x65 0x72 0x73 0x6f 0x6e 0x6e 0x61 0x6c 0x69 0x74 0xffffffc3 0xffffffa9; in_begin = ??sonnalité; in_end = ; out_curr = 0xbe95e374; out_end = 0xbe95e3d0; in /home/cc/repo/realm/release/realm/realm-library/src/main/cpp/io_realm_internal_UncheckedRow.cpp line 161
       at io.realm.internal.UncheckedRow.nativeGetString(UncheckedRow.java)
       at io.realm.internal.UncheckedRow.getString(UncheckedRow.java:157)
       at io.realm.ProfileRealmProxy.realmGet$secret_weapon(ProfileRealmProxy.java:1100)
       at io.realm.ProfileRealmProxy.createDetachedCopy(ProfileRealmProxy.java:3552)
       at io.realm.AccountRealmProxy.createDetachedCopy(AccountRealmProxy.java:2286)
       at io.realm.CollectionAccountRealmProxy.createDetachedCopy(CollectionAccountRealmProxy.java:968)
       at io.realm.DefaultRealmModuleMediator.createDetachedCopy(DefaultRealmModuleMediator.java:1064)
       at io.realm.Realm.createDetachedCopy(Realm.java:1598)
       at io.realm.Realm.copyFromRealm(Realm.java:1320)
       at io.realm.Realm.copyFromRealm(Realm.java:1293)
       at com.app.Fragments.Match.MatchFragment.lambda$afterViews$0$MatchFragment(MatchFragment.java:237)
       at com.app.Fragments.Match.MatchFragment$$Lambda$0.onChange(Unknown Source)
       at io.realm.internal.ObservableCollection$RealmChangeListenerWrapper.onChange(ObservableCollection.java:40)
       at io.realm.internal.ObservableCollection$CollectionObserverPair.onChange(ObservableCollection.java:21)
       at io.realm.internal.ObservableCollection$Callback.onCalled(ObservableCollection.java:65)
       at io.realm.internal.ObservableCollection$Callback.onCalled(ObservableCollection.java:55)
       at io.realm.internal.ObserverPairList.foreach(ObserverPairList.java:109)
       at io.realm.internal.OsResults.notifyChangeListeners(OsResults.java:472)
       at android.os.MessageQueue.nativePollOnce(MessageQueue.java)
       at android.os.MessageQueue.next(MessageQueue.java:323)
       at android.os.Looper.loop(Looper.java:135)
       at android.app.ActivityThread.main(ActivityThread.java:5438)
       at java.lang.reflect.Method.invoke(Method.java)
       at com.android.internal.os.ZygoteInit$MethodAndArgsCaller.run(ZygoteInit.java:762)
       at com.android.internal.os.ZygoteInit.main(ZygoteInit.java:652)

Line 237 is

realm.copyFromRealm(results.first());

[Zhuinden]

I'm not sure why this would happen, is the Realm encrypted?

[tristangrichard]

No, The most of our user are from the middle east and object can contain arabic characters!?!

[kneth]

@trr-amsiq 0xffffffb6 looks a bit odd. Do you know what Ma??sonnalité should be?

[tristangrichard]

@kneth yes, it's French and should be Ma personnalité

String data should be StringData as hex = 0x4d 0x61 0x7f 0x70 0x65 ...

[kneth]

@trr-amsiq Does it happen when processing a push notification? I wonder if it has something to do with the lifecycle of the service (and a Realm instance).

[tristangrichard]

@kneth No it does not. But the object being copied from realm can be updated by a push notification.

[kneth]

@trr-amsiq Do you by any chance have access to the Realm file? If you do, please send it to help@realm.io.

[tristangrichard]

@kneth Sadly no. It is a production error

[Zey-Uzh]

I have the same problem. Lots of crashes on production (app use Realm 5.1.0).
My configuration:

new RealmConfiguration
                .Builder()
                .name(realmName)
                .schemaVersion(Constants.DB_VERSION)
                .directory(dbDir)
                .encryptionKey(key)
                .migration(MIGRATION)
                .initialData(INIT_REALM_TX)
                .build();

Android Studio version: 3.1.2

Stacktrace:
stacktrace 2018-06-06 10-21 (UTC).log

[Zey-Uzh]

Look like this issue related to #6152

[vladimirfx]

After upgrade to Realm 5.4.1 crash become native and increase frequency:
#6152

Android Studio: 3.1.4
Realm: 5.4.1 , 5.5.0
Android OS: 6.0 - 8.1

[fourplay45]

Same for us, we have quiet a bit of crashes like this:

Fatal Exception: io.realm.exceptions.RealmErrorUnrecoverable error. Failure when converting short string to UTF-16 error_code = 1; retcode = 0; StringData.size = 14; StringData.data = ㎠in /Users/cm/Realm/realm-java-release/realm/realm-library/src/main/cpp/io_realm_internal_UncheckedRow.cpp line 161 Raw Text
  | io.realm.internal.UncheckedRow.nativeGetString (SourceFile)
  | io.realm.internal.UncheckedRow.getString (SourceFile:157)

[clj0020]

Also having this issue happen somewhat frequently in a production app.

[cmelchior]

Should be fixed in 6.0.1 (not released yet), but 6.0.1-SNAPSHOT should be available. See https://github.com/realm/realm-java/blob/master/README.md#using-snapshots

[OlegNovosad]

Unrecoverable error. Failure when converting short string to UTF-16 error_code = 1; retcode = 0; StringData.size = 15; StringData.data = '� in /Users/cm/Realm/realm-java-release/realm/realm-library/src/main/cpp/io_realm_internal_UncheckedRow.cpp line 161

Got this with Realm 6.0.2

[cmelchior]

@OlegNovosad Can you create a new issue with as much context as possible, e.g. the full stack trace, which device you are seeing it on, is encryption enabled.