Skip to content

Test(for releasing 12.0)

Jump to bottom Edit New page
Goun Lee edited this page Apr 20, 2017 · 54 revisions

Browsers test

Test Environment

  • Windows7
  • JsUnit 2.2 TestRunner (using js\test\testSuiteDyn.html)

Chrome

Running on Mozilla/5.0 (Windows NT 6.1; WOW64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/57.0.2987.133 Safari/537.36 NetHelper70

Result: Runs: 35951 Errors: 0 Failures: 0

FireFox

Running on Mozilla/5.0 (Windows NT 6.3; WOW64; rv:39.0) Getcko/20100101 Firefox/39.0 NetHelper70

Result: Runs: 35951 Errors: 0 Failures: 0

IE11

Running on Mozilla/5.0 (Windows NT 6.1; WOW64; Trident/7.0; SLCC2; .NET CLR 2.0.50727; .NET CLR 3.5.30729; .NET CLR 3.0.30729; Media Center PC 6.0; InfoPath.3; .NET4.0C; .NET4.0E; NetHelper70; CNS_UA; AD_LOGON=4C47452E4E4554; rv:11.0) like Gecko

Result: Runs: 35951 Errors: 0 Failures: 10

Tests with problems (10 total) - JsUnit

1. root/test/testGlobal.html:testGetLocaleBrowser failed

Expected <ko-KR> (String) but was <en-US> (String)


2. root/test/testGlobalCompiled.html:testGetLocaleBrowser failed

Expected <ko-KR> (String) but was <en-US> (String)


3. collate/test/testCollation.html:testCollatorWithSortUpperFirst failed

" found nested Array@0
"
Expected <e> (String) but was <E> (String)


4. collate/test/testCollation.html:testCollatorCaseMixedWithIndexMarkers_zh_Hans failed

" found nested Array@2
"
Expected <啊> (String) but was <�Banana> (String)


5. collate/test/testCollation.html:testCollatorCaseMixedWithIndexMarkers_zh_Hant_stroke failed

" found nested Array@0
"
Expected <丿> (String) but was <�.10> (String)


6. collate/test/testCollation.html:testCollatorCaseMixedWithIndexMarkers_zh_Hant_zhuyin failed

" found nested Array@1
"
Expected <褒> (String) but was <�ㄆ> (String)


7. collate/test/testCollationCompiled.html:testCollatorWithSortUpperFirst failed

" found nested Array@0
"
Expected <e> (String) but was <E> (String)


8. collate/test/testCollationCompiled.html:testCollatorCaseMixedWithIndexMarkers_zh_Hans failed

" found nested Array@2
"
Expected <啊> (String) but was <�Banana> (String)


9. collate/test/testCollationCompiled.html:testCollatorCaseMixedWithIndexMarkers_zh_Hant_stroke failed

" found nested Array@0
"
Expected <丿> (String) but was <�.10> (String)


10. collate/test/testCollationCompiled.html:testCollatorCaseMixedWithIndexMarkers_zh_Hant_zhuyin failed

" found nested Array@1
"
Expected <褒> (String) but was <�ㄆ> (String)

NOTE: Fail case 1, 2 is known issue caused by locale. Is there a way to change language(navigator.browserLanguage, navigator.browserLanguage or navigator.language) in IE11? I tried to set language to en-US in its option, but it didn't work. I could not find the way to change locale, so I modified LocaleInfo class like below:

ilib.getLocale = function () {
    if (typeof(ilib.locale) !== 'string') {
    	var plat = ilib._getPlatform();
    	switch (plat) {
    	    case 'browser':
                ilib.locale = 'en-US';
                break;

The remaining fail cases are about collation. But they are using useNative: false. (Fail case 3, 4, 5, 6 are duplicated with Fail case 7, 8, 9, 10) In Fail case 3, IE11 has same result with result of Chrome/FF, so if statement of test case is not needed anymore. But in Fail case 4, 5, 6, IE11 has different sort result compared with result of Chrome/FF. Maybe IE11 has something different in the implementation of Array.sort compared with Chrome/FF.

// IE11
�APPLE,�Apple,�Banana,�Lemon,�ORange,�Orange,�Peach,�RASPBERRY,�Raspberry,�Yam,啊,波,吃,次,德,额,佛,各,和,记,科,里,摸,那,坡,起,日,食,四,体,吴,西,一,站,子
// Chrome/FF
�APPLE,�Apple,啊,�Banana,波,吃,次,德,额,佛,各,和,记,科,�Lemon,里,摸,那,�ORange,�Orange,�Peach,坡,起,�RASPBERRY,�Raspberry,日,食,四,体,吴,西,�Yam,一,站,子

IE8

NOTE: Could not install IE8 on Windows7 in the usual way. Is it necessary for release?

NodeJS Test

Test Environment

  • webOS 4.0
  • nodejs v0.12.0

Result

# node testSuite
Running uncompiled dynamic suites:   ["util",".","calendar","date1","date2","date3","daterange1","daterange2","daterange3","durfmt","number","maps","ctype","s	trings-ext","phone1","phone2","phone3","units","name","address1","address2","address3","collate"]	

Summary - 18695 tests run, 18695 pass, 0 fail, 422.394 seconds.

QT test

Ubuntu

Test Environment

  • Ubuntu 14.04.3 LTS (GNU/Linux 3.13.0-76-generic x86_64)
  • Qt 5.6.2

Result

...
testCharmapKRMapToUnicode@file:///home/seonghyup/work/migrateilib/unit_open/js/test/maps/test/testcm_KR.js:335
[exec] @file:///home/seonghyup/work/migrateilib/unit_open/qt/UnitTest/runtests.js:42
[exec] _runAllTests@file:///home/seonghyup/work/migrateilib/unit_open/qt/UnitTest/runtests.js:35
[exec] runTests@file:///home/seonghyup/work/migrateilib/unit_open/qt/UnitTest/runtests.js:119
[exec] onCompleted@file:///home/seonghyup/work/migrateilib/unit_open/qt/UnitTest/TestEnvironment.qml:44
[exec] @file:///home/seonghyup/work/migrateilib/unit_open/qt/UnitTest/TestSuiteModule.js:86
[exec] @file:///home/seonghyup/work/migrateilib/unit_open/qt/UnitTest/runtests.js:127
[exec] runTests@file:///home/seonghyup/work/migrateilib/unit_open/qt/UnitTest/runtests.js:125
[exec] onCompleted@file:///home/seonghyup/work/migrateilib/unit_open/qt/UnitTest/TestEnvironment.qml:44
[exec] @file:///home/seonghyup/work/migrateilib/unit_open/qt/UnitTest/TestSuiteModule.js:86
[exec] @file:///home/seonghyup/work/migrateilib/unit_open/qt/UnitTest/runner.js:61
[exec] @file:///home/seonghyup/work/migrateilib/unit_open/qt/UnitTest/runner.js:59
[exec] onCompleted@file:///home/seonghyup/work/migrateilib/unit_open/qt/UnitTest/TestRunner.qml:91
[exec] FAIL: maps/test/testcm_KR.js:testCharmapKRMapToNative()
[exec]     
[exec] file:///home/seonghyup/work/migrateilib/unit_open/js/lib/Loader.js(undefined): JSON.parse: Parse errorJSON.parse: Parse error
[exec] stack:
[exec] @file:///home/seonghyup/work/migrateilib/unit_open/js/lib/Loader.js:120
[exec] @file:///home/seonghyup/work/migrateilib/unit_open/js/lib/Utils.js:302
[exec] @file:///home/seonghyup/work/migrateilib/unit_open/js/lib/Utils.js:420
[exec] @file:///home/seonghyup/work/migrateilib/unit_open/js/lib/CharmapTable.js:159
[exec] @file:///home/seonghyup/work/migrateilib/unit_open/js/lib/CharmapFactory.js:164
[exec] @file:///home/seonghyup/work/migrateilib/unit_open/js/lib/Charset.js:136
[exec] @file:///home/seonghyup/work/migrateilib/unit_open/js/lib/Utils.js:459
[exec] @file:///home/seonghyup/work/migrateilib/unit_open/js/lib/Charset.js:124
[exec] @file:///home/seonghyup/work/migrateilib/unit_open/js/lib/Utils.js:459
[exec] @file:///home/seonghyup/work/migrateilib/unit_open/js/lib/Charset.js:106
[exec] @file:///home/seonghyup/work/migrateilib/unit_open/js/lib/CharmapFactory.js:140
[exec] testCharmapKRMapToNative@file:///home/seonghyup/work/migrateilib/unit_open/js/test/maps/test/testcm_KR.js:349
[exec] @file:///home/seonghyup/work/migrateilib/unit_open/qt/UnitTest/runtests.js:42
[exec] _runAllTests@file:///home/seonghyup/work/migrateilib/unit_open/qt/UnitTest/runtests.js:35
[exec] runTests@file:///home/seonghyup/work/migrateilib/unit_open/qt/UnitTest/runtests.js:119
[exec] onCompleted@file:///home/seonghyup/work/migrateilib/unit_open/qt/UnitTest/TestEnvironment.qml:44
[exec] @file:///home/seonghyup/work/migrateilib/unit_open/qt/UnitTest/TestSuiteModule.js:86
[exec] @file:///home/seonghyup/work/migrateilib/unit_open/qt/UnitTest/runtests.js:127
[exec] runTests@file:///home/seonghyup/work/migrateilib/unit_open/qt/UnitTest/runtests.js:125
[exec] onCompleted@file:///home/seonghyup/work/migrateilib/unit_open/qt/UnitTest/TestEnvironment.qml:44
[exec] @file:///home/seonghyup/work/migrateilib/unit_open/qt/UnitTest/TestSuiteModule.js:86
[exec] @file:///home/seonghyup/work/migrateilib/unit_open/qt/UnitTest/runner.js:61
[exec] @file:///home/seonghyup/work/migrateilib/unit_open/qt/UnitTest/runner.js:59
[exec] onCompleted@file:///home/seonghyup/work/migrateilib/unit_open/qt/UnitTest/TestRunner.qml:91
[exec] Summary - 17185 tests run, 17132 pass, 53 fail, 825.538 seconds.

Analyzing...

Ubuntu

Test Environment

  • Ubuntu 12.04.5 LTS (GNU/Linux 3.11.0-26-generic x86_64)
  • Qt 5.6

goun@goun:~/Source/ilib-WindowTest/qt$ ant test.qt Buildfile: /home/goun/Source/ilib-WindowTest/qt/build.xml

test.qt: [exec] file:///home/goun/Source/ilib-WindowTest/qt/UnitTest/TestSuiteModule.js:98: ReferenceError: module is not defined [exec] qml: Running uncompiled dynamic suites: [".","address1","address2","address3","calendar","collate","ctype","date1","date2","date3","daterange1","daterange2","daterange3","durfmt","maps","name","number","phone1","phone2","phone3","strings-ext","units","util"] [exec] [exec] qml: Summary - 17185 tests run, 17185 pass, 0 fail, 746.91 seconds.

Add a custom footer
Add a custom sidebar

Clone this wiki locally