Has swiping/scrolling changed in some way, shape or form recently? (iOS)

[tking16]

A large majority of our test suite has started failing out of the blue from a couple weeks ago and I'm not sure why. Investigating it seems the driver.execute_script which handles most of the swiping in our suite just refuses to do anything anymore (TouchActions are also doing nothing now it seems).

This issue seems to be happening on the latest version 1.22.2 and the 2.3 beta. Been stuck for about 2 days now but from what I've read there hasn't been changes to scrolling or anything unless I missed something?

For some more info the Python code I'm running is below (in this case, self._within is equal to None)

driver.execute_script("mobile: swipe", {"direction": 'up', "element": self._within, "velocity": 0.2})

And Appiums output is as follows:

2022-01-05 15:41:07:482 - [HTTP] --> POST /wd/hub/session/814f46c7-605e-4ead-a62f-a49611868788/execute/sync
2022-01-05 15:41:07:482 - [HTTP] {"script":"mobile: swipe","args":[{"direction":"up","element":{"element-6066-11e4-a52e-4f735466cecf":"67000000-0000-0000-6EBB-000000000000"},"velocity":0.2}]}
2022-01-05 15:41:07:484 - [debug] [W3C (814f46c7)] Calling AppiumDriver.execute() with args: ["mobile: swipe",[{"direction":"up","element":{"element-6066-11e4-a52e-4f735466cecf":"67000000-0000-0000-6EBB-000000000000"},"velocity":0.2}],"814f46c7-605e-4ead-a62f-a49611868788"]
2022-01-05 15:41:07:485 - [debug] [XCUITest] Executing command 'execute'
2022-01-05 15:41:07:485 - [XCUITest] The 'element' argument name is deprecated. Consider using 'elementId' instead
2022-01-05 15:41:07:495 - [XCUITest] Proxying to WDA with an unknown route: POST /wda/element/67000000-0000-0000-6EBB-000000000000/swipe
2022-01-05 15:41:07:497 - [debug] [WD Proxy] Proxying [POST /wda/element/67000000-0000-0000-6EBB-000000000000/swipe] to [POST http://127.0.0.1:8100/session/69FCEC5C-8E84-4444-A808-5C0959246346/wda/element/67000000-0000-0000-6EBB-000000000000/swipe] with body: {"direction":"up","velocity":0.2}
2022-01-05 15:41:12:789 - [debug] [WD Proxy] Got response with status 200: {"value":null,"sessionId":"69FCEC5C-8E84-4444-A808-5C0959246346"}
2022-01-05 15:41:12:789 - [debug] [W3C (814f46c7)] Responding to client with driver.execute() result: null
2022-01-05 15:41:12:790 - [HTTP] <-- POST /wd/hub/session/814f46c7-605e-4ead-a62f-a49611868788/execute/sync 200 5308 ms - 14
2022-01-05 15:41:12:790 - [HTTP]

Anyway thanks for any insight, not sure if this is the right forum to be posting such things.
Logs above are from Appium 2's latest beta

[tking16]

Just a quick update, I'm also trying "doubleTap" from execute_script also a 200 response with nothing being done in the app

edit: info about driver
xcuitest@3.59.0 [installed (NPM)] [Up to date]

[KazuCocoa]

This issue seems to be happening on the latest version 1.22.2 and the 2.3 beta.

So, this did not occur with the older versions, correct?

[tking16]

I cannot say anything without appium logs, and in the case probably showXcodeLog capability enabled one.

Is this what you meant? I've added the capability to show the Xcode logs, so when I run the swipe command it gives back this

2022-01-07 11:04:51:236 - [HTTP] --> POST /wd/hub/session/6a64acc6-bf8e-4179-b019-e43816ccc9bb/execute/sync
2022-01-07 11:04:51:236 - [HTTP] {"script":"mobile: swipe","args":[{"direction":"up","element":null,"velocity":0.2}]}
2022-01-07 11:04:51:237 - [debug] [W3C (6a64acc6)] Calling AppiumDriver.execute() with args: ["mobile: swipe",[{"direction":"up","element":null,"velocity":0.2}],"6a64acc6-bf8e-4179-b019-e43816ccc9bb"]
2022-01-07 11:04:51:237 - [debug] [XCUITest] Executing command 'execute'
2022-01-07 11:04:51:238 - [debug] [BaseDriver] Waiting up to 0 ms for condition
2022-01-07 11:04:51:241 - [debug] [WD Proxy] Matched '/element' to command name 'findElement'
2022-01-07 11:04:51:241 - [debug] [WD Proxy] Proxying [POST /element] to [POST http://127.0.0.1:8100/session/949C2857-43B4-49BE-BD65-3F7D121E51DE/element] with body: {"using":"class name","value":"XCUIElementTypeApplication"}
2022-01-07 11:04:51:249 - [Xcode] 2022-01-07 11:04:51.248196+0000 WebDriverAgentRunner-Runner[9319:96086] Getting the most recent active application (out of 1 total items)
2022-01-07 11:04:51:249 - [Xcode]
2022-01-07 11:04:51:250 - [Xcode]     t =   718.20s Get all elements bound by accessibility element for: Descendants matching type Application
2022-01-07 11:04:51:250 - [Xcode]
2022-01-07 11:04:51:252 - [Xcode]     t =   718.21s     Requesting snapshot of accessibility hierarchy for app with pid 9329
2022-01-07 11:04:51:252 - [Xcode]
2022-01-07 11:04:51:291 - [Xcode]     t =   718.24s     Find: Descendants matching type Application
2022-01-07 11:04:51:291 - [Xcode]
2022-01-07 11:04:51:294 - [Xcode]     t =   718.25s Requesting snapshot of accessibility hierarchy for app with pid 9329
2022-01-07 11:04:51:294 - [Xcode]
2022-01-07 11:04:51:330 - [debug] [WD Proxy] Got response with status 200: {"value":{"ELEMENT":"01000000-0000-0000-7124-000000000000","element-6066-11e4-a52e-4f735466cecf":"01000000-0000-0000-7124-000000000000"},"sessionId":"949C2857-43B4-49BE-BD65-3F7D121E51DE"}
2022-01-07 11:04:51:337 - [XCUITest] Proxying to WDA with an unknown route: POST /wda/element/01000000-0000-0000-7124-000000000000/swipe
2022-01-07 11:04:51:339 - [debug] [WD Proxy] Proxying [POST /wda/element/01000000-0000-0000-7124-000000000000/swipe] to [POST http://127.0.0.1:8100/session/949C2857-43B4-49BE-BD65-3F7D121E51DE/wda/element/01000000-0000-0000-7124-000000000000/swipe] with body: {"direction":"up","velocity":0.2}
2022-01-07 11:04:51:341 - [Xcode]     t =   718.29s Requesting snapshot of accessibility hierarchy for app with pid 9329
2022-01-07 11:04:51:341 - [Xcode]
2022-01-07 11:04:51:377 - [Xcode]     t =   718.33s Swipe up Application 'com.xxxx.guacamole.development'
2022-01-07 11:04:51:377 - [Xcode]
2022-01-07 11:04:51:377 - [Xcode] 2022-01-07 11:04:51.377515+0000 WebDriverAgentRunner-Runner[9319:96086] Waiting up to 10s until com.xxxx.guacamole.development is in idle state (including animations)
2022-01-07 11:04:51:378 - [Xcode]
2022-01-07 11:04:51:378 - [Xcode]     t =   718.33s     Wait for com.xxxx.guacamole.development to idle
2022-01-07 11:04:51:378 - [Xcode]
2022-01-07 11:04:51:382 - [Xcode]     t =   718.34s     Find the Application 'com.xxxx.guacamole.development'
2022-01-07 11:04:51:382 - [Xcode]
2022-01-07 11:04:51:382 - [Xcode]     t =   718.34s         Requesting snapshot of accessibility hierarchy for app with pid 9329
2022-01-07 11:04:51:383 - [Xcode]
2022-01-07 11:04:51:419 - [Xcode]     t =   718.37s     Application is configured to skip UI interruption handling
2022-01-07 11:04:51:420 - [Xcode]
2022-01-07 11:04:51:422 - [Xcode]     t =   718.38s     Synthesize event
2022-01-07 11:04:51:422 - [Xcode]
2022-01-07 11:04:56:563 - [Xcode] 2022-01-07 11:04:56.563226+0000 WebDriverAgentRunner-Runner[9319:96086] Waiting up to 10s until com.xxxx.guacamole.development is in idle state (including animations)
2022-01-07 11:04:56:564 - [Xcode]
2022-01-07 11:04:56:564 - [Xcode]     t =   723.52s     Wait for com.xxxx.guacamole.development to idle
2022-01-07 11:04:56:564 - [Xcode]
2022-01-07 11:04:56:570 - [debug] [WD Proxy] Got response with status 200: {"value":null,"sessionId":"949C2857-43B4-49BE-BD65-3F7D121E51DE"}
2022-01-07 11:04:56:571 - [debug] [W3C (6a64acc6)] Responding to client with driver.execute() result: null
2022-01-07 11:04:56:571 - [HTTP] <-- POST /wd/hub/session/6a64acc6-bf8e-4179-b019-e43816ccc9bb/execute/sync 200 5335 ms - 14
2022-01-07 11:04:56:571 - [HTTP]

It says it's waiting for the app to idle but it doesn't move!

[KazuCocoa]

My comment was for Original error: connect ECONNREFUSED 127.0.0.1:8100 to get xcode log.

Waiting up to 10s until com.xxxx.guacamole.development is in idle state (including animations)

This message was by iOS. So, your app view was not idle as iOS system (not Appium layer). Then, XCTest could not interact with it since XCTest (UI) worked in the main thread. Your dev team may know of possible animation or processes running in the main thread.

Possibly animationCoolOffTimeout and waitForIdleTimeout capabilities/settings in https://github.com/appium/appium-xcuitest-driver helps to ignore/customize them, but these capabilities are hacky workaround in appium/WDA layer by injecting vanilla XCTest framework.

[tking16]

Hi, dev team says they don't know of any processes going on in the background. I tried thee workarounds but they do absolutely nothing

    "capabilities": {
        "platformName": "iOS",
        "platformVersion": "15.2",
        "deviceName": "iPhone 12 Pro Max",
        "newCommandTimeout": 10,
        "autoGrantPermissions": "false",
        "showXcodeLog": "true",
        "fullReset": "true",
        "waitForIdleTimeout": 0,
        "animationCoolOffTimeout": 0
    }

Thanks for the help anyway

[tking16]

@KazuCocoa okay further developments! It seems that the scrolling does work INITIALLY but then starts break after a 2nd attempt. I didn't notice it first scrolled as my velocity was set to 0.2 (I set this before the velocity fix so it was scrolling fairly aggressively beforehand). As I stopped the test in the python debugger and tried to adjust the velocity to much higher number I saw no difference at all.

Now I've just tried to run again but this time setting the velocity to 2500 before it tries with a value of 0.2 and it worked! I think there might be a bug with appium where tests can break if velocity is set to a Float value; as then it gives us Got response with status 200: {"value":null,"sessionId":"10BBD1A8-84B4-4D5D-9A14-C6294AFC217C"}

[KazuCocoa]

I see, thanks for the result.

mm, until 1.22, Appium did not support velocity for mobile:swipe. https://github.com/appium/appium-xcuitest-driver#mobile-swipe also addresses 250 or 2500 etc instead of floating.
So, I guess driver.execute_script("mobile: swipe", {"direction": 'up', "element": self._within, "velocity": 0.2}) (your original description) worked before appium 1.22.0, simply the velocity was ignored.