[snapshot] Ability to record video #10121

laullon · 2017-08-23T13:57:28Z

Checklist

I've run bundle exec rspec from the root directory to see all new and existing tests pass
I've followed the fastlane code style and run bundle exec rubocop -a to ensure the code style is valid
I've read the Contribution Guidelines
I've updated the documentation if necessary.

Motivation and Context

This change add Snapshot to the ability to record videos of iOS applications, using the same method used to take screenshots.
There is a bug open for this: #8759
This was tested using:

Xcode 8.3
Xcode 9.0 (Beta 6)

Description

I have created a light/simple HTTP server that is used by SnapshotHelper.swift to send the startRecording and stopRecording commands to snapshot.rb that will execute\kill the xcrun simctl io booted recordVideo

@KrauseFx

…Helper.swift" -> "snapshot.rb" communication to remove a dependency. Feedback addressed @KrauseFx

rubocop

googlebot · 2017-08-23T13:57:32Z

Thanks for your pull request. It looks like this may be your first contribution to a Google open source project. Before we can look at your pull request, you'll need to sign a Contributor License Agreement (CLA).

📝 Please visit https://cla.developers.google.com/ to sign.

Once you've signed, please reply here (e.g. I signed it!) and we'll verify. Thanks.

If you've already signed a CLA, it's possible we don't have your GitHub username or you're using a different email address. Check your existing CLA data and verify that your email is set on your git commits.
If your company signed a CLA, they designated a Point of Contact who decides which employees are authorized to participate. You may need to contact the Point of Contact for your company and ask to be added to the group of authorized contributors. If you don't know who your Point of Contact is, direct the project maintainer to go/cla#troubleshoot.
In order to pass this check, please resolve this problem and have the pull request author add another comment and the bot will run again.

laullon · 2017-08-23T14:00:17Z

I signed it!

googlebot · 2017-08-23T14:00:21Z

CLAs look good, thanks!

laullon · 2017-08-23T14:07:02Z

I need to do some changes to apply recent changes on Snapshot

…with Xcode 9 (fastlane#9570)' change (Only for xCode 8 for now)

laullon · 2017-08-23T15:27:36Z

done, all is working now

joshdholtz

This is super cool! Requested one change to add method doc on execute for new parameter.

Also, is there anyway to add tests for this? 😇

joshdholtz · 2017-08-23T15:55:51Z

fastlane_core/lib/fastlane_core/command_executor.rb

@@ -30,7 +30,7 @@ def which(cmd)
      # @param prefix [Array] An array containing a prefix + block which might get applied to the output


Can we get the pidCreated added to this comment/doc here? ^ 😇

KrauseFx · 2017-09-06T19:27:37Z

Hey @laullon, that's so awesome, thanks for your contribution, I love the idea to use snapshot to create videos. Could you tell us a little more about why we need a HTTP server to communicate? I thought it should be possible to do that without a web server.

brunomunizaf · 2017-09-07T09:13:26Z

I need this PR to be approved so much... Really appreciate the work @laullon !

laullon · 2017-09-07T12:53:14Z

I added the "HTTP Server" because I need a way to communicate the XCTests running on the simulator and the Snapshot process, so it knows when start and stop the recording. I did it that way because:

Is very simple to implement on the Snapshot side, just a TCPServer listening on a random port (for security)
On the simulator side is very simple to send the command, just a simple URLSession
Supports multiples clients (which came handy for Xcode 9 multi simulator support)

This doesn't represent a security problem because this server only support 2 get URLs, any other URL or HTTP command is ignored, any HTTP header is also ignored, and it listen on a different port every time.

KrauseFx · 2017-09-07T19:19:45Z

Yeah, I'm not too worried about the security in this case, but about the complexity that this will add to the code base

laullon · 2017-09-11T08:30:00Z

yeah, "HTTP Server" sounds complex, but is really very simple...

Anyway, if you have a better way in mind let me know, I'll try it.

ChristianSteffens · 2017-09-19T14:53:02Z

This is a great addition to snapshot - especially since Apple is pushing towards the usage of videos in the AppStore.

What is the current position on this PR? Does is need some more testing or is the http server a problem? The http server might be handy for further additions / actions to control the simulator.

KrauseFx · 2017-09-19T15:27:41Z

Yeah, I thought it's possible using

xcrun simctl io booted recordVideo

laullon · 2017-09-19T15:36:10Z

I use "xcrun simctl io" to record the video, but I don't use the "booted" option because in Xcode 9 you can have multiple simulator running, so it had to called with a divide ID.

KrauseFx · 2017-09-19T15:40:40Z

Yeah, but that should still work, right? First, launch up a simulator, get its UDID, and then use that to record the video. For video recording in snapshot (or a new action/tool?), I feel like it would totally be okay to require Xcode 9 to use the feature 👍

laullon · 2017-09-19T16:03:23Z

That's what I do... and It works on Xcode 8 and 9

ffittschen · 2017-10-01T18:49:52Z

snapshot/lib/assets/SnapshotHelper.swift

+    sendCommand(commnad: "stopRecording")
+}
+
+func sendCommand(commnad: String,args: String = "") {


There is a typo in the attribute name: commnad should be command

ffittschen · 2017-10-01T18:51:40Z

fastlane_core/lib/fastlane_core/command_executor.rb

      # @param error [Block] A block that's called if an error occurs
      # @param prefix [Array] An array containing a prefix + block which might get applied to the output
      # @param loading [String] A loading string that is shown before the first output
      # @return [String] All the output as string
-      def execute(command: nil, print_all: false, print_command: true, error: nil, prefix: nil, loading: nil)
+      def execute(command: nil, print_all: false, print_command: true, pidCreated: nil, error: nil, prefix: nil, loading: nil)


The other attributes of this function all use snake_case instead of camelCase. This should be consistent

ffittschen · 2017-10-02T08:01:54Z

I agree with @KrauseFx on this. There should be a simpler way to pass the command from Xcode to fastlane other than using a http server. Maybe it just has to try it from another direction: don't start to record from inside of the UITest, but start the relevant parts of the UITest from outside of Xcode (before/after starting to record).

I could imagine something like snapshot record_videos:true will internally look similar to this execution of scan

scan(only_testing: "TestBundleA/TestSuiteVideo")

directly followed this part of your code

Thread.new do
    FastlaneCore::CommandExecutor.execute(command: "xcrun simctl io booted recordVideo #{language_folder}/#{name}.mp4",
                                          print_all: true,
                                          print_command: true,
                                          loading: "Recording video...",
                                          pidCreated: proc do |pid|
                                            @recording_pid = pid
                                          end,
                                          error: proc do |output, return_code|
                                            ErrorHandler.handle_test_error(output, return_code)
                                            UI.error "Caught error... #{return_code}"
                                            UI.error "Caught output... #{output}"
                                          end) 
end

* master: (96 commits) [snapshot] Fix unused result warning in helper (fastlane#10662) Typo Fix (fastlane#10661) Version bump to 2.62.1 (fastlane#10670) Support manual signingStyle (fastlane#10508) Dont count lane switches in metrics (fastlane#10659) Add missing html tag (fastlane#10657) Deprecates add_id_info_limits_tracking in favor of add_id_info_uses_idfa (fastlane#10653) [fastlane core] fix unit tests when Xcode 9.0 not installed (fastlane#10655) Add automatic commiting of mkdocs.yml for docs generation (fastlane#10578) [Client] Handle Faraday::ParsingError as part of Client#with_retry logic (fastlane#10646) Revert "[BuildWatcher] Handle parse error while waiting for build processing (fastlane#10621)" (fastlane#10647) [BuildWatcher] Handle parse error while waiting for build processing (fastlane#10621) Remove 'zip' example from update_info_plist (fastlane#10494) Make plugin details optional (fastlane#10628) fix leaking sw_vers (fastlane#10630) Update snapshot instructions (fastlane#10626) Update update instructions of snapshot (fastlane#10627) Don't add unneeded new-line when asking for user input (fastlane#10629) Forward match keychain password into cert (fastlane#10619) SW_VERS should be lowercase (fastlane#10625) ... # Conflicts: # README.md # cert/README.md # snapshot/README.md # snapshot/lib/assets/SnapshotHelper.swift

ohayon · 2017-12-04T20:42:22Z

Hey folks! I am just going through some older PRs and checking out the status of them. I wanted to bump this in case there was any more discussion to be had and see if we still thought this should get merged in. @laullon did you have a chance to consider the feedback of the http server? 🚀

KrauseFx · 2017-12-17T14:07:12Z

Thanks everyone, I'm gonna go ahead and close the PR for now. I think we should be able to implement video recording feature in snapshot without the need of setting up a local HTTP server 👍

Thanks for everyone's contribution on this, and sorry for having to close this PR at this time

JulesMoorhouse · 2018-02-05T12:06:26Z

Any ideas how to get rid of the 1 second of black screen at the start of the video :(

Edit: this could be several seconds. Also it delayed my first view controller in the video. I’m pretty sure the snapshot erase simulator was the cause.

@laullon any chance you can merge in recent changes from master? I tried on another branch and couldn’t get it to work, I reckon your more familiar with your changes.

One suggestion I do have is that the success of the snapshot still requires a screenshot, also putting the video in the results page would be good.

However this all works for me, good job.

For anyone else reading, I was confused over the http listener stuff but this is all contained within the swift / fastlane, you don’t need to do anything in your app to use this.

laullon · 2018-02-05T12:09:23Z

I'm not working on this right now... don't have time to it...
But there is another PR in progress: #11744

JulesMoorhouse · 2018-02-05T12:10:47Z

Yeah thats me :)

laullon · 2018-02-05T12:12:23Z

ohhh!!! right ;)

laullon added 4 commits August 10, 2017 18:53

initial basic implementation

413df98

Replace a "file watcher" for a "simple http server" for the "Snapshot…

2cdb949

…Helper.swift" -> "snapshot.rb" communication to remove a dependency. Feedback addressed @KrauseFx

Dynamic http port

669dcd1

rubocop

docs

51762b1

googlebot added the cla: no label Aug 23, 2017

googlebot added cla: yes and removed cla: no labels Aug 23, 2017

Merge branch 'master' into snapshot-record-video

00ea923

Back to work after '[snapshot] Add support for concurrent simulators …

34ff90f

…with Xcode 9 (fastlane#9570)' change (Only for xCode 8 for now)

laullon changed the title ~~Snapshot - Ability to record video~~ [snapshot] Ability to record video Aug 23, 2017

correct SnapshotHelperXcode8

4a52c10

joshdholtz requested changes Aug 23, 2017

View changes

laullon added 4 commits August 23, 2017 18:26

Documentation on the new parameter on CommandExecutor.execute

ccee71a

correct SnapshotHelper.swift

6d5f311

Video recording support on xCode 9 (beta)

c995a49

Merge branch 'master' into snapshot-record-video

938b050

KrauseFx added tool: snapshot type: feature labels Sep 6, 2017

fastlane-bot added the status: needs-attention label Sep 7, 2017

Merge branch 'master' into snapshot-record-video

ad82ba5

ffittschen reviewed Oct 1, 2017

View changes

laullon added 3 commits October 24, 2017 00:11

SnapshotHelper methods back

54eda99

@ffittschen review

acac7af

joshdholtz mentioned this pull request Nov 10, 2017

Record a video of the simulator during scan #10875

Closed

KrauseFx closed this Dec 17, 2017

fastlane-bot removed the status: needs-attention label Dec 20, 2017

JulesMoorhouse mentioned this pull request Feb 17, 2018

[WIP] Snapshot record video #11744

Closed

4 tasks

fastlane locked and limited conversation to collaborators Apr 6, 2018

[snapshot] Ability to record video #10121

[snapshot] Ability to record video #10121

laullon commented Aug 23, 2017 •

edited

googlebot commented Aug 23, 2017

laullon commented Aug 23, 2017

googlebot commented Aug 23, 2017

laullon commented Aug 23, 2017

laullon commented Aug 23, 2017

joshdholtz left a comment

joshdholtz Aug 23, 2017

laullon Aug 23, 2017

laullon Sep 6, 2017

KrauseFx commented Sep 6, 2017

brunomunizaf commented Sep 7, 2017

laullon commented Sep 7, 2017

KrauseFx commented Sep 7, 2017

laullon commented Sep 11, 2017

ChristianSteffens commented Sep 19, 2017

KrauseFx commented Sep 19, 2017

laullon commented Sep 19, 2017

KrauseFx commented Sep 19, 2017

laullon commented Sep 19, 2017 •

edited

ffittschen Oct 1, 2017 •

edited

laullon Oct 23, 2017

ffittschen Oct 1, 2017

laullon Oct 23, 2017

ffittschen commented Oct 2, 2017 •

edited

ohayon commented Dec 4, 2017

KrauseFx commented Dec 17, 2017

JulesMoorhouse commented Feb 5, 2018

laullon commented Feb 5, 2018

JulesMoorhouse commented Feb 5, 2018

laullon commented Feb 5, 2018

		@@ -30,7 +30,7 @@ def which(cmd)
		# @param prefix [Array] An array containing a prefix + block which might get applied to the output

[snapshot] Ability to record video #10121

[snapshot] Ability to record video #10121

Conversation

laullon commented Aug 23, 2017 • edited

Checklist

Motivation and Context

Description

googlebot commented Aug 23, 2017

laullon commented Aug 23, 2017

googlebot commented Aug 23, 2017

laullon commented Aug 23, 2017

laullon commented Aug 23, 2017

joshdholtz left a comment

Choose a reason for hiding this comment

joshdholtz Aug 23, 2017

Choose a reason for hiding this comment

laullon Aug 23, 2017

Choose a reason for hiding this comment

laullon Sep 6, 2017

Choose a reason for hiding this comment

KrauseFx commented Sep 6, 2017

brunomunizaf commented Sep 7, 2017

laullon commented Sep 7, 2017

KrauseFx commented Sep 7, 2017

laullon commented Sep 11, 2017

ChristianSteffens commented Sep 19, 2017

KrauseFx commented Sep 19, 2017

laullon commented Sep 19, 2017

KrauseFx commented Sep 19, 2017

laullon commented Sep 19, 2017 • edited

ffittschen Oct 1, 2017 • edited

Choose a reason for hiding this comment

laullon Oct 23, 2017

Choose a reason for hiding this comment

ffittschen Oct 1, 2017

Choose a reason for hiding this comment

laullon Oct 23, 2017

Choose a reason for hiding this comment

ffittschen commented Oct 2, 2017 • edited

ohayon commented Dec 4, 2017

KrauseFx commented Dec 17, 2017

JulesMoorhouse commented Feb 5, 2018

laullon commented Feb 5, 2018

JulesMoorhouse commented Feb 5, 2018

laullon commented Feb 5, 2018

laullon commented Aug 23, 2017 •

edited

laullon commented Sep 19, 2017 •

edited

ffittschen Oct 1, 2017 •

edited

ffittschen commented Oct 2, 2017 •

edited