Mercurial Resolver for Bower #1448

phenomnomnominal · 2014-08-04T22:28:06Z

Seems to be working! Resolver for ssh/http/https Mercurial repositories + tests.

Bower Mercurial resolver

rayshan · 2014-08-16T01:40:36Z

Very cool! I'm not familiar w/ Mercurial, but just want to say thanks for the PR and the hard work!

sheerun · 2014-09-06T01:27:47Z

@sindresorhus Can this go to 1.4.x?

sindresorhus · 2014-09-06T07:47:42Z

Yes. Up to you :)

codingtony · 2015-01-16T16:27:52Z

Any update on this PR?

sheerun · 2015-01-16T16:29:09Z

Someone needs to review this. Currently I'm working on other bower stuff.

RobbinHabermehl · 2015-01-19T11:02:54Z

@sheerun; I'd be willing to test this PR in an actual environment, would that be of any help?

sheerun · 2015-01-19T12:46:29Z

yes :) just confirmation everything works as expected at least on short run

RobbinHabermehl · 2015-01-26T13:43:09Z

Last week I've tested this version of Bower, specifically TradeMe/bower@b64b365. I've elaborated my findings in the following table:

command	scenario	outcome
`bower install`	fresh install	working properly
`bower update`	update dependency	working properly
`bower update`	resolve specific commit	not working, seems intended
`bower update`	resolve specific branch	working properly
`bower update`	resolve specific tag	working properly

Overall, Bower supporting Mercurial in general is worth the inability to resolve to a specific commit in my opinion.

sheerun · 2015-01-26T13:45:30Z

Any clue why you cannot resolve specific commit? Is there a reason?

RobbinHabermehl · 2015-01-26T13:58:40Z

When specifying a commit like this:

{
  "dependencies": {
    "repo-name": "hg+ssh://user@domain.ext/repo-name#da39a3ee5e6b4b0d3255bfef95601890afd80709"
  }
}

Bower reports the following:

bower repo-name#da39a3ee5e6b4b0d3255bfef95601890afd80709
  ENORESTARGET Tag/branch da39a3ee5e6b4b0d3255bfef95601890afd80709 does not exist

Considering the fact that "Tag/branch" is mentioned specifically implicates the lack of commit resolving is intended. Also, when looking at the source code and unit tests the commit resolving mechanism just seems to be absent.

sheerun · 2015-01-26T14:07:34Z

There seems to be commit detection: https://github.com/TradeMe/bower/blob/master/lib/core/resolvers/HgResolver.js#L158-L165

It works incorrectly then. @phenomnomnominal Could you fix it?

sheerun · 2015-01-26T14:11:09Z

I think bower shoudn't support revision number, but only changeset ids.

AFAIK using revision numbers is not deterministic?

RobbinHabermehl · 2015-01-26T14:29:18Z

It should only support changeset ID's indeed.

Apparently I've missed that feature.. Looking at the regular expression (/^r[a-f0-9]{4,40}/) the changeset ID should be prefixed with an r to mark the target as a revision. I've done so in my Bower configuration and now it works as expected!

The prefixing feels off though, especially since it's not the way to go for Git repositories on both Bower and NPM.

phenomnomnominal · 2015-01-26T19:44:50Z

Happy to make any changes needed, what would the expected behaviour be?

sheerun · 2015-01-26T20:04:17Z

Recognize commits as /[a-f0-9]{40}/

sheerun · 2015-01-26T20:04:45Z

Plus maybe some tests

ghost · 2015-02-18T20:39:34Z

We are about to start a private bower registry and need to have Mercurial behind it. Any chance I can help getting this pull request into the master in the near future? Thx.

RobbinHabermehl · 2015-02-25T09:47:52Z

@sheerun, the tests seem to be pretty complete actually, so I went ahead with adjusting the commit resolving. As the pull request has gotten pretty outdated I tried to merge the most recent version of Bower into it. Unfortunately, this caused the following unit tests to fail:

HgResolver ._resolve should call the necessary functions by the correct order;
HgResolver ._savePkgMeta should save the release in the package meta;
HgResolver .resolve should export correctly if resolution is a tag;
HgResolver .resolve should export correctly if resolution is a commit;
HgResolver .resolve should export correctly if resolution is a branch.

@phenomnomnominal, could you please fix this? You can check out my fork to see the issues directly.

* Merged in latest bower * Update unit tests with changes * Fixed revision ID matching RegExps to not require a leading ‘r’

phenomnomnominal · 2015-02-25T21:15:44Z

@RobbinHabermehl think I've got this all sorted if someone wants to have a look.

RobbinHabermehl · 2015-02-26T11:26:21Z

@phenomnomnominal, I just checked out your updates and ran the tests. Unfortunately four unit tests are still failing, the good news is that it's one less than last time. Also, the cause of the failures has changed, there appear to be some difficulties running hg commands.

I've posted the stack traces below:

1) HgResolver ._savePkgMeta should save the release in the package meta:
     Uncaught Error: expected '0.0.1' to equal '0.0.1+build.5'
      ..
      at ~/bower/test/core/resolvers/hgResolver.js:726:42
      ...
  From previous event:
      ...
      at Context.<anonymous> (~/bower/test/core/resolvers/hgResolver.js:761:14)
      ...

  2) HgResolver .resolve should export correctly if resolution is a tag:
     Uncaught Error: Failed to execute "hg branches", exit code of #255
      at createError (~/bower/lib/util/createError.js:4:15)
      at ChildProcess.<anonymous> (~/bower/lib/util/cmd.js:102:21)
      at ChildProcess.emit (events.js:110:17)
      at maybeClose (child_process.js:1008:16)
      at Process.ChildProcess._handle.onexit (child_process.js:1080:5)
  From previous event:
      at Function.defer (~/bower/node_modules/q/q.js:542:19)
      at executeCmd (~/bower/lib/util/cmd.js:61:22)
      at PThrottler._processEntry (~/bower/node_modules/p-throttler/index.js:89:25)
      at Promise.apply (~/bower/node_modules/p-throttler/node_modules/q/q.js:1122:26)
      at Promise.promise.promiseDispatch (~/bower/node_modules/p-throttler/node_modules/q/q.js:752:41)
      at ~/bower/node_modules/p-throttler/node_modules/q/q.js:1337:14
      at flush (~/bower/node_modules/p-throttler/node_modules/q/q.js:108:17)

  3) HgResolver .resolve should export correctly if resolution is a commit:
     Uncaught Error: Failed to execute "hg clone ~/bower/test/assets/package-hg -r 0 /var/folders/t3/36f8vf4510791gy9sfjs__qm0000gn/T/Robbin/bower/package-hg-94711-ftC4Wb", exit code of #255
      ... Stack trace is identical to 2 ...

  4) HgResolver .resolve should export correctly if resolution is a branch:
     Uncaught Error: Failed to execute "hg branches", exit code of #255
      at createError (~/bower/lib/util/createError.js:4:15)
      at ChildProcess.<anonymous> (~/bower/lib/util/cmd.js:102:21)
      at ChildProcess.emit (events.js:110:17)
      at maybeClose (child_process.js:1008:16)
      at Process.ChildProcess._handle.onexit (child_process.js:1080:5)
  From previous event:
      at Function.defer (~/bower/node_modules/q/q.js:542:19)
      at executeCmd (~/bower/lib/util/cmd.js:61:22)
      at PThrottler._processEntry (~/bower/node_modules/p-throttler/index.js:89:25)
      at Promise.apply (~/bower/node_modules/p-throttler/node_modules/q/q.js:1122:26)
      at Promise.promise.promiseDispatch (~/bower/node_modules/p-throttler/node_modules/q/q.js:752:41)
      at ~/bower/node_modules/p-throttler/node_modules/q/q.js:1337:14
      at flush (~/bower/node_modules/p-throttler/node_modules/q/q.js:108:17)

phenomnomnominal · 2015-02-26T11:29:18Z

Hmm that's bizarre, they all pass on my machine. I'll investigate further!

RobbinHabermehl · 2015-02-26T12:17:59Z

Perhaps it has to do with the OS, Node.js or Mercurial? I'm running Mac OS X 10.10, Node.js is running version 0.12.0 and my Mercurial version is 3.1.1. The Node.js dependencies are up to date as I performed a fresh install.

phenomnomnominal · 2015-02-26T21:40:15Z

@RobbinHabermehl Yeah it might be something, although I just ran them on my Windows box at work and they all passed (apart from some breaking due to different new line characters). I'll try updating my mercurial at home and having another go.

RobbinHabermehl · 2015-02-27T12:51:21Z

I just updated Mercurial to version 3.3 and the number of failing tests has been reduced a little further, now only three tests are failing:

 1) HgResolver .resolve should export correctly if resolution is a tag:
     Uncaught Error: Failed to execute "hg tags", exit code of #255
      at createError (~/bower/lib/util/createError.js:4:15)
      at ChildProcess.<anonymous> (~/bower/lib/util/cmd.js:102:21)
      at ChildProcess.emit (events.js:110:17)
      at maybeClose (child_process.js:1008:16)
      at Process.ChildProcess._handle.onexit (child_process.js:1080:5)
  From previous event:
      at Function.defer (~/bower/node_modules/q/q.js:542:19)
      at executeCmd (~/bower/lib/util/cmd.js:61:22)
      at PThrottler._processEntry (~/bower/node_modules/p-throttler/index.js:89:25)
      at Promise.apply (~/bower/node_modules/p-throttler/node_modules/q/q.js:1122:26)
      at Promise.promise.promiseDispatch (~/bower/node_modules/p-throttler/node_modules/q/q.js:752:41)
      at ~/bower/node_modules/p-throttler/node_modules/q/q.js:1337:14
      at flush (~/bower/node_modules/p-throttler/node_modules/q/q.js:108:17)

  2) HgResolver .resolve should export correctly if resolution is a commit:
     Uncaught Error: Failed to execute "hg clone ~/bower/test/assets/package-hg -r 0 /var/folders/t3/36f8vf4510791gy9sfjs__qm0000gn/T/Robbin/bower/package-hg-99099-fWA8ts", exit code of #255
      ... Identical to 1 ...

  3) HgResolver .resolve should export correctly if resolution is a branch:
     Uncaught Error: Failed to execute "hg branches", exit code of #255
      ... Identical to 1 and 2 ...

Apparently something causes Mercurial to exit with status code 255.

phenomnomnominal · 2015-03-07T02:53:53Z

Still can't repro this, tried a few machines...

RobbinHabermehl · 2015-03-10T13:41:06Z

I tried removing the repository locally and cloning it again, but then I'm still encountering these three failing tests. In order to determine whether the problems are caused by my MacBook I ran the tests on another machine (OS X 10.10.2, Node.js v0.12.0, NPM v2.5.1 and Mercurial v3.3) as well, unfortunately resulting in the same errors.

As this didn't help I started to dig deeper and started to analyze the stdout and stderr of the failing hg commands. Per failing test I logged both and the output is as follows:

1) HgResolver .resolve should export correctly if resolution is a tag

hg clone /Users/Robbin/Development/bower/test/assets/package-hg /var/folders/t3/36f8vf4510791gy9sfjs__qm0000gn/T/Robbin/bower/package-hg-4530-XZEzT9
abort: repository /Users/Robbin/Development/bower/test/assets/package-hg not found!

hg clone /Users/Robbin/Development/bower/test/assets/package-hg /var/folders/t3/36f8vf4510791gy9sfjs__qm0000gn/T/Robbin/bower/package-hg-4530-rsZ3Ey
abort: repository /Users/Robbin/Development/bower/test/assets/package-hg not found!

hg branches
abort: no repository found in '/private/var/folders/t3/36f8vf4510791gy9sfjs__qm0000gn/T/Robbin/bower/package-hg-4530-XZEzT9' (.hg not found)!

2) HgResolver .resolve should export correctly if resolution is a commit

hg tags
abort: no repository found in '/private/var/folders/t3/36f8vf4510791gy9sfjs__qm0000gn/T/Robbin/bower/package-hg-4530-rsZ3Ey' (.hg not found)!

hg clone /Users/Robbin/Development/bower/test/assets/package-hg -r 0 /var/folders/t3/36f8vf4510791gy9sfjs__qm0000gn/T/Robbin/bower/package-hg-4530-FIrLd8
abort: repository /Users/Robbin/Development/bower/test/assets/package-hg not found!

3) HgResolver .resolve should export correctly if resolution is a branch

Due to the order in the console it seems that no errors are related to the third failing test. Mocha's stack trace shows the cause is Failed to execute "hg branches", exit code of #255 though. Therefore the order is probably just a timing thing making my grouping incorrect.

Two of the logs clearly state the .hg file is missing, perhaps this could lead to something?

phenomnomnominal · 2015-03-11T03:55:53Z

Awesome, will look into this tonight!

phenomnomnominal · 2015-03-15T08:52:56Z

I have no idea what this is. Can't reproduce, have cloned it on every computer I have access to. Stumped.

RobbinHabermehl · 2015-03-19T15:34:21Z

Which OS's have you tried @phenomnomnominal? And which version of Node.js was installed? I just noticed Bower is optimized for Node.js v0.10.0, while I've been running v0.12.0 on both devices. Perhaps that's the cause.

I guess that appveyor.yml should be extended with a choco install hg in order to support the Mercurial tests on the CI server. Can you confirm whether the absence of this is the cause of the failed build @sheerun? I can't seem to find any details about the PR's build.

phenomnomnominal · 2015-03-21T00:29:00Z

Tried it on Windows 7 and OS X 10.10, both with 0.10.36. I'm not sure if the node version would be the problem, because node is basically just running Mercurial. It must be an issue with how Mercurial is running. Frustrating.

RobbinHabermehl · 2015-03-23T11:08:43Z

Done, without errors. I reverted Node.js to version 0.10.32 and now it works like a charm!

Later today I'll run the integration tests again to determine whether this PR can finally be merged.

RobbinHabermehl · 2015-03-23T12:39:57Z

As promised, hereby the results of my integration tests:

command	scenario	outcome
`bower install`	fresh install	working properly
`bower update`	update dependency	working properly
`bower update`	resolve specific commit	working properly (!)
`bower update`	resolve specific branch	working properly
`bower update`	resolve specific tag	working properly

As you can see all of these scenarios have passed now.

@sheerun, could you take a look at my previous question and let us know how to handle that? Once that's been taken care of, this pull request seems ready to be merged!

sheerun · 2015-04-07T23:24:51Z

@phenomnomnominal I have time to look at it. Could you rebase it on master? There were many changes there since this PR (including many more tests to possibly fail).

We need passing tests on all platforms (Linux, OSX on Travis and Windows on Appveyor).

sheerun · 2015-04-07T23:29:42Z

Also, please fix indentation and whitespacing (tabs instead of 4 spaces etc.) :)

renegat4 · 2015-07-15T15:57:06Z

Any news on this? I would realy like to see Mercurial support in bower.

sheerun · 2015-07-15T16:20:30Z

Yes, pluggable revolvers I'm working on will allow it.

On Wednesday, July 15, 2015, renegat4 notifications@github.com wrote:

Any news on this? I would realy like to see Mercurial support in bower.

—
Reply to this email directly or view it on GitHub
#1448 (comment).

phenomnomnominal · 2015-07-16T03:53:05Z

Sorry, this thing has fallen off my radar a bit as my current project is no longer using bower. I will hopefully have some free time to get this PR sorted and up to date it if is still even required?

alvaromb · 2015-07-16T06:59:27Z

Yes, that would be awesome @phenomnomnominal. We use mercurial in our company and we're struggling to find a reasonable option to handle common, non-public front-end libraries. Let me know if I can help you with anything.

sheerun · 2015-09-07T20:34:30Z

@phenomnomnominal I managed to implement Pluggable Resolvers interface for Bower. It has different (simpler) API than native resolvers, so some refactor is needed to implement Mercurial resolver, but now you can publish it by yourself :) No need to wait for anyone to review.

I really appreciate the work you've done! I hope you'd find time to re-write it as Pluggable Resolver.

The plan is to re-write all native resolvers as plugin resolvers, and switch to them in Bower 2.0. I'm looking forward to to include Mercurial as one of the built-in pluggable resolvers.

tetor · 2015-09-08T08:44:03Z

It's good news!
@phenomnomnominal @sheerun Nice work 😄

phenomnomnominal · 2015-09-08T09:49:07Z

I'm having a look at this now, will see how I get on in the next couple of days. Repo will be here: https://github.com/phenomnomnominal/mercurial-bower-resolver

phenomnomnominal · 2015-09-13T05:18:22Z

https://github.com/phenomnomnominal/mercurial-bower-resolver is pretty much working now, please try it and open issues!

ormico · 2016-11-16T01:56:25Z

is the intention still to ship the mercurial resolver plug-in as one of the build-in resolvers?

phenomnomnominal and others added 2 commits August 5, 2014 10:05

Bower Mercurial resolver

c527986

Merge pull request #1 from phenomnomnominal/master

b64b365

Bower Mercurial resolver

phenomnomnominal mentioned this pull request Aug 5, 2014

Support version control tools other than git ? #329

Closed

sheerun added the enhancement label Sep 6, 2014

sindresorhus added this to the 1.4.x milestone Sep 6, 2014

sindresorhus assigned sheerun Sep 6, 2014

sheerun removed their assignment Jan 16, 2015

Merged latest, fixed UTs, fixed revision ID RegExp

0c27039

* Merged in latest bower * Update unit tests with changes * Fixed revision ID matching RegExps to not require a leading ‘r’

sheerun closed this Sep 7, 2015

Mercurial Resolver for Bower #1448

Mercurial Resolver for Bower #1448

Conversation

phenomnomnominal commented Aug 4, 2014

rayshan commented Aug 16, 2014

sheerun commented Sep 6, 2014

sindresorhus commented Sep 6, 2014

codingtony commented Jan 16, 2015

sheerun commented Jan 16, 2015

RobbinHabermehl commented Jan 19, 2015

sheerun commented Jan 19, 2015

RobbinHabermehl commented Jan 26, 2015

sheerun commented Jan 26, 2015

RobbinHabermehl commented Jan 26, 2015

sheerun commented Jan 26, 2015

sheerun commented Jan 26, 2015

RobbinHabermehl commented Jan 26, 2015

phenomnomnominal commented Jan 26, 2015

sheerun commented Jan 26, 2015

sheerun commented Jan 26, 2015

ghost commented Feb 18, 2015

RobbinHabermehl commented Feb 25, 2015

phenomnomnominal commented Feb 25, 2015

RobbinHabermehl commented Feb 26, 2015

phenomnomnominal commented Feb 26, 2015

RobbinHabermehl commented Feb 26, 2015

phenomnomnominal commented Feb 26, 2015

RobbinHabermehl commented Feb 27, 2015

phenomnomnominal commented Mar 7, 2015

RobbinHabermehl commented Mar 10, 2015

phenomnomnominal commented Mar 11, 2015

phenomnomnominal commented Mar 15, 2015

RobbinHabermehl commented Mar 19, 2015

phenomnomnominal commented Mar 21, 2015

RobbinHabermehl commented Mar 23, 2015

RobbinHabermehl commented Mar 23, 2015

sheerun commented Apr 7, 2015

sheerun commented Apr 7, 2015

renegat4 commented Jul 15, 2015

sheerun commented Jul 15, 2015

phenomnomnominal commented Jul 16, 2015

alvaromb commented Jul 16, 2015

sheerun commented Sep 7, 2015

tetor commented Sep 8, 2015

phenomnomnominal commented Sep 8, 2015

phenomnomnominal commented Sep 13, 2015

ormico commented Nov 16, 2016