p4: fix "Not a valid object name HEAD0" when unshelving #183
Conversation
Welcome to GitGitGadgetHi @mdymike, and welcome to GitGitGadget, the GitHub App to send patch series to the Git mailing list from GitHub Pull Requests. Please make sure that this Pull Request has a good description, as it will be used as cover letter. Also, it is a good idea to review the commit messages one last time, as the Git project expects them in a quite specific form:
It is in general a good idea to await the automated test ("Checks") in this Pull Request before contributing the patches, e.g. to avoid trivial issues such as unportable code. Contributing the patchesBefore you can contribute the patches, your GitHub username needs to be added to the list of permitted users. Any already-permitted user can do that, by adding a PR comment of the form Once on the list of permitted usernames, you can contribute the patches to the Git mailing list by adding a PR comment After you submit, GitGitGadget will respond with another comment that contains the link to the cover letter mail in the Git mailing list archive. Please make sure to monitor the discussion in that thread and to address comments and suggestions. If you do not want to subscribe to the Git mailing list just to be able to respond to a mail, you can download the mbox ("raw") file corresponding to the mail you want to reply to from the Git mailing list. If you use GMail, you can upload that raw mbox file via: curl -g --user "<EMailAddress>:<Password>" --url "imaps://imap.gmail.com/INBOX" -T /path/to/raw.txt |
|
/allow mdymike |
|
User mdymike is now allowed to use GitGitGadget. |
|
@mdymike please consider using your real email address (as the Git mailing list will most likely reject the patch if it has a fake email address in the author/Signed-off-by info). Also, please wrap the commit message at 74 columns/line or less. Finally, I think that you might want to add a bit more information about that Is my take on this correct? |
|
Thanks @dscho! Implemented your suggestions, yes you were right about ^ on Windows |
|
Note there are a couple of other suspicious uses of ^ however I don't have access to a non-prod perforce to test these code paths: line#1459, part of P4RollBack line#1830, part of applyCommit line#3303, part of getCommitByP4Change, called by importNewBranch If those lines have code coverage in the automatic checks I would be happy to propose the fixes, just let me know. |
|
/submit |
|
Error: Could not determine full name of mdymike |
:-( Sorry about that. GitGitGadget looks at your GitHub profile to come up with your full name so that the mails can be sent as "Mike Mueller via GitGitGadget". And since your profile does not have that information, GitGitGadget gives up. I'm currently quite busy preparing for the upcoming v2.22.0-rc0, so I am unable to change GitGitGadget right now. Would you mind changing your profile and then issuing another |
|
/submit |
|
Submitted as pull.183.git.gitgitgadget@gmail.com |
![gitgitgadget[bot]](https://avatars.githubusercontent.com/in/12836?s=60&v=4){kind=small}
| @@ -737,7 +737,7 @@ def extractLogMessageFromGitCommit(commit): | |||
|
|
|||
There was a problem hiding this comment.
On the Git mailing list, Junio C Hamano wrote (reply to this):
"Mike Mueller via GitGitGadget" <gitgitgadget@gmail.com> writes:
> From: Mike Mueller <mike.mueller@moodys.com>
>
> git p4 unshelve was failing with these errors on Windows:
>
> fatal: Not a valid object name HEAD0
> Command failed: git cat-file commit HEAD^0
>
> (git version 2.21.0.windows.1, python 2.7.16)
>
> The pOpen call used by git-p4 to invoke the git command can take either a
> string or an array as a first argument. The array form is preferred
> however the extractLogMessageFromGitCommit method was using the string
> form, which makes the caller responsible for escaping the command text
> appropriately (see https://docs.python.org/2/library/subprocess.html)
Rewrite the sentence that begin with "The array form is
preferred...", as it is somewhat unreadable. "X is preferred
because Y; however Z was using the other one" would be
understandable.
> Somewhat ironically, the carat character is the escape character in
s/carat/caret/ everywhere.
> Windows and so should be escaped (HEAD^^0). Without the extra carat, the
> OS was passing an escaped 0 to the git command instead, and the git
> command was rejecting the invalid object name "HEAD0"
>
> The behaviour can be confirmed by typing ECHO HEAD^0 at the command-
> prompt, which emits HEAD0.
>
> The solution is simply to use the array format of passing the command to
> fOpen, which is preferred and used in other parts of this code anyway.
>
> Signed-off-by: Mike Mueller <mike.mueller@moodys.com>
> ---
> git-p4.py | 2 +-
> 1 file changed, 1 insertion(+), 1 deletion(-)
>
> diff --git a/git-p4.py b/git-p4.py
> index 5b79920f46..0b5bfcbc5e 100755
> --- a/git-p4.py
> +++ b/git-p4.py
> @@ -737,7 +737,7 @@ def extractLogMessageFromGitCommit(commit):
>
> ## fixme: title is first line of commit, not 1st paragraph.
> foundTitle = False
> - for log in read_pipe_lines("git cat-file commit %s" % commit):
> + for log in read_pipe_lines(["git", "cat-file", "commit", commit]):
> if not foundTitle:
> if len(log) == 1:
> foundTitle = True
git p4 unshelve was failing with these errors: fatal: Not a valid object name HEAD0 Command failed: git cat-file commit HEAD^0 (git version 2.21.0.windows.1, python 2.7.16) The pOpen call used by git-p4 to invoke the git command can take either a string or an array as a first argument. The array form is preferred because platform-specific escaping of special characters will be handled automatically.(https://docs.python.org/2/library/subprocess.html) The extractLogMessageFromGitCommit method was, however, using the string form and so the caret (^) character in the HEAD^0 argument was not being escaped on Windows. The caret happens to be the escape character, which is why the git command was receiving HEAD0. The behaviour can be confirmed by typing ECHO HEAD^0 at the command- prompt, which emits HEAD0. The solution is simply to use the array format of passing the command to fOpen, which is recommended and used in other parts of this code anyway. Signed-off-by: Mike Mueller <mike.mueller@moodys.com>
|
@dscho do you think this looks OK and do I need to /submit again? |
Looks okay to me (but it's up to @gitster to judge), and yes, you need to |
FWIW the Git maintainer mentioned a couple of times that they strongly prefer to review patches on the Git mailing list, so there is no reason to wait with |
Cool thanks - been offline in the mountains, will submit now - thanks! |
|
/submit |
|
Submitted as pull.183.v2.git.gitgitgadget@gmail.com |
| @@ -737,7 +737,7 @@ def extractLogMessageFromGitCommit(commit): | |||
|
|
|||
There was a problem hiding this comment.
On the Git mailing list, Junio C Hamano wrote (reply to this):
"Mike Mueller via GitGitGadget" <gitgitgadget@gmail.com> writes:
> From: Mike Mueller <mike.mueller@moodys.com>
>
> git p4 unshelve was failing with these errors:
>
> fatal: Not a valid object name HEAD0
> Command failed: git cat-file commit HEAD^0
>
> (git version 2.21.0.windows.1, python 2.7.16)
>
> The pOpen call used by git-p4 to invoke the git command can take either a
> string or an array as a first argument. The array form is preferred
> because platform-specific escaping of special characters will be
> handled automatically.(https://docs.python.org/2/library/subprocess.html)
> The extractLogMessageFromGitCommit method was, however, using the string
> form and so the caret (^) character in the HEAD^0 argument was not being
> escaped on Windows. The caret happens to be the escape character, which
> is why the git command was receiving HEAD0.
In the output from
git grep 'read_pipe_lines("'
together with a few hits to harmless constant command line, we find
this line
diff = read_pipe_lines("git diff-tree -r %s \"%s^\" \"%s\"" % (self.diffOpts, id, id))
Would the caret we see there cause a similar problem? It would end
up running something like
$ git diff-tree -r -M "HEAD^" "HEAD"
There was a problem hiding this comment.
On the Git mailing list, Johannes Schindelin wrote (reply to this):
Hi Junio,
On Tue, 28 May 2019, Junio C Hamano wrote:
> "Mike Mueller via GitGitGadget" <gitgitgadget@gmail.com> writes:
>
> > From: Mike Mueller <mike.mueller@moodys.com>
> >
> > git p4 unshelve was failing with these errors:
> >
> > fatal: Not a valid object name HEAD0
> > Command failed: git cat-file commit HEAD^0
> >
> > (git version 2.21.0.windows.1, python 2.7.16)
> >
> > The pOpen call used by git-p4 to invoke the git command can take eithe=
r a
> > string or an array as a first argument. The array form is preferred
> > because platform-specific escaping of special characters will be
> > handled automatically.(https://docs.python.org/2/library/subprocess.ht=
ml)
> > The extractLogMessageFromGitCommit method was, however, using the stri=
ng
> > form and so the caret (^) character in the HEAD^0 argument was not bei=
ng
> > escaped on Windows. The caret happens to be the escape character, whi=
ch
> > is why the git command was receiving HEAD0.
>
> In the output from
>
> git grep 'read_pipe_lines("'
>
> together with a few hits to harmless constant command line, we find
> this line
>
> diff =3D read_pipe_lines("git diff-tree -r %s \"%s^\" \"%s\"" % (sel=
f.diffOpts, id, id))
>
> Would the caret we see there cause a similar problem? It would end
> up running something like
>
> $ git diff-tree -r -M "HEAD^" "HEAD"
I think you're right!
In addition, I wonder whether we would want to replace the `^` by a `~`,
which would have the same effect, but does not need quoting in Bash nor
CMD.
Ciao,
Dscho
|
This branch is now known as |
|
This patch series was integrated into pu via git@b4f728e. |
|
This patch series was integrated into pu via git@c47cb04. |
|
This patch series was integrated into pu via git@fe98c6f. |
|
This patch series was integrated into pu via git@f61ed81. |
|
This patch series was integrated into pu via git@ed433b5. |
|
This patch series was integrated into pu via git@f016246. |
|
This patch series was integrated into next via git@d45167d. |
|
This patch series was integrated into pu via git@1a7fcc0. |
|
This patch series was integrated into pu via git@3e299f3. |
|
This patch series was integrated into pu via git@0727d70. |
|
This patch series was integrated into pu via git@5142854. |
|
This patch series was integrated into pu via git@780a40b. |
|
This patch series was integrated into pu via git@ca2c63d. |
|
This patch series was integrated into pu via git@add59c4. |
|
This patch series was integrated into next via git@add59c4. |
|
This patch series was integrated into master via git@add59c4. |
|
Closed via add59c4. |
git p4 unshelve was failing with "fatal: Not a valid object name HEAD0" and "Command failed: git cat-file commit HEAD^0" on certain systems e.g. git version 2.21.0.windows.1 + python 2.7.16
It seems that certain python pOpen implementations drop the ^ character when invoked using a string instead of an array as first argument, which is what is done by extractLogMessageFromGitCommit.
Solution is to use the array format of passing the command to fOpen, which is preferred (see https://docs.python.org/2/library/subprocess.html) and is used in other parts of this code anyway.