-
Notifications
You must be signed in to change notification settings - Fork 839
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
400 error in Newman for 4 tests out of 46, all pass in Postman #6964
Comments
Hey. We would need more details to debug this. I suspect this could be an issue with cookies or auth. Can you reproduce this issue using a small subset of requests? Say 2 requests, with both passing in Postman and one failing in Newman. With this setup, if you can send me the exact request and response details from Postman Console and then verbose logs from Newman. |
Hi Shamasis, I’m working on getting a smaller test together. Hopefully I will have that done today.
I’m not sure how to get the Verbose logs from Newman. Can you help?
Thanks
Tim
From: Shamasis Bhattacharya <notifications@github.com>
Sent: Sunday, July 21, 2019 12:48 AM
To: postmanlabs/postman-app-support <postman-app-support@noreply.github.com>
Cc: Tim Egan <Tim.Egan@PulteGroup.com>; Author <author@noreply.github.com>
Subject: Re: [postmanlabs/postman-app-support] 400 error in Newman for 4 tests out of 46, all pass in Postman (#6964)
CAUTION: This email originated from outside of Pulte. Do not click links or open attachments unless you recognize the sender and know the content is safe.
Hey. We would need more details to debug this. I suspect this could be an issue with cookies or auth.
Can you reproduce this issue using a small subset of requests? Say 2 requests, with both passing in Postman and one failing in Newman. With this setup, if you can send me the exact request and response details from Postman Console and then verbose logs from Newman.
—
You are receiving this because you authored the thread.
Reply to this email directly, view it on GitHub<https://urldefense.proofpoint.com/v2/url?u=https-3A__github.com_postmanlabs_postman-2Dapp-2Dsupport_issues_6964-3Femail-5Fsource-3Dnotifications-26email-5Ftoken-3DAH3ITV4GHDFLX6PUROYXQL3QAQIEXA5CNFSM4IFIX5S2YY3PNVWWK3TUL52HS4DFVREXG43VMVBW63LNMVXHJKTDN5WW2ZLOORPWSZGOD2N57UQ-23issuecomment-2D513531858&d=DwMCaQ&c=vOc857T30pEVjkC9Auf77g&r=9D00KYjDtx9tfgJ2VR2cxiRappXM_rNx2Wf6y6QFAN4&m=8nEv4CDJksrLcQRmePBzROI8tRGL3ML4gTug4yHSd7E&s=ZSMt1QwEvMghAVnN3PuCRQdhfmpHxIliZcOriBZTeYU&e=>, or mute the thread<https://urldefense.proofpoint.com/v2/url?u=https-3A__github.com_notifications_unsubscribe-2Dauth_AH3ITV2WAK7BAIKSRDVIXELQAQIEXANCNFSM4IFIX5SQ&d=DwMCaQ&c=vOc857T30pEVjkC9Auf77g&r=9D00KYjDtx9tfgJ2VR2cxiRappXM_rNx2Wf6y6QFAN4&m=8nEv4CDJksrLcQRmePBzROI8tRGL3ML4gTug4yHSd7E&s=M8Oyem4XiFvlYn8xlFAUgf6dG3hpUmwXdsqBc1y5mh4&e=>.
…________________________________
CONFIDENTIALITY NOTICE: This email may contain confidential and privileged material for the sole use of the intended recipient(s). Any review, use, distribution or disclosure by others is strictly prohibited. If you have received this communication in error, please notify the sender immediately by email and delete the message and any file attachments from your computer. Thank you.
|
Hi Shamasis, Please see the attached file. It’s the smaller version that you requested.
The test that fails in Newman but Passes in Postman is Post “Financial Area”
I also asked our Release manger to clear the Cookies but that might not happen until later today.
Thanks
Tim
From: Tim Egan
Sent: Monday, July 22, 2019 10:19 AM
To: postmanlabs/postman-app-support <reply@reply.github.com>; postmanlabs/postman-app-support <postman-app-support@noreply.github.com>
Cc: Author <author@noreply.github.com>
Subject: RE: [postmanlabs/postman-app-support] 400 error in Newman for 4 tests out of 46, all pass in Postman (#6964)
Hi Shamasis, I’m working on getting a smaller test together. Hopefully I will have that done today.
I’m not sure how to get the Verbose logs from Newman. Can you help?
Thanks
Tim
From: Shamasis Bhattacharya <notifications@github.com<mailto:notifications@github.com>>
Sent: Sunday, July 21, 2019 12:48 AM
To: postmanlabs/postman-app-support <postman-app-support@noreply.github.com<mailto:postman-app-support@noreply.github.com>>
Cc: Tim Egan <Tim.Egan@PulteGroup.com<mailto:Tim.Egan@PulteGroup.com>>; Author <author@noreply.github.com<mailto:author@noreply.github.com>>
Subject: Re: [postmanlabs/postman-app-support] 400 error in Newman for 4 tests out of 46, all pass in Postman (#6964)
CAUTION: This email originated from outside of Pulte. Do not click links or open attachments unless you recognize the sender and know the content is safe.
Hey. We would need more details to debug this. I suspect this could be an issue with cookies or auth.
Can you reproduce this issue using a small subset of requests? Say 2 requests, with both passing in Postman and one failing in Newman. With this setup, if you can send me the exact request and response details from Postman Console and then verbose logs from Newman.
—
You are receiving this because you authored the thread.
Reply to this email directly, view it on GitHub<https://urldefense.proofpoint.com/v2/url?u=https-3A__github.com_postmanlabs_postman-2Dapp-2Dsupport_issues_6964-3Femail-5Fsource-3Dnotifications-26email-5Ftoken-3DAH3ITV4GHDFLX6PUROYXQL3QAQIEXA5CNFSM4IFIX5S2YY3PNVWWK3TUL52HS4DFVREXG43VMVBW63LNMVXHJKTDN5WW2ZLOORPWSZGOD2N57UQ-23issuecomment-2D513531858&d=DwMCaQ&c=vOc857T30pEVjkC9Auf77g&r=9D00KYjDtx9tfgJ2VR2cxiRappXM_rNx2Wf6y6QFAN4&m=8nEv4CDJksrLcQRmePBzROI8tRGL3ML4gTug4yHSd7E&s=ZSMt1QwEvMghAVnN3PuCRQdhfmpHxIliZcOriBZTeYU&e=>, or mute the thread<https://urldefense.proofpoint.com/v2/url?u=https-3A__github.com_notifications_unsubscribe-2Dauth_AH3ITV2WAK7BAIKSRDVIXELQAQIEXANCNFSM4IFIX5SQ&d=DwMCaQ&c=vOc857T30pEVjkC9Auf77g&r=9D00KYjDtx9tfgJ2VR2cxiRappXM_rNx2Wf6y6QFAN4&m=8nEv4CDJksrLcQRmePBzROI8tRGL3ML4gTug4yHSd7E&s=M8Oyem4XiFvlYn8xlFAUgf6dG3hpUmwXdsqBc1y5mh4&e=>.
…________________________________
CONFIDENTIALITY NOTICE: This email may contain confidential and privileged material for the sole use of the intended recipient(s). Any review, use, distribution or disclosure by others is strictly prohibited. If you have received this communication in error, please notify the sender immediately by email and delete the message and any file attachments from your computer. Thank you.
|
@TimEganGitHub ... it seems like that the attachment did not get through. Can you share the link to the collection by hitting “share” from the menu in Postman sidebar? And to run newman in verbose mode, I think there’s a |
I’m sending the json file again here.
I tried clicking Share in Postman but it only allowed me to share with my other teams. I might be missing something as I haven’t shared with Postman before. Please send me instructions of what you want me to do.
Thanks
Tim
From: Shamasis Bhattacharya <notifications@github.com>
Sent: Tuesday, July 23, 2019 10:11 PM
To: postmanlabs/postman-app-support <postman-app-support@noreply.github.com>
Cc: Tim Egan <Tim.Egan@PulteGroup.com>; Mention <mention@noreply.github.com>
Subject: Re: [postmanlabs/postman-app-support] 400 error in Newman for 4 tests out of 46, all pass in Postman (#6964)
CAUTION: This email originated from outside of Pulte. Do not click links or open attachments unless you recognize the sender and know the content is safe.
@TimEganGitHub<https://urldefense.proofpoint.com/v2/url?u=https-3A__github.com_TimEganGitHub&d=DwMFaQ&c=vOc857T30pEVjkC9Auf77g&r=9D00KYjDtx9tfgJ2VR2cxiRappXM_rNx2Wf6y6QFAN4&m=wIcD2EfFk-TwxcTu7plbqM4hyvFYY12moz2-Kix0OA0&s=0ey4qgZim9E_7Mkm34jT8mhJgPxXE6p8OBSX6rpKksA&e=> ... it seems like that the attachment did not get through. Can you share the link to the collection by hitting “share” from the menu in Postman sidebar?
—
You are receiving this because you were mentioned.
Reply to this email directly, view it on GitHub<https://urldefense.proofpoint.com/v2/url?u=https-3A__github.com_postmanlabs_postman-2Dapp-2Dsupport_issues_6964-3Femail-5Fsource-3Dnotifications-26email-5Ftoken-3DAH3ITV6CKQAINCGVQWTHFXTQA7P7VA5CNFSM4IFIX5S2YY3PNVWWK3TUL52HS4DFVREXG43VMVBW63LNMVXHJKTDN5WW2ZLOORPWSZGOD2VF6TQ-23issuecomment-2D514481998&d=DwMFaQ&c=vOc857T30pEVjkC9Auf77g&r=9D00KYjDtx9tfgJ2VR2cxiRappXM_rNx2Wf6y6QFAN4&m=wIcD2EfFk-TwxcTu7plbqM4hyvFYY12moz2-Kix0OA0&s=BLHRyiGW_lyjVZc6MLp9LoLj3_jDMX1OlrvgyfHuFaQ&e=>, or mute the thread<https://urldefense.proofpoint.com/v2/url?u=https-3A__github.com_notifications_unsubscribe-2Dauth_AH3ITV6PJYA2CP5HJJUQZKDQA7P7VANCNFSM4IFIX5SQ&d=DwMFaQ&c=vOc857T30pEVjkC9Auf77g&r=9D00KYjDtx9tfgJ2VR2cxiRappXM_rNx2Wf6y6QFAN4&m=wIcD2EfFk-TwxcTu7plbqM4hyvFYY12moz2-Kix0OA0&s=4Qvkg66_Dnw3u3BQjcVZyFOqLFgBXL_gAbD4wGHtKro&e=>.
…________________________________
CONFIDENTIALITY NOTICE: This email may contain confidential and privileged material for the sole use of the intended recipient(s). Any review, use, distribution or disclosure by others is strictly prohibited. If you have received this communication in error, please notify the sender immediately by email and delete the message and any file attachments from your computer. Thank you.
|
Hi Premang,
It turns out that the developers moved our pipeline tests from VSTS to Git Hub without my knowledge. The updates I was adding in VSTS weren’t getting to the script.
This ticket can be closed.
Thanks so much for helping.
Tim
From: Tim Egan
Sent: Thursday, August 1, 2019 10:31 AM
To: postmanlabs/postman-app-support <reply@reply.github.com>; postmanlabs/postman-app-support <postman-app-support@noreply.github.com>
Cc: Mention <mention@noreply.github.com>
Subject: RE: [postmanlabs/postman-app-support] 400 error in Newman for 4 tests out of 46, all pass in Postman (#6964)
Hello Premang,
Please see the collection link https://www.getpostman.com/collections/2004ec7762da19644209.
The error occurs on Post Financial Area.
The tests pass when run from Postman or from the Command prompt. Just a few tests including Financial Area fail when executed in our pipeline. The tests have worked in the past.
Thanks
Tim
From: Premang Vikani <notifications@github.com<mailto:notifications@github.com>>
Sent: Thursday, August 1, 2019 1:50 AM
To: postmanlabs/postman-app-support <postman-app-support@noreply.github.com<mailto:postman-app-support@noreply.github.com>>
Cc: Tim Egan <Tim.Egan@PulteGroup.com<mailto:Tim.Egan@PulteGroup.com>>; Mention <mention@noreply.github.com<mailto:mention@noreply.github.com>>
Subject: Re: [postmanlabs/postman-app-support] 400 error in Newman for 4 tests out of 46, all pass in Postman (#6964)
CAUTION: This email originated from outside of Pulte. Do not click links or open attachments unless you recognize the sender and know the content is safe.
Hi @TimEganGitHub<https://urldefense.proofpoint.com/v2/url?u=https-3A__github.com_TimEganGitHub&d=DwMCaQ&c=vOc857T30pEVjkC9Auf77g&r=9D00KYjDtx9tfgJ2VR2cxiRappXM_rNx2Wf6y6QFAN4&m=YUL59n9O_5lIIgxoE50KK8eZDv6d5xt7zHFlUz9Vrps&s=kjmaMjxG-6uoS-tMnwwWYJLy5m_RtELSMtZqNlnys0k&e=>
Please share the collection link as previously suggested by @shamasis<https://urldefense.proofpoint.com/v2/url?u=https-3A__github.com_shamasis&d=DwMCaQ&c=vOc857T30pEVjkC9Auf77g&r=9D00KYjDtx9tfgJ2VR2cxiRappXM_rNx2Wf6y6QFAN4&m=YUL59n9O_5lIIgxoE50KK8eZDv6d5xt7zHFlUz9Vrps&s=8HTF1Jta70EaLLLP6_haA5gVsHi5dOHgNDOMEcSceBk&e=> so that we can reproduce your issue at our end. If you don't know how to get a shareable link of the collection, please refer to this link<https://urldefense.proofpoint.com/v2/url?u=https-3A__learning.getpostman.com_docs_postman_collections_sharing-5Fcollections_-23sharing-2Dcollections-2Dwith-2Da-2Dlink&d=DwMCaQ&c=vOc857T30pEVjkC9Auf77g&r=9D00KYjDtx9tfgJ2VR2cxiRappXM_rNx2Wf6y6QFAN4&m=YUL59n9O_5lIIgxoE50KK8eZDv6d5xt7zHFlUz9Vrps&s=yhil4HlUGo8ywcRUh68R8bBdzx5jCBrkERQOEaPblnY&e=> from Postman Learning Center.
—
You are receiving this because you were mentioned.
Reply to this email directly, view it on GitHub<https://urldefense.proofpoint.com/v2/url?u=https-3A__github.com_postmanlabs_postman-2Dapp-2Dsupport_issues_6964-3Femail-5Fsource-3Dnotifications-26email-5Ftoken-3DAH3ITV5GOJF72GZVJIOLXGTQCKPRVA5CNFSM4IFIX5S2YY3PNVWWK3TUL52HS4DFVREXG43VMVBW63LNMVXHJKTDN5WW2ZLOORPWSZGOD3J3OAQ-23issuecomment-2D517191426&d=DwMCaQ&c=vOc857T30pEVjkC9Auf77g&r=9D00KYjDtx9tfgJ2VR2cxiRappXM_rNx2Wf6y6QFAN4&m=YUL59n9O_5lIIgxoE50KK8eZDv6d5xt7zHFlUz9Vrps&s=cdiPZhEolg09CacedOwJsib7bKKJ_MIknLFteimnLqQ&e=>, or mute the thread<https://urldefense.proofpoint.com/v2/url?u=https-3A__github.com_notifications_unsubscribe-2Dauth_AH3ITV5EKAUPE2V4W4OQIMDQCKPRVANCNFSM4IFIX5SQ&d=DwMCaQ&c=vOc857T30pEVjkC9Auf77g&r=9D00KYjDtx9tfgJ2VR2cxiRappXM_rNx2Wf6y6QFAN4&m=YUL59n9O_5lIIgxoE50KK8eZDv6d5xt7zHFlUz9Vrps&s=zjpeXs9ZNxgtqy4-MtnpsrSo2Mx3SV5B4QHUlVPq3V4&e=>.
…________________________________
CONFIDENTIALITY NOTICE: This email may contain confidential and privileged material for the sole use of the intended recipient(s). Any review, use, distribution or disclosure by others is strictly prohibited. If you have received this communication in error, please notify the sender immediately by email and delete the message and any file attachments from your computer. Thank you.
|
Describe the bug
A clear and concise description of what the bug is.
Test works in Postman but not in Newman. Getting a 400 error. Only 4 tests fail out of 46. All 46 passed before June 26th.
To Reproduce
Steps to reproduce the behavior:
The bug is reproducible every time in Newman, passes in Postman every time.
First noticed the issue around June 26 2019. Worked for many months before.
Authorization: Inherit auth from parent (same as all the other tests)
Header:
Content-Type Application/json
Body:
{
"name": "{{chNameAr}}" ,
"financialBusinessSegmentId": 2,
"sortKey": 10
Pre-request script:
var randomNumber = (Math.floor(Math.random() * 100 + 1).toString());
var text = "NewArea" + randomNumber;
console.log (text);
pm.globals.set("chNameAr",text);
pm.globals.set("Num",randomNumber);
Tests:
pm.test("Successful POST request", function () {
pm.expect(pm.response.code).to.be.oneOf([201,202]);
});
pm.globals.unset("idFinAr");
if( pm.response.code===201) {
}
Similar issue found at:
postmanlabs/newman#398
Expected behavior
A clear and concise description of what you expected to happen.
Expected Newman tests to pass as in the past.
Screenshots
![image](https://user-images.githubusercontent.com/32934359/61552557-fe0b6580-aa0c-11e9-982c-5f9e1009e93c.png)
If applicable, add screenshots to help explain your problem.
App information (please complete the following information):
Using the Postman App v6.7.4, Newman 3.9.0
Additional context
Add any other context about the problem here.
Similar issue found at:
postmanlabs/newman#398
The text was updated successfully, but these errors were encountered: