400 - Bad request - Maximum content length. #203

sunscreem · 2023-04-30T15:21:32Z

Bug description

When running the command I get the following:

◇  Detected 2 staged files:
     tests/Fixtures/TicketSource/events.index.json
     tests/Unit/TicketSourceAPITest.php
│
◇  Changes analyzed
│
└  ✖ OpenAI API Error: 400 - Bad Request

{
  "error": {
    "message": "This model's maximum context length is 4097 tokens. However, you requested 5838 tokens (2909 in the messages, 2929 in the completion). Please reduce the length of the messages or completion.",
    "type": "invalid_request_error",
    "param": "messages",
    "code": "context_length_exceeded"
  }
}

My changes aren't particularly big. I've create a text file and added a single new test to my test suite.

git diff --cached
diff --git a/tests/Fixtures/TicketSource/events.index.json b/tests/Fixtures/TicketSource/events.index.json
index 0434c49..9d4b7e7 100644
--- a/tests/Fixtures/TicketSource/events.index.json
+++ b/tests/Fixtures/TicketSource/events.index.json
@@ -1 +1 @@
-{"statusCode":403,"headers":{"Date":"Sun, 30 Apr 2023 14:36:54 GMT","Content-Type":"text\/html; charset=UTF-8","Transfer-Encoding":"chunked","Connection":"keep-alive","Cache-Control":"max-age=15","Expires":"Sun, 30 Apr 2023 14:37:09 GMT","X-Frame-Options":"SAMEORIGIN","Report-To":"{\"endpoints\":[{\"url\":\"https:\\\/\\\/a.nel.cloudflare.com\\\/report\\\/v3?s=Vw41yz6s0hMgWrkbJWmSYwVZFcOoT5bKhg4TVpDimLV6VSBiGHbvdlD6K3Tmn4MsBLoimlt275%2FXaZUYlOrsKNGJdvlLuJ5T8qPlcXMmDD713bOkB92QDZRCoV2cHXTkdQRKCwFs\"}],\"group\":\"cf-nel\",\"max_age\":604800}","NEL":"{\"success_fraction\":0,\"report_to\":\"cf-nel\",\"max_age\":604800}","Strict-Transport-Security":"max-age=31536000; includeSubDomains; preload","X-Content-Type-Options":"nosniff","Server":"cloudflare","CF-RAY":"7c008508f889dcdb-LHR","alt-svc":"h3=\":443\"; ma=86400, h3-29=\":443\"; ma=86400"},"data":"<!DOCTYPE html>\n<!--[if lt IE 7]> <html class=\"no-js ie6 oldie\" lang=\"en-US\"> <![endif]-->\n<!--[if IE 7]>    <html class=\"no-js ie7 oldie\" lang=\"en-US\"> <![endif]-->\n<!--[if IE 8]>    <html class=\"no-js ie8 oldie\" lang=\"en-US\"> <![endif]-->\n<!--[if gt IE 8]><!--> <html class=\"no-js\" lang=\"en-US\"> <!--<![endif]-->\n<head>\n<title>Attention Required! | Cloudflare<\/title>\n<meta charset=\"UTF-8\" \/>\n<meta http-equiv=\"Content-Type\" content=\"text\/html; charset=UTF-8\" \/>\n<meta http-equiv=\"X-UA-Compatible\" content=\"IE=Edge\" \/>\n<meta name=\"robots\" content=\"noindex, nofollow\" \/>\n<meta name=\"viewport\" content=\"width=device-width,initial-scale=1\" \/>\n<link rel=\"stylesheet\" id=\"cf_styles-css\" href=\"\/cdn-cgi\/styles\/cf.errors.css\" \/>\n<!--[if lt IE 9]><link rel=\"stylesheet\" id='cf_styles-ie-css' href=\"\/cdn-cgi\/styles\/cf.errors.ie.css\" \/><![endif]-->\n<style>body{margin:0;padding:0}<\/style>\n\n\n<!--[if gte IE 10]><!-->\n<script>\n  if (!navigator.cookieEnabled) {\n    window.addEventListener('DOMContentLoaded', function () {\n      var cookieEl = document.getElementById('cookie-alert');\n      cookieEl.style.display = 'block';\n    })\n  }\n<\/script>\n<!--<![endif]-->\n\n\n<\/head>\n<body>\n  <div id=\"cf-wrapper\">\n    <div class=\"cf-alert cf-alert-error cf-cookie-error\" id=\"cookie-alert\" data-translate=\"enable_cookies\">Please enable cookies.<\/div>\n    <div id=\"cf-error-details\" class=\"cf-error-details-wrapper\">\n      <div class=\"cf-wrapper cf-header cf-error-overview\">\n        <h1 data-translate=\"block_headline\">Sorry, you have been blocked<\/h1>\n        <h2 class=\"cf-subheadline\"><span data-translate=\"unable_to_access\">You are unable to access<\/span> ticketsource.io<\/h2>\n      <\/div><!-- \/.header -->\n\n      <div class=\"cf-section cf-highlight\">\n        <div class=\"cf-wrapper\">\n          <div class=\"cf-screenshot-container cf-screenshot-full\">\n            \n              <span class=\"cf-no-screenshot error\"><\/span>\n            \n          <\/div>\n        <\/div>\n      <\/div><!-- \/.captcha-container -->\n\n      <div class=\"cf-section cf-wrapper\">\n        <div class=\"cf-columns two\">\n          <div class=\"cf-column\">\n            <h2 data-translate=\"blocked_why_headline\">
Why have I been blocked?<\/h2>\n\n            <p data-translate=\"blocked_why_detail\">This website is usi
ng a security service to protect itself from online attacks. The action you just performed triggered the s
ecurity solution. There are several actions that could trigger this block including submitting a certain w
ord or phrase, a SQL command or malformed data.<\/p>\n          <\/div>\n\n          <div class=\"cf-colum
n\">\n            <h2 data-translate=\"blocked_resolve_headline\">What can I do to resolve this?<\/h2>\n\n
            <p data-translate=\"blocked_resolve_detail\">You can email the site owner to let them know you
 were blocked. Please include what you were doing when this page came up and the Cloudflare Ray ID found a
t the bottom of this page.<\/p>\n          <\/div>\n        <\/div>\n      <\/div><!-- \/.section -->\n\n 
     <div class=\"cf-error-footer cf-wrapper w-240 lg:w-full py-10 sm:py-4 sm:px-8 mx-auto text-center sm:
text-left border-solid border-0 border-t border-gray-300\">\n  <p class=\"text-13\">\n    <span class=\"cf
-footer-item sm:block sm:mb-1\">Cloudflare Ray ID: <strong class=\"font-semibold\">7c008508f889dcdb<\/stro
ng><\/span>\n    <span class=\"cf-footer-separator sm:hidden\">&bull;<\/span>\n    <span id=\"cf-footer-it
em-ip\" class=\"cf-footer-item hidden sm:block sm:mb-1\">\n      Your IP:\n      <button type=\"button\" i
d=\"cf-footer-ip-reveal\" class=\"cf-footer-ip-reveal-btn\">Click to reveal<\/button>\n      <span class=\
"hidden\" id=\"cf-footer-ip\">167.99.206.90<\/span>\n      <span class=\"cf-footer-separator sm:hidden\">&
bull;<\/span>\n    <\/span>\n    <span class=\"cf-footer-item sm:block sm:mb-1\"><span>Performance &amp; s
ecurity by<\/span> <a rel=\"noopener noreferrer\" href=\"https:\/\/www.cloudflare.com\/5xx-error-landing\"
 id=\"brand_link\" target=\"_blank\">Cloudflare<\/a><\/span>\n    \n  <\/p>\n  <script>(function(){functio
n d(){var b=a.getElementById(\"cf-footer-item-ip\"),c=a.getElementById(\"cf-footer-ip-reveal\");b&&\"class
List\"in b&&(b.classList.remove(\"hidden\"),c.addEventListener(\"click\",function(){c.classList.add(\"hidd
en\");a.getElementById(\"cf-footer-ip\").classList.remove(\"hidden\")}))}var a=document;document.addEventL
istener&&a.addEventListener(\"DOMContentLoaded\",d)})();<\/script>\n<\/div><!-- \/.error-footer -->\n\n\n 
   <\/div><!-- \/#cf-error-details -->\n  <\/div><!-- \/#cf-wrapper -->\n\n  <script>\n  window._cf_transl
ation = {};\n  \n  \n<\/script>\n\n<\/body>\n<\/html>\n"}
\ No newline at end of file
+{"statusCode":200,"headers":{"Date":"Sun, 30 Apr 2023 14:36:54 GMT","Content-Type":"text\/html; charset=U
TF-8","Transfer-Encoding":"chunked","Connection":"keep-alive","Cache-Control":"max-age=15","Expires":"Sun,
 30 Apr 2023 14:37:09 GMT","X-Frame-Options":"SAMEORIGIN","Report-To":"{\"endpoints\":[{\"url\":\"https:\\
\/\\\/a.nel.cloudflare.com\\\/report\\\/v3?s=Vw41yz6s0hMgWrkbJWmSYwVZFcOoT5bKhg4TVpDimLV6VSBiGHbvdlD6K3Tmn
4MsBLoimlt275%2FXaZUYlOrsKNGJdvlLuJ5T8qPlcXMmDD713bOkB92QDZRCoV2cHXTkdQRKCwFs\"}],\"group\":\"cf-nel\",\"m
ax_age\":604800}","NEL":"{\"success_fraction\":0,\"report_to\":\"cf-nel\",\"max_age\":604800}","Strict-Tra
nsport-Security":"max-age=31536000; includeSubDomains; preload","X-Content-Type-Options":"nosniff","Server
":"cloudflare","CF-RAY":"7c008508f889dcdb-LHR","alt-svc":"h3=\":443\"; ma=86400, h3-29=\":443\"; ma=86400"
},"data":"{\"data\":[{\"id\":\"evt-WE39wVbREgJVrvZY\",\"type\":\"event\",\"attributes\":{\"name\":\"Test E
vent 2\",\"reference\":\"\",\"description\":\"Lorem Ipsum\",\"comment\":\"\",\"keywords\":null,\"terms\":\
"\",\"category\":\"business\",\"genre\":\"dinner\",\"images\":[],\"third_party_consent\":{\"capture\":fals
e,\"name\":\"\",\"show_consent\":{\"email\":false,\"post\":false,\"sms\":false}},\"activated\":true,\"arch
ived\":false,\"public\":true,\"settled\":false,\"created_at\":\"2023-04-28T17:50:46+00:00\",\"updated_at\"
:\"2023-04-28T17:51:45+00:00\"},\"links\":{\"self\":\"https:\\/\\/api.ticketsource.io\\/events\\/evt-WE39w
VbREgJVrvZY\",\"venues\":\"https:\\/\\/api.ticketsource.io\\/events\\/evt-WE39wVbREgJVrvZY\\/venues\",\"da
tes\":\"https:\\/\\/api.ticketsource.io\\/events\\/evt-WE39wVbREgJVrvZY\\/dates\"}}],\"links\":{\"first\":
\"https:\\/\\/api.ticketsource.io\\/events?page=1\",\"last\":null,\"prev\":null,\"next\":null},\"meta\":{\
"current_page\":1,\"from\":1,\"path\":\"https:\\/\\/api.ticketsource.io\\/events\",\"per_page\":10,\"to\":
1}}"}
\ No newline at end of file
diff --git a/tests/Unit/TicketSourceAPITest.php b/tests/Unit/TicketSourceAPITest.php
index a58e36d..466d73d 100644
--- a/tests/Unit/TicketSourceAPITest.php
+++ b/tests/Unit/TicketSourceAPITest.php
@@ -6,6 +6,13 @@ use Saloon\Helpers\MockConfig;
 use Saloon\Http\Faking\MockResponse;
 use Saloon\Laravel\Saloon;
 
+beforeEach(function () {
+    MockConfig::throwOnMissingFixtures();
+
+    MockConfig::setFixturePath('tests/Fixtures/TicketSource');
+
+});
+
 it('throws_errors', function () {
 
     Saloon::fake([
@@ -16,28 +23,29 @@ it('throws_errors', function () {
     $ticketSource->send(new GetEvents);
 
     Saloon::assertSent(GetEvents::class);
-})->throws(Exception::class)->skip();
+})->throws(Exception::class);
 
 it('fetches_a_list_of_events', function () {
 
-    // rob you are here.
-    // you want to fake the real response
-    // and work out how to make the correct calls
-
-    // MockConfig::throwOnMissingFixtures();
-
-    MockConfig::setFixturePath('tests/Fixtures/TicketSource');
-
     Saloon::fake([
         TicketSourceConnector::class => MockResponse::fixture('events.index'),
     ]);
 
-    $ticketSource = new TicketSourceConnector;
-    $response = $ticketSource->send(new GetEvents);
+    $data = (new TicketSourceConnector)->send(new GetEvents)->json();
 
-    Saloon::assertSent(GetEvents::class);
+    expect($data)->toHaveCount(3);
+
+    $events = $data['data'];
+
+    expect($events)->toHaveCount(1);
+
+    expect($events[0])->toHaveKeys([
+        'id',
+        'type',
+        'attributes',
+        'links',
+    ]);
 
-    expect($response->status())->toBe(200);
 });

aicommits version

1.10.0

Environment

System:
    OS: Linux 4.15 Ubuntu 18.04.6 LTS (Bionic Beaver)
    CPU: (4) x64 DO-Regular
    Memory: 3.75 GB / 7.79 GB
    Container: Yes
    Shell: 4.4.20 - /bin/bash
  Binaries:
    Node: 16.16.0 - /usr/local/bin/node
    Yarn: 1.19.1 - /usr/bin/yarn
    npm: 8.11.0 - /usr/local/bin/npm

Can you contribute a fix?

I’m interested in opening a pull request for this issue.

The text was updated successfully, but these errors were encountered:

sunscreem · 2023-04-30T15:22:14Z

I'm wondering if I set something up wrong as that diff doesn't seem especially large?

privatenumber · 2023-05-01T06:07:50Z

@rocktimsaikia Wondering if we need to set a max here depending on the model?

aicommits/src/utils/openai.ts

Line 166 in f53fb85

max_tokens: maxTokens,

I think we can get the max for each model from tiktoken.

RyanRoberts · 2023-05-01T11:49:25Z

Exact same issue here. It was working fine last night with larger diffs but this morning I've done some minimal work and run into this error. Strange.

mreduar · 2023-05-02T14:19:39Z

Same here

privatenumber · 2023-05-02T15:11:13Z

I haven't had time to investigate this yet, but if anyone wants to, feel free to open a PR. I think it's basically setting a limit here:

aicommits/src/utils/openai.ts

Line 166 in f53fb85

max_tokens: maxTokens,

sunscreem · 2023-05-03T17:58:53Z

@privatenumber Sorry to report I've updated to 1.11.0 and I've still having the same issue.

npm list -g
npm WARN config global `--global`, `--local` are deprecated. Use `--location=global` instead.
/usr/local/lib
├── aicommits@1.11.0
├── corepack@0.10.0
├── eslint@7.14.0
├── n@9.0.0
├── npm-why@3.0.0
├── npm@8.11.0
├── prettier@2.7.1
├── webpack-cli@4.5.0
└── webpack@5.24.2

  aicommits 
│
◇  Detected 13 staged files:
     app/Http/Integrations/TicketSource/Requests/GetDate.php
     app/Http/Integrations/TicketSource/Requests/GetEvent.php
     app/Http/Integrations/TicketSource/Requests/GetEventDates.php
     app/Http/Integrations/TicketSource/Requests/GetEventVenues.php
     app/Http/Integrations/TicketSource/Requests/GetVenue.php
     app/Http/Integrations/TicketSource/Requests/GetVenueDates.php
     tests/Fixtures/TicketSource/date.show.json
     tests/Fixtures/TicketSource/event.dates.index.json
     tests/Fixtures/TicketSource/event.show.json
     tests/Fixtures/TicketSource/event.venues.index.json
     tests/Fixtures/TicketSource/venue.dates.index.json
     tests/Fixtures/TicketSource/venue.show.json
     tests/Unit/TicketSourceAPITest.php
│
◇  Changes analyzed
│
└  ✖ OpenAI API Error: 400 - Bad Request

{
  "error": {
    "message": "This model's maximum context length is 4097 tokens. However, your messages resulted in 8332 tokens. Please reduce the length of the messages.",
    "type": "invalid_request_error",
    "param": "messages",
    "code": "context_length_exceeded"
  }
}

privatenumber · 2023-05-04T00:02:48Z

That's not the same error:

-    "message": "This model's maximum context length is 4097 tokens. However, you requested 5838 tokens (2909 in the messages, 2929 in the completion). Please reduce the length of the messages or completion.",
+    "message": "This model's maximum context length is 4097 tokens. However, your messages resulted in 8332 tokens. Please reduce the length of the messages.",

Previously, we were requesting more tokens than we can. Which was just fixed.

In your case, your diff is too large. Would you mind filing a new issue for this?

sunscreem · 2023-05-04T16:57:45Z

@privatenumber Done - thank you.

sunscreem added bug Something isn't working pending triage labels Apr 30, 2023

privatenumber added pending triage pr welcome and removed pending triage labels May 2, 2023

privatenumber mentioned this issue May 3, 2023

revert: setting max_tokens based on message size #207

Merged

privatenumber closed this as completed in #207 May 3, 2023

This comment was marked as outdated.

Sign in to view

Provide feedback

Saved searches

Use saved searches to filter your results more quickly

400 - Bad request - Maximum content length. #203

400 - Bad request - Maximum content length. #203

sunscreem commented Apr 30, 2023

sunscreem commented Apr 30, 2023

privatenumber commented May 1, 2023 •

edited

RyanRoberts commented May 1, 2023

mreduar commented May 2, 2023

privatenumber commented May 2, 2023

sunscreem commented May 3, 2023

privatenumber commented May 4, 2023

This comment was marked as outdated.

sunscreem commented May 4, 2023

400 - Bad request - Maximum content length. #203

400 - Bad request - Maximum content length. #203

Comments

sunscreem commented Apr 30, 2023

Bug description

aicommits version

Environment

Can you contribute a fix?

sunscreem commented Apr 30, 2023

privatenumber commented May 1, 2023 • edited

RyanRoberts commented May 1, 2023

mreduar commented May 2, 2023

privatenumber commented May 2, 2023

sunscreem commented May 3, 2023

privatenumber commented May 4, 2023

This comment was marked as outdated.

sunscreem commented May 4, 2023

privatenumber commented May 1, 2023 •

edited