[Question]: The input (140999 tokens) is longer than the model's context length (128000 tokens).

[zgh551]

Self Checks

• I have searched for existing issues search for existing issues, including closed ones.
• I confirm that I am using English to submit this report (Language Policy).
• Non-english title submitions will be closed directly ( 非英文标题的提交将会被直接关闭 ) (Language Policy).
• Please do not modify this template :) and fill in all the required fields.

Describe your problem

hi, @yuzhichang , i use general LightRAG mode, some file will output error as follow:

开始于:
Wed, 19 Mar 2025 15:47:49 GMT
持续时间:
4045.93 s
进度:
15:47:49 Task has been received.
15:51:07 Page(1~100000001): Start to parse.
15:51:07 Page(1~100000001): Finish parsing.
15:51:08 Page(1~100000001): Start to generate keywords for every chunk ...
15:51:39 Page(1~100000001): Keywords generation 52 chunks completed in 30.81s
15:51:39 Page(1~100000001): Start to generate questions for every chunk ...
15:52:13 Page(1~100000001): Question generation 52 chunks completed in 34.32s
15:52:13 Page(1~100000001): Generate 52 chunks
15:58:49 Page(1~100000001): Embedding chunks (395.78s)
15:58:57 Page(1~100000001): Indexing done (7.08s). Task done (667.58s)
15:59:00 created task raptor
15:59:01 Task has been received.
16:00:55 Cluster one layer: 52 -> 9
16:01:45 Cluster one layer: 9 -> 3
16:02:20 Cluster one layer: 3 -> 2
16:02:37 Cluster one layer: 2 -> 1
16:02:40 Indexing done (2.87s). Task done (219.38s)
16:10:58 Entities extraction of chunk 26 41/67 done, 9 nodes, 3 edges, 5726 tokens.
16:10:59 Entities extraction of chunk 25 42/67 done, 6 nodes, 6 edges, 5930 tokens.
16:10:59 Entities extraction of chunk 24 43/67 done, 3 nodes, 2 edges, 4221 tokens.
16:11:00 Entities extraction of chunk 23 44/67 done, 1 nodes, 0 edges, 5332 tokens.
16:11:02 Entities extraction of chunk 22 45/67 done, 8 nodes, 2 edges, 6535 tokens.
16:11:03 Entities extraction of chunk 21 46/67 done, 10 nodes, 0 edges, 4760 tokens.
16:11:05 Entities extraction of chunk 20 47/67 done, 2 nodes, 0 edges, 5174 tokens.
16:11:09 Entities extraction of chunk 19 48/67 done, 7 nodes, 8 edges, 5917 tokens.
16:11:10 Entities extraction of chunk 18 49/67 done, 11 nodes, 10 edges, 7039 tokens.
16:11:11 Entities extraction of chunk 16 50/67 done, 3 nodes, 0 edges, 3847 tokens.
16:11:13 Entities extraction of chunk 15 51/67 done, 3 nodes, 2 edges, 4625 tokens.
16:11:14 Entities extraction of chunk 14 52/67 done, 5 nodes, 7 edges, 5821 tokens.
16:11:15 Entities extraction of chunk 13 53/67 done, 3 nodes, 2 edges, 4320 tokens.
16:11:19 Entities extraction of chunk 12 54/67 done, 3 nodes, 2 edges, 5988 tokens.
16:11:20 Entities extraction of chunk 11 55/67 done, 5 nodes, 4 edges, 5586 tokens.
16:11:21 Entities extraction of chunk 10 56/67 done, 5 nodes, 3 edges, 6192 tokens.
16:11:22 Entities extraction of chunk 9 57/67 done, 1 nodes, 0 edges, 3788 tokens.
16:11:23 Entities extraction of chunk 8 58/67 done, 1 nodes, 0 edges, 7931 tokens.
16:11:24 Entities extraction of chunk 7 59/67 done, 3 nodes, 0 edges, 5653 tokens.
16:11:25 Entities extraction of chunk 6 60/67 done, 3 nodes, 2 edges, 4453 tokens.
16:11:26 Entities extraction of chunk 5 61/67 done, 0 nodes, 0 edges, 3839 tokens.
16:11:28 Entities extraction of chunk 4 62/67 done, 5 nodes, 3 edges, 5041 tokens.
16:11:30 Entities extraction of chunk 3 63/67 done, 1 nodes, 0 edges, 4227 tokens.
16:11:31 Entities extraction of chunk 2 64/67 done, 4 nodes, 4 edges, 4975 tokens.
16:11:32 Entities extraction of chunk 1 65/67 done, 6 nodes, 5 edges, 5694 tokens.
16:11:33 Entities extraction of chunk 0 66/67 done, 5 nodes, 3 edges, 5231 tokens.
16:11:34 Entities extraction of chunk 17 67/67 done, 0 nodes, 0 edges, 5330 tokens.
16:11:34 Entities and relationships extraction done, 267 nodes, 155 edges, 398031 tokens, 524.80s.
16:31:52 Entities merging done, 1217.29s.
16:54:46 Relationships merging done, 1374.61s.
16:54:47 generated subgraph for doc 28b1927a007711f091ff2219abc1305d in 3117.27 seconds.
16:55:04 merging subgraph for doc 28b1927a007711f091ff2219abc1305d into the global graph done in 17.03 seconds.
16:55:11 Identified 399973 candidate pairs
16:55:13 [ERROR][Exception]: Exceptions from Trio nursery (1 sub-exception) -- **ERROR**: Error code: 400 - {'object': 'error', 'message': "The input (140999 tokens) is longer than the model's context length (128000 tokens).", 'type': 'BadRequestError', 'param': None, 'code': 400}

the input tokens override the model conext lenght (128K)，please give me some suggests about how to solve this problem, current selected one 7B model with Q4 quant。
thanks.