[FEATURE] Is there any chain for sumarizing large context ?

[LegendLeo]

Describe the feature you'd like
I want to summarize a webpage, the webpage content resulted tokens exceed the maximum, langchain provide a load_summarize_chain for this situation, is there any component can i use

[chungyau97]

Will need to dive deeper on how to solve max tokens limitation in Flowise, as it will hit the limit of OpenAI.

langchainjs reference on how to implement into Flowise

Reference:
langchainjs #1827
Auto-GPT #2906

[LegendLeo]

Will need to dive deeper on how to solve max tokens limitation in Flowise, as it will hit the limit of OpenAI.

langchainjs reference on how to implement into Flowise

Reference: langchainjs #1827 Auto-GPT #2906

I just want a loadSummarizationChain component, langchain has provided: loadSummarizationChain

[chungyau97]

Alright, I can do that.

Once PR is opened I will update you here.

[HenryHengZJ]

@LegendLeo have you tried using ConversationalRetrievalQAChain with different chain type?

you can read more what are these for - https://js.langchain.com/docs/modules/chains/document/map_reduce , these chain types are used to summarize long context

[LegendLeo]

ConversationalRetrievalQAChain is used in conversation situation, but I just want to summarize a very long text, not a chat history.