[Feature Request] Add dataloader for Pandas (pure pandas)

[sallyqus]

Required prerequisites

• I have searched the Issue Tracker and Discussions that this hasn't already been reported. (+1 or comment there if it has.)
• Consider asking first in a Discussion.

Motivation

Hi there, our dear camel developers,

Thank you for providing different kinds of loaders, including PandaLoader. But it needs OPENAI API.
As we dont have a simple and pure pandas loader, could you add it?

Thanks!

Solution

No response

Alternatives

No response

Additional context

No response

[mohamadkav]

So, for this issue, the original problem is as follows:

SmartDataFrame, is a type that includes the chat() functionality which directly chats with the LLM about the query according to the data.
I modified the init to take a bool called "pure_pandas", asking whether they want to use pure pandas or not. I modified the load function to return both accordingly. The default for pure_pandas is false to make it backwards-compatible with the original implementation.
Unless we have to use LLM, openai and SmartDataFrame will not be used.

I added a "query" method mainly to test the functionality. The functionality we can support without LLM is limited. I only implemented top sales (we even might wanna remove it).

My desired implementation was that if llm is not specified (not backwards compatible), we consider that the user does not want to use LLM. But the backwards compatibility issue made me go on to support the current test cases with no change.