libchatty is a ChatGPT Wrapper for Ricers
Is your ChatGPT wrapper too slow? Is it causing you trouble in VC pitches? API changes frustrating your dev team? Wow, do I have the solution for you. libchatty is the world's first high performance ChatGPT wrapper written 100% in handcrafted, artisinal, C.
libchatty is 212x faster than LlamaIndex, 40x faster than LangChain and is even 20x faster than LITS 🔥.
When you've been using LLMs as long as I have (since 2023-01-21) you accumulate these people called friends, and sometimes these friends, like people from Vespa, Qdrant, and Weaviate, come up with some really good ideas. And then you can steal these ideas and start a project, and maybe even a company.
First off, if you haven't heard of LD_PRELOAD/LD_LIBRARY_PATH I can't be wasting my precious milliseconds talking to you. Secondly, GitHub Copilot's C support is quite lacking, and I don't have access to Devin.
No, unless you're committed to ricing, in which case, yes.
Yup, Python and JS. Please report any bugs in their respective repos and not here.
Your mom. (what?) Your mom is who supports hybrid search. This is a light weight blazing fast ChatGPT wrapper for AI Engineering chads, not a do everything for you RAG 15.0 Pro Max library. If you want one of those, you should BM these folks.
Command being timed: "./groq.sh"
User time (seconds): 0.07
System time (seconds): 0.09
Percent of CPU this job got: 2%
Elapsed (wall clock) time (h:mm:ss or m:ss): 0:08.42
Average shared text size (kbytes): 0
Average unshared data size (kbytes): 0
Average stack size (kbytes): 0
Average total size (kbytes): 0
Maximum resident set size (kbytes): 5824
Average resident set size (kbytes): 0
Major (requiring I/O) page faults: 41
Minor (reclaiming a frame) page faults: 6425
Voluntary context switches: 104
Involuntary context switches: 623
Swaps: 0
File system inputs: 0
File system outputs: 0
Socket messages sent: 60
Socket messages received: 388
Signals delivered: 10
Page size (bytes): 16384
Exit status: 0
Command being timed: "./groq.sh"
User time (seconds): 0.03
System time (seconds): 0.04
Percent of CPU this job got: 0%
Elapsed (wall clock) time (h:mm:ss or m:ss): 0:17.98
Average shared text size (kbytes): 0
Average unshared data size (kbytes): 0
Average stack size (kbytes): 0
Average total size (kbytes): 0
Maximum resident set size (kbytes): 5920
Average resident set size (kbytes): 0
Major (requiring I/O) page faults: 21
Minor (reclaiming a frame) page faults: 6433
Voluntary context switches: 122
Involuntary context switches: 562
Swaps: 0
File system inputs: 0
File system outputs: 0
Socket messages sent: 60
Socket messages received: 410
Signals delivered: 10
Page size (bytes): 16384
Exit status: 0
Command being timed: "./fireworks.sh"
User time (seconds): 0.04
System time (seconds): 0.05
Percent of CPU this job got: 0%
Elapsed (wall clock) time (h:mm:ss or m:ss): 0:29.64
Average shared text size (kbytes): 0
Average unshared data size (kbytes): 0
Average stack size (kbytes): 0
Average total size (kbytes): 0
Maximum resident set size (kbytes): 6016
Average resident set size (kbytes): 0
Major (requiring I/O) page faults: 52
Minor (reclaiming a frame) page faults: 6311
Voluntary context switches: 139
Involuntary context switches: 604
Swaps: 0
File system inputs: 0
File system outputs: 0
Socket messages sent: 60
Socket messages received: 390
Signals delivered: 10
Page size (bytes): 16384
Exit status: 0
Command being timed: "./fireworks.sh"
User time (seconds): 0.08
System time (seconds): 0.10
Percent of CPU this job got: 0%
Elapsed (wall clock) time (h:mm:ss or m:ss): 1:40.66
Average shared text size (kbytes): 0
Average unshared data size (kbytes): 0
Average stack size (kbytes): 0
Average total size (kbytes): 0
Maximum resident set size (kbytes): 6176
Average resident set size (kbytes): 0
Major (requiring I/O) page faults: 21
Minor (reclaiming a frame) page faults: 6331
Voluntary context switches: 194
Involuntary context switches: 636
Swaps: 0
File system inputs: 0
File system outputs: 0
Socket messages sent: 60
Socket messages received: 390
Signals delivered: 10
Page size (bytes): 16384
Exit status: 0
Command being timed: "./mistral.sh"
User time (seconds): 0.07
System time (seconds): 0.10
Percent of CPU this job got: 0%
Elapsed (wall clock) time (h:mm:ss or m:ss): 1:03.76
Average shared text size (kbytes): 0
Average unshared data size (kbytes): 0
Average stack size (kbytes): 0
Average total size (kbytes): 0
Maximum resident set size (kbytes): 6512
Average resident set size (kbytes): 0
Major (requiring I/O) page faults: 34
Minor (reclaiming a frame) page faults: 6443
Voluntary context switches: 166
Involuntary context switches: 854
Swaps: 0
File system inputs: 0
File system outputs: 0
Socket messages sent: 60
Socket messages received: 388
Signals delivered: 10
Page size (bytes): 16384
Exit status: 0
Command being timed: "./loop.sh"
User time (seconds): 0.08
System time (seconds): 0.11
Percent of CPU this job got: 0%
Elapsed (wall clock) time (h:mm:ss or m:ss): 0:51.48
Average shared text size (kbytes): 0
Average unshared data size (kbytes): 0
Average stack size (kbytes): 0
Average total size (kbytes): 0
Maximum resident set size (kbytes): 7232
Average resident set size (kbytes): 0
Major (requiring I/O) page faults: 44
Minor (reclaiming a frame) page faults: 7093
Voluntary context switches: 244
Involuntary context switches: 881
Swaps: 0
File system inputs: 0
File system outputs: 0
Socket messages sent: 160
Socket messages received: 278
Signals delivered: 10
Page size (bytes): 16384
Exit status: 0
That's because you don't own my laptop. DM me your results on Twitter.