Discussions

• 1 You must be logged in to vote

  🙏

  Why Is bitnet.cpp Failing to Build on Windows Even With Visual Studio and Clang Installed?

  pawpatrolrockie asked Apr 18, 2025 in Q&A · Answered

  

  

  

  

  3
• 1 You must be logged in to vote

  🙌

  Speed boost for NUMA aware systems

  chhu started Apr 28, 2025 in Show and tell

  

  

  0
• 1 You must be logged in to vote

  💡

  bitseek - Flash Multi Head Latent Attention inspired by deepseek.

  chetanreddyv started Apr 27, 2025 in Ideas

  

  

  0
• 1 You must be logged in to vote

  💬

  Getting error in build step

  sandipto-sanyal started Apr 18, 2025 in General

  

  

  1
• 1 You must be logged in to vote

  🙌

  Future-proof Dockerization

  cmlpolymath started Apr 24, 2025 in Show and tell

  

  

  0
• 1 You must be logged in to vote

  💡

  Fleet Management Software: The Backbone or Bottleneck of Your Rental Operations?

  avabennett started Apr 24, 2025 in Ideas

  

  

  0
• 1 You must be logged in to vote

  💡

  running as a service

  lfoppiano started Dec 5, 2024 in Ideas

  

  

  

  

  2
• 1 You must be logged in to vote

  🙌

  FastAPI-BitNet

  grctest started Nov 12, 2024 in Show and tell

  

  

  

  

  2
• 1 You must be logged in to vote

  🙏

  strawberry problem

  sprappcom asked Apr 22, 2025 in Q&A · Unanswered

  

  

  0
• 1 You must be logged in to vote

  🙏

  possible to do a qwq32b equivalent and 70b and 683b deepseek equivalent?

  sprappcom asked Apr 22, 2025 in Q&A · Unanswered

  

  

  0
• 1 You must be logged in to vote

  💬

  Thank You

  ded23579 started Apr 21, 2025 in General

  

  

  0
• 1 You must be logged in to vote

  🙏

  Can I run bitnet on 1GB RAM 1Core ubuntu 2204?

  leitaoyu asked Apr 17, 2025 in Q&A · Unanswered

  

  

  

  

  2
• 1 You must be logged in to vote

  🙏

  WebGPU kernels for bitnet?

  hrstoyanov asked Jan 1, 2025 in Q&A · Unanswered

  

  

  1
• 1 You must be logged in to vote

  🙏

  bitnet.cpp & VSCode copilot agent & MCP

  sholtomaud asked Apr 18, 2025 in Q&A · Unanswered

  

  

  0
• 1 You must be logged in to vote

  🙏

  Why Does bitnet.cpp Throw an Error When I Try to Run Inference With a Model Downloaded From Hugging Face?

  pawpatrolrockie asked Apr 18, 2025 in Q&A · Answered

  

  

  1
• 1 You must be logged in to vote

  🙏

  Why Is bitnet.cpp Not Running My 1.58-Bit Model at the Expected Speed on CPU?

  pawpatrolrockie asked Apr 18, 2025 in Q&A · Answered

  

  

  1
• 19 You must be logged in to vote

  📣

  Welcome to bitnet.cpp Discussions!

  shumingma announced Oct 18, 2024 in Announcements

  

  

  

  

  9
• 1 You must be logged in to vote

  🙏

  No output when using run_inference.py

  phalcomb asked Dec 27, 2024 in Q&A · Unanswered

  

  

  1
• 0 You must be logged in to vote

  🙏

  Tyring to setup Bitnet gets out of memory

  davidgfolch asked Dec 6, 2024 in Q&A · Unanswered

  

  

  0
• 2 You must be logged in to vote

  💡

  Improved ternary rounding

  compilade started Nov 13, 2024 in Ideas

  

  

  5
• 5 You must be logged in to vote

  🙏

  Training the model

  morpheuslord asked Oct 20, 2024 in Q&A · Unanswered

  

  

  1
• 1 You must be logged in to vote

  💬

  An err is encounter during Setup process

  gaofengliu started Oct 26, 2024 in General

  

  

  1
• 2 You must be logged in to vote

  💬

  Bitnet.cpp and Phi family models?

  JORGEGO started Oct 26, 2024 in General

  

  

  0
• 1 You must be logged in to vote

  🙌

  Electron-Bitnet

  grctest started Oct 26, 2024 in Show and tell

  

  

  0
• 1 You must be logged in to vote

  💬

  Just Curious - Can we use it to deploy rag-based chatbots ?

  Shivansh12t started Oct 24, 2024 in General

  

  

  0