Discussions

• 1 You must be logged in to vote

  🙏

  Intemittent memory errors when trying to load model.

  balisujohn asked May 7, 2024 in Q&A · Answered

  

  

  3
• 1 You must be logged in to vote

  💡

  Support for multiple models in one file?

  TheTerrasque started May 7, 2024 in Ideas

  

  

  0
• 1 You must be logged in to vote

  🙏

  Is there an efficient way to do tensor-scalar addition?

  balisujohn asked May 3, 2024 in Q&A · Answered

  

  

  1
• 5 You must be logged in to vote

  🙌

  some notes about how ggml works using the GPT-2 example

  chunhualiao started Jan 29, 2024 in Show and tell

  

  

  

  

  2
• 2 You must be logged in to vote

  🙏

  Using a KV cache with GGML

  benraha asked Apr 10, 2024 in Q&A · Unanswered

  

  

  1
• 0 You must be logged in to vote

  🙏

  Encodec-cpp-ggml: when I make the Encodec (cpp) version, I am using ggml ggml-model-f16.bin, GGML_TYPE_COUNT miss match

  monircsueb asked Apr 5, 2024 in Q&A · Closed · Unanswered

  

  

  0
• 1 You must be logged in to vote

  💬

  Is there any way to execute Wav2Vec2 CTC (facebook/wav2vec2-base-100h) on c++?

  AntiAnti started Apr 7, 2024 in General

  

  

  0
• 1 You must be logged in to vote

  🙏

  How can I do equivalent of torch.chunk in ggml tensor ?

  mnlife asked Apr 1, 2024 in Q&A · Unanswered

  

  

  1
• 2 You must be logged in to vote

  💡

  stablediffusion.cpp based on GGML

  zhouwg started Apr 5, 2024 in Ideas

  

  

  3
• 1 You must be logged in to vote

  💬

  Can GGUF model be further finetuned?

  llm-finetune started Mar 6, 2024 in General

  

  

  1
• 1 You must be logged in to vote

  🙏

  How bcast works

  hipudding asked Mar 21, 2024 in Q&A · Closed · Unanswered

  

  

  0
• 6 You must be logged in to vote

  💬

  A simple example of using ggml-backend and ggml-alloc

  FSSRepo started Oct 9, 2023 in General

  

  

  

  

  7
• 1 You must be logged in to vote

  🙏

  Should there be a matrix check in ggml_transpose?

  crnsh asked Mar 3, 2024 in Q&A · Answered

  

  

  1
• 1 You must be logged in to vote

  🙏

  Is there a slice operator in ggml? If not, how do I use it / implement it?

  crnsh asked Mar 2, 2024 in Q&A · Answered

  

  

  1
• 4 You must be logged in to vote

  💬

  1-bit quantization?

  PABannier started Mar 1, 2024 in General

  

  

  1
• 1 You must be logged in to vote

  💡

  Nightshade

  iacore started Feb 29, 2024 in Ideas

  

  

  0
• 1 You must be logged in to vote

  💬

  What is the equivalent of removed "ggml_timestep_embedding" method?

  paulocoutinhox started Feb 25, 2024 in General

  

  

  0
• 1 You must be logged in to vote

  🙏

  Conversion older ggml code to latest version

  HoiV asked Feb 19, 2024 in Q&A · Answered

  

  

  1
• 2 You must be logged in to vote

  🙏

  Adaptive lora - some questions on ggml

  cmp-nct asked Feb 15, 2024 in Q&A · Unanswered

  

  

  0
• 1 You must be logged in to vote

  🙏

  Is there a recommended way to implement an analogous operation to torch.where?

  balisujohn asked Feb 1, 2024 in Q&A · Closed · Unanswered

  

  

  1
• 7 You must be logged in to vote

  🙌

  A basic training example using GGML

  bssrdf started Jan 24, 2024 in Show and tell

  

  

  

  

  2
• 2 You must be logged in to vote

  🙏

  minibatch size and ADAM optimizer

  bssrdf asked Jan 11, 2024 in Q&A · Closed · Unanswered

  

  

  0
• 1 You must be logged in to vote

  🙏

  How to optimize more than one loss functions?

  bssrdf asked Jan 14, 2024 in Q&A · Closed · Unanswered

  

  

  0
• 1 You must be logged in to vote

  🙏

  How to transpose a tensor and have the transpose reflected in contiguous memory with CUDA backend

  balisujohn asked Jan 7, 2024 in Q&A · Answered

  

  

  3
• 1 You must be logged in to vote

  🙏

  Is there a way to downcast a float32 tensor to a float16 tensor?

  balisujohn asked Jan 1, 2024 in Q&A · Answered

  

  

  1