Skip to content

Generative AI Examples v0.1 Release Notes
Compare
Choose a tag to compare
@chensuyue chensuyue released this 09 Apr 15:28
· 151 commits to main since this release
v0.1.0
855fbfe
This commit was created on GitHub.com and signed with GitHub’s verified signature.
GPG key ID: B5690EEEBB952194
Learn about vigilant mode.
  • Highlights
  • Examples

Highlights

  • Provides a collective list of Generative AI (GenAI) and Retrieval-Augmented Generation (RAG) examples such as chatbot with question and answering (ChatQnA), code generation (CodeGen), document summary (DocSum), etc.
  • All the examples are well-validated and optimized on Intel platforms.
  • Use ecosystem-compliant APIs to build the end-to-end GenAI examples.
  • Deploy the GenAI examples with performance on Intel platforms.

Examples

  • ChatQnA: an example of chatbot for question and answering through retrieval argumented generation (RAG)
  • CodeGen: an example of copilot designed for code generation in Visual Studio Code.
  • DocSum: an example of chatbot for summarizing the content of documents or reports.
  • SearchQnA: an example of chatbot for using search engine to enhance QA quality.
  • VisualQnA is an example of chatbot for question and answering based on the images.

Validated Configurations

  • Python 3.8, 3.9, 3.10, 3.11
  • Ubuntu 20.04
  • PyTorch 2.2.0+cpu 2.1.0+cpu
  • Intel® Extension for PyTorch 2.2.0+cpu, 2.1.0+cpu
  • TGI Gaudi 1.2.1
  • LangChain 0.1.12
Assets 2