Amazon Science

All

387 repositories

wraval
Public
WRAVAL helps in evaluating LLMs for writing assistant tasks like summarization, professional tone, witty tone, etc.
Jupyter Notebook
•2•5•0•8•Updated Jun 19, 2025Jun 19, 2025
MEMERAG
Public
MEMERAG: A Multilingual End-to-End Meta-Evaluation Benchmark for Retrieval Augmented Generation
benchmark evaluation rag
Python
•
Other
•0•3•1•3•Updated Jun 19, 2025Jun 19, 2025
fmcore
Public
Running GenAI models at every scale, on every modality
machine-learning natural-language-processing computer-vision artificial-intelligence scientific-computing multi-modal ai-research foundation-models genai
Python
•
Apache License 2.0
•1•5•5•3•Updated Jun 19, 2025Jun 19, 2025
bears
Public
Heterogeneous Multimodal DataFrames for GenAI workloads
Python
•
Apache License 2.0
•1•3•9•2•Updated Jun 19, 2025Jun 19, 2025
carbon-assessment-with-ml
Public
CaML: Carbon Footprinting of Household Products with Zero-Shot Semantic Text Similarity
Jupyter Notebook
•
Apache License 2.0
•10•46•0•1•Updated Jun 19, 2025Jun 19, 2025
llm-asymptotic-decoding
Public
Jupyter Notebook
•
Other
•0•9•0•6•Updated Jun 19, 2025Jun 19, 2025
alexa-arena
Public
Python
•
GNU Lesser General Public License v2.1
•12•107•1•2•Updated Jun 18, 2025Jun 18, 2025
application-eval-data
Public
Other
•0•0•0•0•Updated Jun 18, 2025Jun 18, 2025
DeepMTL2R
Public
Deep Multi-task Learning to Rank
Apache License 2.0
•0•1•0•0•Updated Jun 18, 2025Jun 18, 2025
auction-gym
Public
AuctionGym is a simulation environment that enables reproducible evaluation of bandit and reinforcement learning methods for online advertising auctions.
machine-learning reinforcement-learning advertising real-time-bidding
Jupyter Notebook
•
Apache License 2.0
•40•172•2•2•Updated Jun 18, 2025Jun 18, 2025
Repoformer
Public
Repoformer: Selective Retrieval for Repository-Level Code Completion (ICML 2024)
Python
•
Apache License 2.0
•10•55•6•1•Updated Jun 17, 2025Jun 17, 2025
avgen-eval-toolkit
Public
Python
•
Apache License 2.0
•4•11•0•4•Updated Jun 17, 2025Jun 17, 2025
SDFeedback
Public
Python
•
Apache License 2.0
•0•6•0•3•Updated Jun 17, 2025Jun 17, 2025
MigrationBench
Public
Python
•
Apache License 2.0
•0•6•0•2•Updated Jun 17, 2025Jun 17, 2025
SWE-PolyBench
Public
SWE-PolyBench: A multi-language benchmark for repository level evaluation of coding agents
Python
•
MIT License
•2•51•1•0•Updated Jun 11, 2025Jun 11, 2025
TurboFuzzLLM
Public
TurboFuzzLLM: Turbocharging Mutation-based Fuzzing for Effectively Jailbreaking Large Language Models in Practice
jailbreaking ai-safety red-teaming guardrails responsible-ai large-language-models
Python
•
Apache License 2.0
•1•7•0•0•Updated Jun 11, 2025Jun 11, 2025
GaRAGe
Public
[ACL 2025] GaRAGe: A Benchmark with Grounding Annotations for RAG Evaluation.
benchmarking rag llm
Other
•1•5•0•0•Updated Jun 10, 2025Jun 10, 2025
DiversityOfThoughts
Public
Python
•
Other
•0•3•0•1•Updated Jun 10, 2025Jun 10, 2025
dstc12-controllable-conversational-theme-detection
Public
Data & code for DSTC12, Controllable Conversational Theme Detection track
nlp theme challenge machine-learning natural-language-processing deep-learning neural-network dialog intent conversational-ai
Python
•
Other
•2•8•2•2•Updated Jun 9, 2025Jun 9, 2025
PersonaLens
Public
Code repository for PersonaLens paper (ACL 2025).
benchmark personalization datasets llm
Python
•
Other
•0•1•0•0•Updated Jun 6, 2025Jun 6, 2025
uniqsketch
Public
UniqSketch: sensitive and resource-efficient strain-level detection in metagenomes
C++
•
MIT License
•1•1•0•1•Updated Jun 3, 2025Jun 3, 2025
TISER
Public
[ACL 2025] Learning to Reason Over Time: Timeline Self-Reflection for Improved Temporal Reasoning in Language Models
language-model reasoning temporal-reasoning large-language-models llms-reasoning temporal-dataset
MIT No Attribution
•1•4•0•0•Updated Jun 3, 2025Jun 3, 2025
graph-lm-ensemble
Public
Python
•
Apache License 2.0
•3•15•0•0•Updated Jun 2, 2025Jun 2, 2025
hyperbolic-embeddings
Public
Code for hyperboloid embeddings for knowledge graph entities
Python
•
Other
•5•38•2•0•Updated Jun 2, 2025Jun 2, 2025
cusp
Public
Official implementation of Spectro-Riemannian Graph Neural Networks (ICLR 2025)
Python
•1•9•0•1•Updated May 30, 2025May 30, 2025
PrefEval
Public
Python
•
Other
•5•19•2•6•Updated May 30, 2025May 30, 2025
distributionally-robust-self-supervised-learning-for-tabular-data
Public
Python
•
Apache License 2.0
•1•2•0•1•Updated May 30, 2025May 30, 2025
Network-Usable-Info-Framework
Public
Python
•
Apache License 2.0
•3•4•0•1•Updated May 30, 2025May 30, 2025
text_generation_diffusion_llm_topic
Public
Topic Embedding, Text Generation and Modeling using diffusion
nlp machine-learning natural-language-processing topic transformers text-generation topic-modeling lda text-embedding topic-models
Python
•
Apache License 2.0
•4•14•1•1•Updated May 30, 2025May 30, 2025
serializeEM
Public
Python
•
Apache License 2.0
•0•1•0•2•Updated May 30, 2025May 30, 2025