Releases: Rezarys/ane-embed-pipeline
Releases · Rezarys/ane-embed-pipeline
Release list
Build 2 - sentence-transformers/all-MiniLM-L6-v2
Benchmark sentence-transformers/all-MiniLM-L6-v2
- Taille (quant8) : 21.66 Mo
- Latence mediane : 25.398 ms (runs=30)
- Cosinus torch vs fp32 : 0.999984
- Cosinus fp32 vs quant8 : 0.999775
- compute_unit demande : ComputeUnit.CPU_AND_NE
- compute_unit_plan (par operation) : {'inconnu (non estime)': 243, 'MLCPUComputeDevice': 180}
v1.0.0
Build 1 - sentence-transformers/all-MiniLM-L6-v2
Benchmark sentence-transformers/all-MiniLM-L6-v2
- Taille (quant8) : 21.66 Mo
- Latence mediane : 44.636 ms (runs=30)
- Cosinus torch vs fp32 : 0.999984
- Cosinus fp32 vs quant8 : 0.999775
- compute_unit demande : ComputeUnit.CPU_AND_NE
- compute_unit_plan (par operation) : {'inconnu (non estime)': 243, 'MLCPUComputeDevice': 180}