Skip to content

Commit 4b68f72

Browse files
committed
update notes
1 parent b5eaaae commit 4b68f72

File tree

3 files changed

+12
-4
lines changed

3 files changed

+12
-4
lines changed

content/posts/meetup-53-wrapup.md

Lines changed: 12 additions & 4 deletions
Original file line numberDiff line numberDiff line change
@@ -33,13 +33,21 @@ is simple, robust and an algorithm that does not require any training)
3333
> suggest that the LLM generates slightly more novel outputs as temperatures
3434
> get higher. -- [Is Temperature the Creativity Parameter of Large Language Models?](https://arxiv.org/pdf/2405.00492)
3535
36-
Randomness in embeddings: Do you get different embedding vectors from the same model on the same input? Quick test using ollama running on a Intel [N3450](https://www.intel.com/content/www/us/en/products/sku/95596/intel-celeron-processor-n3450-2m-cache-up-to-2-20-ghz/specifications.html) 2016 6W TDP CPU:
37-
36+
Randomness in embeddings: Do you get different embedding vectors from the same
37+
model on the same input? [Quick
38+
test](https://github.com/golang-leipzig/golang-leipzig.github.io/tree/source/static/vembedtest)
39+
using [ollama](https://ollama.com) running on a Intel
40+
[N3450](https://www.intel.com/content/www/us/en/products/sku/95596/intel-celeron-processor-n3450-2m-cache-up-to-2-20-ghz/specifications.html)
41+
2016 6W TDP CPU (and [1.6W idle power
42+
consumption](/images/zima-idle-1.6w.png)):
3843

3944
![](/images/vembedtest.gif)
4045

41-
Estimated cost of running this test (90 embeddings, total): ~9W for ~6 minutes at [0.30 EUR/kWh](/images/l-strom-dyn-2025-07.png): EUR 0.00027.
42-
46+
Estimated cost of running this test (90 embeddings, total): ~9W for ~6 minutes
47+
at [0.30 EUR/kWh](/images/l-strom-dyn-2025-07.png): EUR 0.00027 (or framed
48+
differently: you can calculate about 640000 embeddings for the price of one
49+
scoop of ice cream - albeit it would take about a month to calculate them on a
50+
this device) 🍦
4351

4452
* [Fabrice Bellard](https://en.wikipedia.org/wiki/Fabrice_Bellard),
4553
[superproductivity](http://web.archive.org/web/20121006002711/http://blog.smartbear.com/software-quality/bid/167059/Fabrice-Bellard-Portrait-of-a-Superproductive-Programmer),

static/images/zima-idle-1.6w.png

159 KB
Loading

static/vembedtest/vembedtest.gif

4.37 MB
Loading

0 commit comments

Comments
 (0)