How to create NF4 datatype

[phorcic]

The function

bitsandbytes/bitsandbytes/functional.py

Line 209 in 00c0a1a

def create_normal_map(offset=0.9677083, use_extra_value=True):

is supposed to return the NF4 datatype as specified in

bitsandbytes/bitsandbytes/functional.py

Line 733 in 00c0a1a

data = [

.

However, this is not the case as the result is not exactly the same; we are missing some decimals after the comma because of rounding. Moreover, I am not fully sure how to reproduce the exact values that are used in the NF4 paper https://arxiv.org/abs/2305.14314.

I am mostly curious to know how I can obtain the exact values that are used in the paper and in the NF4 datatype. Also, perhaps the documentation could possibly be updated. Thank you so much for clarifying.