Connection management

[TeddyAlbina]

Hello,

I have a question about the management of the connection, can i use singleton ? I plan to use it using DI, but i don't know if it's a good idea.

Best regards.

[lennylxx]

Yes, I would recommend Singleton,

• it's thread safe, as the Rust Connection is behind Arc, which C# FFI clones it before spawning the async work, there is no shared mutable state on C# side.
• ConnectionOptions.Session configs caches, they will be shared across all callers in a Singleton.

Actually singleton is the intended usage pattern for Python as well, check this out https://github.com/lancedb/lancedb/blob/v0.27.0/python/python/lancedb/db.py#L1074

[TeddyAlbina]

Thank you

I have another question, do i need some kind of lock to avoid multiple thread writing in the database at the same time or is it handle by the db or a non question at all ?

[lennylxx]

Lock is not a preferred choice if you want high throughput, but you could choose to implement a distributed lock in some cases for correctness.
https://docs.lancedb.com/faq/faq-oss#does-lancedb-support-concurrent-operations
lancedb/lancedb#1504 (comment)

I would design to make sure there is only one writer with multiple concurrent readers to achieve the high performance.

[TeddyAlbina]

Thank you