Home

Welcome to the hcl wiki!

TODOs:

1. Remove RPClib.
2. Create OFI and UCX version of Thallium with VERBS and TCP. Needs custom URI support as some cases need PROTOCOL + DEVICE + INTERFACE
3. CPP Logger
4. DLIO Profiler
5. Make MPI Optional
6. Remove all warnings.
7. Add Catch2 Unit Tests.
8. Add in-memory data structures with RDMA. I think this is not useful. Typically, HCL has two scenarios. First, data structure holding small metadata information. Second, move large data objects. As data is on a local hashmap, we need to first figure out memory regions, typically copy it into a RDMA exposed buffer and then ask the client to read. This would defeat the purpose for both the scenarios. For metadata, the latency of back and forth exchange just to know which region to read and size is expensive. For data, we need 2 calls per 1 RDMA calls which would negate the benefit. Also for large data, it can be split into multiple asynchronous calls which will parallelize large data transfers better.
9. Initialize Deinitialize HCL with configuration.
10. Convert HCL into a library: You can't do this. The STL data structures are essentially templated. Therefore, there is no way for the library to know what it will be implemented as from the standpoint of an application. Therefore, it has to be done at the application's compile time.
11. Streamline configurations.
    • Cleanup configuration fields.
    • Support for YAML.
    • Support for ENV Variables.
12. Hierarchical HCL Design.