feat: Hardware API

[vansangpfiev]

Describe Your Changes

curl --request GET --url http://127.0.0.1:39281/v1/hardware

{
    "cpu": {
        "arch": "amd64",
        "cores": 8,
        "instructions": [
            "fpu",
            "mmx",
            "sse",
            "sse2",
            "sse3",
            "ssse3",
            "sse4_1",
            "sse4_2",
            "pclmulqdq",
            "avx",
            "avx2",
            "aes",
            "f16c"
        ],
        "model": "AMD Ryzen Threadripper PRO 5955WX 16-Cores"
    },
    "gpus": [
        {
            "additional_information": {
                "compute_cap": "8.6",
                "driver_version": "535.183"
            },
            "free_vram": 24246,
            "name": "NVIDIA GeForce RTX 3090",
            "total_vram": 24576,
            "version": "12.2"
        }
    ],
    "os": {
        "name": "Ubuntu 24.04.1 LTS",
        "version": "24.04.1 LTS (Noble Numbat)"
    },
    "power": {
        "battery_life": 0,
        "charging_status": "",
        "is_power_saving": false
    },
    "ram": {
        "available": 14335725568,
        "total": 16768770048,
        "type": ""
    },
    "storage": {
        "available": 0,
        "total": 0,
        "type": ""
    }
}

• Model usage estimation will be in a separate PR

Fixes Issues

• Implement hardware detection function #1591
• chore: Cortex Docs should be updated with Docs and API Endpoints #1613
• Create API for hardware activation (Nvidia) #1603

Self Checklist

• Added relevant comments, esp in complex areas
• Updated docs (for bug fixes / features)
• Created issues for follow-up changes or refactoring needed

[github-actions]

Preview URL: https://2884bb8e.cortex-docs.pages.dev

[namchuai]

✅ Overall lgtm. Only some nits and should not be blocked. Great job!