Rocm with lmstudio in windows

[wet mica]

@violet ember asked: "how do I setup rocm in Windows with a gfx1150 to be able to select rocm in lmstudio?"

📄 Your question has 3 messages below. Please check all!

[wet mica]

[Message 1/3]
To set up ROCm on Windows for your gfx1150 (Ryzen AI 300 series / Strix Point) hardware, you will need to install the AMD HIP SDK. While our current documentation for version 7.1.1 lists gfx1151, ROCm 7.2.0 officially supports the gfx1150 architecture on Windows 11.

Before we begin, could you please confirm if you are running Windows 11 and if your system supports PCIe atomics (standard on Ryzen and modern Intel CPUs)?

1. System Requirements

• Operating System: Windows 11 (Validated on version 22H2).
• Hardware: gfx1150 is an APU architecture. For the best experience in LM Studio, ensure you have allocated a sufficient UMA Frame Buffer (VRAM) in your BIOS (e.g., 8GB or 16GB).

2. Installation Steps

We recommend installing the HIP SDK 7.2.0 to get native support for your gfx1150 target.

1. Download the Installer: Visit the HIP SDK download page and select the version matching ROCm 7.2.0. 2. Launch as Administrator: Right-click the setup file and run it with Administrator privileges.
2. Customize Installation:
3. Ensure HIP SDK Core, HIP Libraries, and HIP Runtime Compiler are selected.
4. Important: Select the bundled AMD Display Driver (Full Install) to ensure your driver version is compatible with the SDK.
5. Complete and Restart: Once the installation finishes, you must restart your system for the drivers and runtime to initialize correctly.

3. Selecting ROCm in LM Studio

LM Studio uses llama.cpp as its backend. Once the HIP SDK is installed, LM Studio should automatically detect your GPU.

• Detection: Open LM Studio and go to the Settings or GPU Offloading section.
• Selection: You should see an option for ROCm or AMD GPU offloading.
• Troubleshooting: If it doesn't appear, ensure that the HIP runtime DLLs (like amdhip64_7.dll) are in your system P...

[wet mica]

[Message 2/3]

Summary of Components

[wet mica]

[Message 3/3]
If you encounter any specific error codes during the installation, please let me know!

References:
• HIP SDK installation for Windows — HIP SDK install
• System requirements (Windows) — HIP SDK installati
• ROCm component support — HIP SDK installation on W

[wet mica]

@placid wigeon asked: "The hip sdk download page does not offer 7.2.0. the latest available is 7.1.1"