Building a custom LLM with Ollama on SAP AI Core sounds straightforward—until you hit Windows-specific quirks, hidden Linux dependencies, and ambiguous Docker Hub registry requirements.

In this post, I share the real errors I faced, why zstd installation fails, the correct Dockerfile order, and the exact registry URL you need for public Docker Hub images. If you’re deploying a custom LLM on SAP AI Core from Windows, this guide will save you hours of trial and error.