Feature Request: Add Qwen3.8-27B to the Foundry Local catalog #1025
Unanswered
Neil-Godfrey (Neil-GS)
asked this question in
Feature requests
Replies: 0 comments
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Uh oh!
There was an error while loading. Please reload this page.
Is your feature request related to a problem? Please describe.
Foundry Local's catalog currently tops out at the Qwen 3.5 series (and older Qwen2.5 / small Qwen3). Alibaba released Qwen3.8-27B this month — a dense 27B native vision-language model, Apache-2.0, 262K context, thinking + tool calling. It is already the model I run locally for coding and agent work, but I have to do that in Ollama because it is not in the Foundry catalog.
I would rather stay on Foundry Local: C# SDK, OpenAI-compatible endpoint, curated ONNX, Windows + Apple Silicon execution providers. The catalog gap is the only reason this model lives outside the Microsoft runtime.
Describe the solution you'd like
Add Qwen3.8-27B to the Foundry Local catalog, with ONNX builds for the execution providers you already ship for Qwen 3.5:
Weights: https://huggingface.co/Qwen/Qwen3.8-27B
Ollama (for comparison, already running here):
qwen3.8:27b(19 GB quantized)There is a single deployment-sized dense checkpoint in this generation (
Qwen3.8-27B). Qwen3.8-Max (2.4T MoE) is not a local-catalog candidate.Describe alternatives you've considered
qwen3.8:27bon a MacBook Pro M5 Max, 128 GB). That is not the Foundry path, and GGUF does not load in Foundry Local.microsoft/olive-recipeshas folders for Qwen3.5-27B and Qwen3.6-27B; there is no Qwen3.8 folder. Qwen3.8 uses a hybrid Gated DeltaNet + Gated Attention layout (same family as 3.5, new generation). A genericolive optimizeagainst Llama-shaped recipes is likely to fail. I am willing to attempt a recipe PR against the 3.5-27B template and report the result, including full logs if it breaks.Additional context
Happy to follow up with an
olive-recipesPR (info.yml+ recipe cloned fromQwen-Qwen3.5-27B) if that is the useful next step versus waiting on an official ONNX build.All reactions