Hi, I'm Minjun. Most of my time goes into making LLM serving faster and more reliable. I fix bugs and performance issues in open-source projects like LMCache and AIBrix, and I'm also building pygrpc-native, a Python gRPC server backed by Rust. On the side, I make things with friends and write about them on my blog.
pygrpc/pygrpc-native · Drop-in Python gRPC server with its HTTP/2 layer in Rust · used by LMCache
- Runs LMCache's native gRPC mode and ships in its Docker images (#6031, #6048)
- Made LMCache's gRPC transport 21% faster than ZMQ, where grpcio was 36% slower
- Replaces
grpc.server()in one line, with existing servicers and interceptors unchanged - 1.5x grpcio's calls per second from a single client thread, 5x from 32
LMCache/LMCache · KV cache layer for vLLM/SGLang · 19 merged PRs
- Added a native gRPC server mode in Rust, outside the GIL, with 1.2x ZMQ's throughput (#6031)
- Raised gRPC throughput 1.9x via an asyncio server with bounded stream read-ahead (#5799, #5858)
- Cut gRPC p99 latency from ~9 ms to 1.8 ms by fixing a metrics flush stall (#5760)
- Cut gRPC recovery after a server restart from 36 s to 0.4 s by bounding reconnect backoff (#5825)
vllm-project/aibrix · vLLM's Kubernetes control plane for LLM serving · 11 merged PRs
- Built an encode stage for multimodal requests in PD and E+PD disaggregated routing (#3069, #3153, #3200)
- Cut prefix-cache routing latency by 42% and fixed tokenizer pool failures (#3035)
- Fixed LoRA prefix-cache routing by indexing KV cache blocks per adapter (#3097)
Also contributed to KAI-Scheduler (5 PRs, up to 48% faster reclaim) · guidellm (2 PRs) · semantic-router · production-stack
- Software (Computer Science & Engineering), Chung-Ang University (2021.03. ~ )
- Nexters 29th BE Member (2026.07. ~ 2026.08.)
- GDGoC CAU 4th Core Member, 5th Organizer, 6th Team Member (2024.09. ~ )
- Woowacourse 7th BE (2025.02. ~ 2025.11.)
- CECOM Member (2024.09. ~ 2026.02.)
- Undergraduate researcher at HCSLAB of Chung-Ang Univ. (2024.09. ~ 2025.01.)
- GDSC CAU 1st Member (2021.06. ~ 2022.07.)
- CAU ZeroPage 31st Member, 32nd Vice-President (2021.03. ~ )