Simon Mo's picture

14 3 1

Simon Mo

simon-mo

·

https://github.com/simon-mo

AI & ML interests

System for ML

Recent Activity

new activity about 1 month ago

openai/gpt-oss-120b:[v1 engine][flash_attn backend] TypeError: flash_attn_varlen_func() got an unexpected keyword argument 's_aux' when running gpt-oss-120b on H200

new activity about 1 month ago

openai/gpt-oss-120b:VLLM - Flash-attn 3

reacted to erikkaum's post with 🤗 about 2 months ago

We just released native support for @SGLang and @vllm-project in Inference Endpoints 🔥 Inference Endpoints is becoming the central place where you deploy high performance Inference Engines. And that provides the managed infra for it. Instead of spending weeks configuring infrastructure, managing servers, and debugging deployment issues, you can focus on what matters most: your AI model and your users 🙌

View all activity

Organizations

simon-mo 's models

None public yet