AntAngelMed: 103B medical LLM, 6.1B active via MoE
MedAIBase open-sourced AntAngelMed, a 103B-parameter medical language model using 1/32 activation-ratio MoE (Mixture-of-Experts) to activate only 6.1B parameters at inference, matching ~40B dense models while hitting 200+ tokens/sec on H20 hardware.
Three-stage training pipeline: continual pre-training on medical corpora, supervised fine-tuning, then GRPO-based reinforcement learning. Ranks first on OpenAI's HealthBench, tops MedAIBench and MedBench leaderboards among open-source models.