共计 88 篇文章

---

2025

12-22

【论文阅读】ScheMoE:An Extensible Mixture-of-Experts Distributed Training System with Tasks Scheduling

12-22

【Megatron-LM源码分析（二）】-GPT模型pretrain流程

12-14

【Megatron-LM源码分析（一）】-环境配置与训练示例跑通

12-13

【论文阅读】The Llama 3 Herd of Models（Section 3 Pre-Training）

12-09

【论文阅读】Rail-only:A Low-Cost High-Performance Network for Training LLMs with Trillion Parameters

12-08

【论文阅读】Reducing Activation Recomputation in Large Transformer Models

12-07

【论文阅读】Megatron-LM论文阅读

08-24

【k8s APIServer 源码阅读（一）】-对象缓存

08-19

【k8s kubelet 源代码阅读（二）】-节点状态上报

08-11

【k8s kubelet 源代码阅读（一）】-Pod管理