LLM 训练方案整理

last modify

Keywords: LLM

• 方案整理

  • ColossalAI

  • Alpaca

方案整理

ColossalAI

• 代码: ColossalAI/applications/Chat · GitHub

• 博客: ColossalChat: An Open-Source Solution for Cloning ChatGPT With a Complete RLHF Pipeline | by Yang You | PyTorch | Medium

Alpaca

• stanford_alpaca: Code and documentation to train Stanford's Alpaca models, and generate the data.

• alpaca-lora: Instruct-tune LLaMA on consumer hardware · GitHub