Mohlo by se vám také líbit

Více informací o knize Pre-Training LLM Engineering

• Parametry knihy
• Anotace
• Oblíbené z jiného soudku

Nákupem získáte 24 bodů

Anotace knihy

The Engineering Playbook for Pre-Training Foundation Models

LLM Pre-Training Engineering is a practical guide for ML engineers and AI infrastructure teams who need to train large language models from scratch or continue pre-training open-source checkpoints on domain-specific data.

• Build large-scale data pipelines with deduplication, quality filtering, and dataset governance
• Design tokenizers for general-purpose and domain-specific vocabularies
• Configure modern transformer architecture components for better training efficiency
• Plan distributed training with sharding, parallelism, and large-scale optimizer strategies
• Monitor training stability and recover from common training instabilities
• Apply compute-optimal scaling principles to improve budget and hardware planning
• Evaluate pre-training progress with benchmark design and validation workflows

Parametry knihy

• Plný název: Pre-Training LLM Engineering
• Podnázev: Distributed Training, Architecture Design, and Scaling Laws
• Autor: ChatVariety Team
• Jazyk: Angličtina
• Vazba: Brožovaná
• Počet stran: 88
• EAN: 9798173594327
• ID: 53881405
• Nakladatelství: Independently published
• Hmotnost: 131 g
• Rozměry: 229 × 152 × 5 mm
• Datum vydání: 12. September 2026

---

---

---