Commit History
-
Wave 20: fix SageMaker smoke — torch-2.7 DLC + drop vllm pin (the real conflict)
Baladithya Balamurugan +1: Claude Opus 4.8 (1M context)Second live run peeled the fundamental conflict: trl 1.5.1 requires transformers>=4.56.2, which references torch.float8_e8m0fnu (torch>=2.7). So pinning transformers DOWN (last commit) was impossible, and the torch-2.6 DLC was the wrong base. Fixes: - launcher + Dockerfile: use the torch-2.7 DLC 2.7.1-gpu-py312-cu128-ubuntu22.04-sagemaker-v1.26 (pullable, verified). - requirements.txt: drop vllm — vllm==0.8.5 hard-pins torch==2.6.0 and fights the 2.7 base. vLLM-colocate is a rollout speed optimization, not what the smoke proves; the smoke uses model.generate rollout. Resolver dry-run now clean (trl pulls transformers>=4.56.2, satisfiable on torch 2.7). - launcher: --no-vllm → --vllm (opt-in, OFF by default); vLLM needs a baked image with a torch-2.7-matched vllm>=0.9. - quickstart: document the full trl→transformers→torch chain + the vLLM note. Two failed runs cost ~$0.30 total (365 + 316 billable sec). Co-Authored-By: Claude Opus 4.8 (1M context) <noreply…a578ad9 -
Wave 20: SageMaker GRPO smoke artifacts (F3) — runnable g5.2xlarge GSM8K
Baladithya Balamurugan +1: Claude Opus 4.8 (1M context)The F3 runnable-now RL smoke, with two live-verified corrections to the design doc's recipe: - DLC tag is cu126 + requires the -v1.25 build suffix (NOT the cu124 bare tag in the AWS docs page; resolved against the live ECR registry). - sagemaker SDK pinned <3: v3 is an API rewrite that dropped sagemaker.estimator.Estimator / sagemaker.pytorch. Artifacts: - examples/gsm8k_grpo/run_sagemaker.py: GPU+vLLM-colocate variant of run.py (same GSM8K RLVR reward, plain GRPO alpha=beta=0), CLI/JSON hyperparams, writes to SM_MODEL_DIR. - examples/gsm8k_grpo/run_sagemaker_launch.py: sagemaker-v2 Estimator driver. Default --image dlc uses the stock PyTorch DLC + source_dir (no local 15GB cross-arch build); --image <ecr> uses a prebuilt baked image. Stages a minimal source_dir (framework + script + requirements). - examples/gsm8k_grpo/requirements.txt: trl + vllm==0.8.5 (torch-2.6 line) + RL stack, installed at job start atop the DLC's torch 2.6/cu126. - d…7453f13