| 2025-08-31 17:03:52 - pico-train - INFO - Step 100000 -- 📊 Evaluation Results | |
| 2025-08-31 17:03:52 - pico-train - INFO - └── paloma: inf | |
| 2025-08-31 17:03:52 - pico-train - INFO - ================================================== | |
| 2025-08-31 17:03:52 - pico-train - INFO - ✨ Training Configuration | |
| 2025-08-31 17:03:52 - pico-train - INFO - ================================================== | |
| 2025-08-31 17:03:52 - pico-train - INFO - ╭─────────────────────────────────────────────────────╮ | |
| 2025-08-31 17:03:52 - pico-train - INFO - │ checkpointing: │ | |
| 2025-08-31 17:03:52 - pico-train - INFO - │ checkpoints_dir: checkpoints │ | |
| 2025-08-31 17:03:52 - pico-train - INFO - │ evaluation: │ | |
| 2025-08-31 17:03:52 - pico-train - INFO - │ eval_results_dir: eval_results │ | |
| 2025-08-31 17:03:52 - pico-train - INFO - │ fabric_checkpoint_dir: fabric_state │ | |
| 2025-08-31 17:03:52 - pico-train - INFO - │ fabric_checkpoint_filename: checkpoint.pt │ | |
| 2025-08-31 17:03:52 - pico-train - INFO - │ hf_checkpoint: │ | |
| 2025-08-31 17:03:52 - pico-train - INFO - │ collection_slug: null │ | |
| 2025-08-31 17:03:52 - pico-train - INFO - │ repo_id: ThomasTheMaker/pico-decoder-tiny │ | |
| 2025-08-31 17:03:52 - pico-train - INFO - │ learning_dynamics: │ | |
| 2025-08-31 17:03:52 - pico-train - INFO - │ batch_size: 1 │ | |
| 2025-08-31 17:03:52 - pico-train - INFO - │ eval_data: null │ | |
| 2025-08-31 17:03:52 - pico-train - INFO - │ layer_suffixes: │ | |
| 2025-08-31 17:03:52 - pico-train - INFO - │ - attention.v_proj │ | |
| 2025-08-31 17:03:52 - pico-train - INFO - │ - attention.o_proj │ | |
| 2025-08-31 17:03:52 - pico-train - INFO - │ - swiglu.w_2 │ | |
| 2025-08-31 17:03:52 - pico-train - INFO - │ sequence_idx: -1 │ | |
| 2025-08-31 17:03:52 - pico-train - INFO - │ learning_dynamics_dir: learning_dynamics │ | |
| 2025-08-31 17:03:52 - pico-train - INFO - │ logs_dir: logs │ | |
| 2025-08-31 17:03:52 - pico-train - INFO - │ run_name: pico-decoder-tiny-dolma250M-v1 │ | |
| 2025-08-31 17:03:52 - pico-train - INFO - │ runs_dir: runs │ | |
| 2025-08-31 17:03:52 - pico-train - INFO - │ save_every_n_steps: 2000 │ | |
| 2025-08-31 17:03:52 - pico-train - INFO - │ save_to_hf: false │ | |
| 2025-08-31 17:03:52 - pico-train - INFO - │ training: │ | |
| 2025-08-31 17:03:52 - pico-train - INFO - │ auto_resume: true │ | |
| 2025-08-31 17:03:52 - pico-train - INFO - │ data: │ | |
| 2025-08-31 17:03:52 - pico-train - INFO - │ dataloader: │ | |
| 2025-08-31 17:03:52 - pico-train - INFO - │ batch_size: 16 │ | |
| 2025-08-31 17:03:52 - pico-train - INFO - │ dataset: │ | |
| 2025-08-31 17:03:52 - pico-train - INFO - │ name: pico-lm/pretokenized-dolma │ | |
| 2025-08-31 17:03:52 - pico-train - INFO - │ tokenizer: │ | |
| 2025-08-31 17:03:52 - pico-train - INFO - │ name: allenai/OLMo-7B-0724-hf │ | |
| 2025-08-31 17:03:52 - pico-train - INFO - │ vocab_size: 50304 │ | |
| 2025-08-31 17:03:52 - pico-train - INFO - │ evaluation: │ | |
| 2025-08-31 17:03:52 - pico-train - INFO - │ metrics: │ | |
| 2025-08-31 17:03:52 - pico-train - INFO - │ - paloma │ | |
| 2025-08-31 17:03:52 - pico-train - INFO - │ paloma: │ | |
| 2025-08-31 17:03:52 - pico-train - INFO - │ batch_size: 1 │ | |
| 2025-08-31 17:03:52 - pico-train - INFO - │ dataset_name: pico-lm/pretokenized-paloma-tinsy │ | |
| 2025-08-31 17:03:52 - pico-train - INFO - │ dataset_split: val │ | |
| 2025-08-31 17:03:52 - pico-train - INFO - │ max_length: 2048 │ | |
| 2025-08-31 17:03:52 - pico-train - INFO - │ model: │ | |
| 2025-08-31 17:03:52 - pico-train - INFO - │ activation_hidden_dim: 384 │ | |
| 2025-08-31 17:03:52 - pico-train - INFO - │ attention_n_heads: 12 │ | |
| 2025-08-31 17:03:52 - pico-train - INFO - │ attention_n_kv_heads: 4 │ | |
| 2025-08-31 17:03:52 - pico-train - INFO - │ batch_size: 1024 │ | |
| 2025-08-31 17:03:52 - pico-train - INFO - │ d_model: 96 │ | |
| 2025-08-31 17:03:52 - pico-train - INFO - │ max_seq_len: 2048 │ | |
| 2025-08-31 17:03:52 - pico-train - INFO - │ model_type: pico_decoder │ | |
| 2025-08-31 17:03:52 - pico-train - INFO - │ n_layers: 12 │ | |
| 2025-08-31 17:03:52 - pico-train - INFO - │ norm_eps: 1.0e-06 │ | |
| 2025-08-31 17:03:52 - pico-train - INFO - │ position_emb_theta: 10000.0 │ | |
| 2025-08-31 17:03:52 - pico-train - INFO - │ vocab_size: 50304 │ | |
| 2025-08-31 17:03:52 - pico-train - INFO - │ monitoring: │ | |
| 2025-08-31 17:03:52 - pico-train - INFO - │ logging: │ | |
| 2025-08-31 17:03:52 - pico-train - INFO - │ log_every_n_steps: 100 │ | |
| 2025-08-31 17:03:52 - pico-train - INFO - │ log_level: INFO │ | |
| 2025-08-31 17:03:52 - pico-train - INFO - │ save_to_wandb: false │ | |
| 2025-08-31 17:03:52 - pico-train - INFO - │ wandb: │ | |
| 2025-08-31 17:03:52 - pico-train - INFO - │ entity: boymyc │ | |
| 2025-08-31 17:03:52 - pico-train - INFO - │ project: pico-decoder-tiny │ | |
| 2025-08-31 17:03:52 - pico-train - INFO - │ training: │ | |
| 2025-08-31 17:03:52 - pico-train - INFO - │ fabric: │ | |
| 2025-08-31 17:03:52 - pico-train - INFO - │ accelerator: cuda │ | |
| 2025-08-31 17:03:52 - pico-train - INFO - │ num_devices: 1 │ | |
| 2025-08-31 17:03:52 - pico-train - INFO - │ num_nodes: 1 │ | |
| 2025-08-31 17:03:52 - pico-train - INFO - │ precision: bf16-mixed │ | |
| 2025-08-31 17:03:52 - pico-train - INFO - │ max_steps: 100000 │ | |
| 2025-08-31 17:03:52 - pico-train - INFO - │ optimization: │ | |
| 2025-08-31 17:03:52 - pico-train - INFO - │ gradient_accumulation_steps: 1 │ | |
| 2025-08-31 17:03:52 - pico-train - INFO - │ lr: 0.0002 │ | |
| 2025-08-31 17:03:52 - pico-train - INFO - │ lr_scheduler: cosine │ | |
| 2025-08-31 17:03:52 - pico-train - INFO - │ lr_warmup_steps: 2000 │ | |
| 2025-08-31 17:03:52 - pico-train - INFO - │ optimizer: adamw │ | |
| 2025-08-31 17:03:52 - pico-train - INFO - │ │ | |
| 2025-08-31 17:03:52 - pico-train - INFO - ╰─────────────────────────────────────────────────────╯ | |
| 2025-08-31 17:03:52 - pico-train - INFO - ================================================== | |
| 2025-08-31 17:03:52 - pico-train - INFO - ⛭ Runtime Summary: | |
| 2025-08-31 17:03:52 - pico-train - INFO - ================================================== | |
| 2025-08-31 17:03:52 - pico-train - INFO - Starting from step: 100000 | |
| 2025-08-31 17:03:52 - pico-train - INFO - Model Setup: | |
| 2025-08-31 17:03:52 - pico-train - INFO - └─ Total Parameters: 11,282,784 | |
| 2025-08-31 17:03:52 - pico-train - INFO - └─ Trainable Parameters: 11,282,784 | |
| 2025-08-31 17:03:52 - pico-train - INFO - Distributed Setup: | |
| 2025-08-31 17:03:52 - pico-train - INFO - └─ Number of Devices: 1 | |
| 2025-08-31 17:03:52 - pico-train - INFO - └─ Device Type: NVIDIA H100 80GB HBM3 | |
| 2025-08-31 17:03:52 - pico-train - INFO - └─ Available Memory: 85.03 GB | |
| 2025-08-31 17:03:52 - pico-train - INFO - Software Setup: | |
| 2025-08-31 17:03:52 - pico-train - INFO - └─ Python Version: 3.12.3 | |
| 2025-08-31 17:03:52 - pico-train - INFO - └─ PyTorch Version: 2.8.0+cu128 | |
| 2025-08-31 17:03:52 - pico-train - INFO - └─ CUDA Version: 12.8 | |
| 2025-08-31 17:03:52 - pico-train - INFO - └─ Operating System: Linux 6.8.0-71-generic | |
| 2025-08-31 17:03:52 - pico-train - INFO - Batch Size Configuration: | |
| 2025-08-31 17:03:52 - pico-train - INFO - └─ Global Batch Size: 16 | |
| 2025-08-31 17:03:52 - pico-train - INFO - └─ Per Device Batch Size: 16 | |
| 2025-08-31 17:03:52 - pico-train - INFO - └─ Gradient Accumulation Steps: 1 | |
| 2025-08-31 17:03:52 - pico-train - INFO - ================================================== | |
| 2025-08-31 17:03:52 - pico-train - INFO - Step 100000 -- 🔄 Training Metrics | |
| 2025-08-31 17:03:52 - pico-train - INFO - ├── Loss: 4.9432 | |
| 2025-08-31 17:03:52 - pico-train - INFO - ├── Learning Rate: 2.00e-05 | |
| 2025-08-31 17:03:52 - pico-train - INFO - └── Inf/NaN count: 0 | |
| 2025-08-31 17:03:52 - pico-train - INFO - Step 100000 -- 📈 Saving Learning Dynamics | |
| 2025-08-31 17:04:49 - pico-train - INFO - Step 100100 -- 🔄 Training Metrics | |
| 2025-08-31 17:04:49 - pico-train - INFO - ├── Loss: 4.7703 | |
| 2025-08-31 17:04:49 - pico-train - INFO - ├── Learning Rate: 1.01e-04 | |
| 2025-08-31 17:04:49 - pico-train - INFO - └── Inf/NaN count: 0 | |
| 2025-08-31 17:05:43 - pico-train - INFO - Step 100200 -- 🔄 Training Metrics | |
| 2025-08-31 17:05:43 - pico-train - INFO - ├── Loss: 4.8047 | |
| 2025-08-31 17:05:43 - pico-train - INFO - ├── Learning Rate: 1.01e-04 | |
| 2025-08-31 17:05:43 - pico-train - INFO - └── Inf/NaN count: 0 | |
| 2025-08-31 17:06:37 - pico-train - INFO - Step 100300 -- 🔄 Training Metrics | |
| 2025-08-31 17:06:37 - pico-train - INFO - ├── Loss: 4.8076 | |
| 2025-08-31 17:06:37 - pico-train - INFO - ├── Learning Rate: 1.01e-04 | |
| 2025-08-31 17:06:37 - pico-train - INFO - └── Inf/NaN count: 0 | |
| 2025-08-31 17:07:31 - pico-train - INFO - Step 100400 -- 🔄 Training Metrics | |
| 2025-08-31 17:07:31 - pico-train - INFO - ├── Loss: 4.7926 | |
| 2025-08-31 17:07:31 - pico-train - INFO - ├── Learning Rate: 1.01e-04 | |
| 2025-08-31 17:07:31 - pico-train - INFO - └── Inf/NaN count: 0 | |
| 2025-08-31 17:08:25 - pico-train - INFO - Step 100500 -- 🔄 Training Metrics | |
| 2025-08-31 17:08:25 - pico-train - INFO - ├── Loss: 4.8059 | |
| 2025-08-31 17:08:25 - pico-train - INFO - ├── Learning Rate: 1.01e-04 | |
| 2025-08-31 17:08:25 - pico-train - INFO - └── Inf/NaN count: 0 | |
| 2025-08-31 17:09:19 - pico-train - INFO - Step 100600 -- 🔄 Training Metrics | |
| 2025-08-31 17:09:19 - pico-train - INFO - ├── Loss: 4.7896 | |
| 2025-08-31 17:09:19 - pico-train - INFO - ├── Learning Rate: 1.01e-04 | |
| 2025-08-31 17:09:19 - pico-train - INFO - └── Inf/NaN count: 0 | |
| 2025-08-31 17:10:12 - pico-train - INFO - Step 100700 -- 🔄 Training Metrics | |
| 2025-08-31 17:10:12 - pico-train - INFO - ├── Loss: 4.8066 | |
| 2025-08-31 17:10:12 - pico-train - INFO - ├── Learning Rate: 1.00e-04 | |
| 2025-08-31 17:10:12 - pico-train - INFO - └── Inf/NaN count: 0 | |
| 2025-08-31 17:11:07 - pico-train - INFO - Step 100800 -- 🔄 Training Metrics | |
| 2025-08-31 17:11:07 - pico-train - INFO - ├── Loss: 4.7870 | |
| 2025-08-31 17:11:07 - pico-train - INFO - ├── Learning Rate: 1.00e-04 | |
| 2025-08-31 17:11:07 - pico-train - INFO - └── Inf/NaN count: 0 | |
| 2025-08-31 17:12:01 - pico-train - INFO - Step 100900 -- 🔄 Training Metrics | |
| 2025-08-31 17:12:01 - pico-train - INFO - ├── Loss: 4.7958 | |
| 2025-08-31 17:12:01 - pico-train - INFO - ├── Learning Rate: 1.00e-04 | |
| 2025-08-31 17:12:01 - pico-train - INFO - └── Inf/NaN count: 0 | |
| 2025-08-31 17:12:55 - pico-train - INFO - Step 101000 -- 🔄 Training Metrics | |
| 2025-08-31 17:12:55 - pico-train - INFO - ├── Loss: 4.8081 | |
| 2025-08-31 17:12:55 - pico-train - INFO - ├── Learning Rate: 1.00e-04 | |
| 2025-08-31 17:12:55 - pico-train - INFO - └── Inf/NaN count: 0 | |
| 2025-08-31 17:13:48 - pico-train - INFO - Step 101100 -- 🔄 Training Metrics | |
| 2025-08-31 17:13:48 - pico-train - INFO - ├── Loss: 4.8023 | |
| 2025-08-31 17:13:48 - pico-train - INFO - ├── Learning Rate: 9.98e-05 | |
| 2025-08-31 17:13:48 - pico-train - INFO - └── Inf/NaN count: 0 | |
| 2025-08-31 17:14:43 - pico-train - INFO - Step 101200 -- 🔄 Training Metrics | |
| 2025-08-31 17:14:43 - pico-train - INFO - ├── Loss: 4.7830 | |
| 2025-08-31 17:14:43 - pico-train - INFO - ├── Learning Rate: 9.97e-05 | |
| 2025-08-31 17:14:43 - pico-train - INFO - └── Inf/NaN count: 0 | |
| 2025-08-31 17:15:38 - pico-train - INFO - Step 101300 -- 🔄 Training Metrics | |
| 2025-08-31 17:15:38 - pico-train - INFO - ├── Loss: 4.8071 | |
| 2025-08-31 17:15:38 - pico-train - INFO - ├── Learning Rate: 9.95e-05 | |
| 2025-08-31 17:15:38 - pico-train - INFO - └── Inf/NaN count: 0 | |
| 2025-08-31 17:16:32 - pico-train - INFO - Step 101400 -- 🔄 Training Metrics | |
| 2025-08-31 17:16:32 - pico-train - INFO - ├── Loss: 4.8072 | |
| 2025-08-31 17:16:32 - pico-train - INFO - ├── Learning Rate: 9.94e-05 | |
| 2025-08-31 17:16:32 - pico-train - INFO - └── Inf/NaN count: 0 | |
| 2025-08-31 17:17:27 - pico-train - INFO - Step 101500 -- 🔄 Training Metrics | |
| 2025-08-31 17:17:27 - pico-train - INFO - ├── Loss: 4.8027 | |
| 2025-08-31 17:17:27 - pico-train - INFO - ├── Learning Rate: 9.92e-05 | |
| 2025-08-31 17:17:27 - pico-train - INFO - └── Inf/NaN count: 0 | |
| 2025-08-31 17:18:20 - pico-train - INFO - Step 101600 -- 🔄 Training Metrics | |
| 2025-08-31 17:18:20 - pico-train - INFO - ├── Loss: 4.7874 | |
| 2025-08-31 17:18:20 - pico-train - INFO - ├── Learning Rate: 9.90e-05 | |
| 2025-08-31 17:18:20 - pico-train - INFO - └── Inf/NaN count: 0 | |
| 2025-08-31 17:19:15 - pico-train - INFO - Step 101700 -- 🔄 Training Metrics | |
| 2025-08-31 17:19:15 - pico-train - INFO - ├── Loss: 4.7817 | |
| 2025-08-31 17:19:15 - pico-train - INFO - ├── Learning Rate: 9.89e-05 | |
| 2025-08-31 17:19:15 - pico-train - INFO - └── Inf/NaN count: 0 | |
| 2025-08-31 17:20:09 - pico-train - INFO - Step 101800 -- 🔄 Training Metrics | |
| 2025-08-31 17:20:09 - pico-train - INFO - ├── Loss: 4.8188 | |
| 2025-08-31 17:20:09 - pico-train - INFO - ├── Learning Rate: 9.87e-05 | |
| 2025-08-31 17:20:09 - pico-train - INFO - └── Inf/NaN count: 0 | |
| 2025-08-31 17:21:04 - pico-train - INFO - Step 101900 -- 🔄 Training Metrics | |
| 2025-08-31 17:21:04 - pico-train - INFO - ├── Loss: 4.7880 | |
| 2025-08-31 17:21:04 - pico-train - INFO - ├── Learning Rate: 9.86e-05 | |
| 2025-08-31 17:21:04 - pico-train - INFO - └── Inf/NaN count: 0 | |
| 2025-08-31 17:21:58 - pico-train - INFO - Step 102000 -- 💾 Saving Checkpoint | |
| 2025-08-31 18:00:17 - pico-train - INFO - Step 102000 -- 📊 Evaluation Results | |
| 2025-08-31 18:00:17 - pico-train - INFO - └── paloma: inf | |
| 2025-08-31 18:00:17 - pico-train - INFO - Step 102000 -- 🔄 Training Metrics | |
| 2025-08-31 18:00:17 - pico-train - INFO - ├── Loss: 4.8055 | |
| 2025-08-31 18:00:17 - pico-train - INFO - ├── Learning Rate: 9.84e-05 | |
| 2025-08-31 18:00:17 - pico-train - INFO - └── Inf/NaN count: 0 | |
| 2025-08-31 18:00:17 - pico-train - INFO - Step 102000 -- 📈 Saving Learning Dynamics | |
| 2025-08-31 18:01:13 - pico-train - INFO - Step 102100 -- 🔄 Training Metrics | |
| 2025-08-31 18:01:13 - pico-train - INFO - ├── Loss: 4.7742 | |
| 2025-08-31 18:01:13 - pico-train - INFO - ├── Learning Rate: 9.83e-05 | |
| 2025-08-31 18:01:13 - pico-train - INFO - └── Inf/NaN count: 0 | |
| 2025-08-31 18:02:07 - pico-train - INFO - Step 102200 -- 🔄 Training Metrics | |
| 2025-08-31 18:02:07 - pico-train - INFO - ├── Loss: 4.8050 | |
| 2025-08-31 18:02:07 - pico-train - INFO - ├── Learning Rate: 9.81e-05 | |
| 2025-08-31 18:02:07 - pico-train - INFO - └── Inf/NaN count: 0 | |
| 2025-08-31 18:03:01 - pico-train - INFO - Step 102300 -- 🔄 Training Metrics | |
| 2025-08-31 18:03:01 - pico-train - INFO - ├── Loss: 4.8066 | |
| 2025-08-31 18:03:01 - pico-train - INFO - ├── Learning Rate: 9.79e-05 | |
| 2025-08-31 18:03:01 - pico-train - INFO - └── Inf/NaN count: 0 | |
| 2025-08-31 18:03:57 - pico-train - INFO - Step 102400 -- 🔄 Training Metrics | |
| 2025-08-31 18:03:57 - pico-train - INFO - ├── Loss: 4.7865 | |
| 2025-08-31 18:03:57 - pico-train - INFO - ├── Learning Rate: 9.78e-05 | |
| 2025-08-31 18:03:57 - pico-train - INFO - └── Inf/NaN count: 0 | |
| 2025-08-31 18:04:50 - pico-train - INFO - Step 102500 -- 🔄 Training Metrics | |
| 2025-08-31 18:04:50 - pico-train - INFO - ├── Loss: 4.8019 | |
| 2025-08-31 18:04:50 - pico-train - INFO - ├── Learning Rate: 9.76e-05 | |
| 2025-08-31 18:04:50 - pico-train - INFO - └── Inf/NaN count: 0 | |
| 2025-08-31 18:05:45 - pico-train - INFO - Step 102600 -- 🔄 Training Metrics | |
| 2025-08-31 18:05:45 - pico-train - INFO - ├── Loss: 4.7948 | |
| 2025-08-31 18:05:45 - pico-train - INFO - ├── Learning Rate: 9.75e-05 | |
| 2025-08-31 18:05:45 - pico-train - INFO - └── Inf/NaN count: 0 | |
| 2025-08-31 18:06:39 - pico-train - INFO - Step 102700 -- 🔄 Training Metrics | |
| 2025-08-31 18:06:39 - pico-train - INFO - ├── Loss: 4.8006 | |
| 2025-08-31 18:06:39 - pico-train - INFO - ├── Learning Rate: 9.73e-05 | |
| 2025-08-31 18:06:39 - pico-train - INFO - └── Inf/NaN count: 0 | |
| 2025-08-31 18:07:33 - pico-train - INFO - Step 102800 -- 🔄 Training Metrics | |
| 2025-08-31 18:07:33 - pico-train - INFO - ├── Loss: 4.8049 | |
| 2025-08-31 18:07:33 - pico-train - INFO - ├── Learning Rate: 9.71e-05 | |
| 2025-08-31 18:07:33 - pico-train - INFO - └── Inf/NaN count: 0 | |
| 2025-08-31 18:08:27 - pico-train - INFO - Step 102900 -- 🔄 Training Metrics | |
| 2025-08-31 18:08:27 - pico-train - INFO - ├── Loss: 4.8086 | |
| 2025-08-31 18:08:27 - pico-train - INFO - ├── Learning Rate: 9.70e-05 | |
| 2025-08-31 18:08:27 - pico-train - INFO - └── Inf/NaN count: 0 | |
| 2025-08-31 18:09:21 - pico-train - INFO - Step 103000 -- 🔄 Training Metrics | |
| 2025-08-31 18:09:21 - pico-train - INFO - ├── Loss: 4.8154 | |
| 2025-08-31 18:09:21 - pico-train - INFO - ├── Learning Rate: 9.68e-05 | |
| 2025-08-31 18:09:21 - pico-train - INFO - └── Inf/NaN count: 0 | |
| 2025-08-31 18:10:15 - pico-train - INFO - Step 103100 -- 🔄 Training Metrics | |
| 2025-08-31 18:10:15 - pico-train - INFO - ├── Loss: 4.8232 | |
| 2025-08-31 18:10:15 - pico-train - INFO - ├── Learning Rate: 9.67e-05 | |
| 2025-08-31 18:10:15 - pico-train - INFO - └── Inf/NaN count: 0 | |
| 2025-08-31 18:11:10 - pico-train - INFO - Step 103200 -- 🔄 Training Metrics | |
| 2025-08-31 18:11:10 - pico-train - INFO - ├── Loss: 4.8032 | |
| 2025-08-31 18:11:10 - pico-train - INFO - ├── Learning Rate: 9.65e-05 | |
| 2025-08-31 18:11:10 - pico-train - INFO - └── Inf/NaN count: 0 | |
| 2025-08-31 18:12:05 - pico-train - INFO - Step 103300 -- 🔄 Training Metrics | |
| 2025-08-31 18:12:05 - pico-train - INFO - ├── Loss: 4.8157 | |
| 2025-08-31 18:12:05 - pico-train - INFO - ├── Learning Rate: 9.64e-05 | |
| 2025-08-31 18:12:05 - pico-train - INFO - └── Inf/NaN count: 0 | |
| 2025-08-31 18:13:00 - pico-train - INFO - Step 103400 -- 🔄 Training Metrics | |
| 2025-08-31 18:13:00 - pico-train - INFO - ├── Loss: 4.7903 | |
| 2025-08-31 18:13:00 - pico-train - INFO - ├── Learning Rate: 9.62e-05 | |
| 2025-08-31 18:13:00 - pico-train - INFO - └── Inf/NaN count: 0 | |
| 2025-08-31 18:13:54 - pico-train - INFO - Step 103500 -- 🔄 Training Metrics | |
| 2025-08-31 18:13:54 - pico-train - INFO - ├── Loss: 4.7786 | |
| 2025-08-31 18:13:54 - pico-train - INFO - ├── Learning Rate: 9.60e-05 | |
| 2025-08-31 18:13:54 - pico-train - INFO - └── Inf/NaN count: 0 | |
| 2025-08-31 18:14:48 - pico-train - INFO - Step 103600 -- 🔄 Training Metrics | |
| 2025-08-31 18:14:48 - pico-train - INFO - ├── Loss: 4.7962 | |
| 2025-08-31 18:14:48 - pico-train - INFO - ├── Learning Rate: 9.59e-05 | |
| 2025-08-31 18:14:48 - pico-train - INFO - └── Inf/NaN count: 0 | |
| 2025-08-31 18:15:43 - pico-train - INFO - Step 103700 -- 🔄 Training Metrics | |
| 2025-08-31 18:15:43 - pico-train - INFO - ├── Loss: 4.8097 | |
| 2025-08-31 18:15:43 - pico-train - INFO - ├── Learning Rate: 9.57e-05 | |
| 2025-08-31 18:15:43 - pico-train - INFO - └── Inf/NaN count: 0 | |
| 2025-08-31 18:16:37 - pico-train - INFO - Step 103800 -- 🔄 Training Metrics | |
| 2025-08-31 18:16:37 - pico-train - INFO - ├── Loss: 4.7613 | |
| 2025-08-31 18:16:37 - pico-train - INFO - ├── Learning Rate: 9.56e-05 | |
| 2025-08-31 18:16:37 - pico-train - INFO - └── Inf/NaN count: 0 | |
| 2025-08-31 18:17:31 - pico-train - INFO - Step 103900 -- 🔄 Training Metrics | |
| 2025-08-31 18:17:31 - pico-train - INFO - ├── Loss: 4.7992 | |
| 2025-08-31 18:17:31 - pico-train - INFO - ├── Learning Rate: 9.54e-05 | |
| 2025-08-31 18:17:31 - pico-train - INFO - └── Inf/NaN count: 0 | |
| 2025-08-31 18:18:25 - pico-train - INFO - Step 104000 -- 💾 Saving Checkpoint | |