Log documents_seen / num_documents and offer it as a W&B x-axis#559

Merged

jlamypoirier merged 11 commits into

mainfrom

jlp_documents_seen

Jul 9, 2026

Commits on Jul 9, 2026

Drop dead num_documents-is-not-None check in TokenModelInput.share_batch_data

jlamypoirier
and
claude
committed
Collapse now-empty TokenPreprocessingConfig into LengthPreprocessingConfig

jlamypoirier
and
claude
committed
Define the documents_seen W&B x-axis unconditionally in __init__

jlamypoirier
and
claude
committed
Always include num_documents/documents_seen in logged training metrics

jlamypoirier
and
claude
committed
Review fixes: trust int document-count boundary, keep step as default W&B x-axis

jlamypoirier
and
claude
committed
Review fixes: dedup document-count expression, drop restating comments

jlamypoirier
and
claude
committed
Merge branch 'main' into jlp_documents_seen
jlamypoirier
authored