--- a
+++ b/sub-packages/bionemo-llm/README.md
@@ -0,0 +1,6 @@
+# bionemo-llm
+
+The Bionemo Large Language Model (LLM) submodule contains common code used in submodules that train LLMs on biological
+datasets (currently `bionemo-esm2` and `bionemo-geneformer`). This includes data masking and collate functions, the
+bio-BERT common architecture code, loss functions, and other NeMo / Megatron-LM compatibility functions. Sub-packages
+should only depend on `bionemo-llm` if they need access to NeMo and Megatron-LM.