# LLM Pre and Post Training

#### Post Training

Post-training (sometimes referred to as “alignment”) is a key component of modern LLMs, and the way to “teach” models how to answer in a way that humans like, and how to reason.

Why is post-training different from pre training, you ask? Post-training primes the model to have a conversation with a user, which follows a set of basic rules such as:

1. In a conversation, there’s more than one speaker, and they all take turns talking
2. You should listen before you talk to say something relevant

Following are the resource for the reference .....

* [Post-training of LLMs - DeepLearning.AI](https://www.deeplearning.ai/short-courses/post-training-of-llms/)
* [Post-training 101 | Tokens for Thoughts](https://tokens-for-thoughts.notion.site/post-training-101)
* [Post training an LLM for reasoning with GRPO in TRL - Hugging Face Open-Source AI Cookbook](https://huggingface.co/learn/cookbook/en/fine_tuning_llm_grpo_trl)
* [New LLM Pre-training and Post-training Paradigms](https://magazine.sebastianraschka.com/p/new-llm-pre-training-and-post-training)
* [LLM Post-Training: A Deep Dive into Reasoning Large Language Models | by Ursina Sanderink | Medium](https://medium.com/@sanderink.ursina/llm-post-training-a-deep-dive-into-reasoning-large-language-models-b910786275b5)
* [Everything You Wanted to Know About LLM Post-Training, with Nathan Lambert of Allen Institute for AI](https://www.youtube.com/watch?v=LVXtFnEbNU0)
* [A Primer on LLM Post-Training – PyTorch](https://pytorch.org/blog/a-primer-on-llm-post-training/)
* [How can I actually learn and try LLM pretraining? (or post training a large LLM ) : r/LocalLLaMA](https://www.reddit.com/r/LocalLLaMA/comments/1mk8oll/how_can_i_actually_learn_and_try_llm_pretraining/)
* <https://medium.com/@sulbha.jindal/review-of-llm-post-training-techniques-25c2e049954e>


---

# Agent Instructions: Querying This Documentation

If you need additional information that is not directly available in this page, you can query the documentation dynamically by asking a question.

Perform an HTTP GET request on the current page URL with the `ask` query parameter:

```
GET https://59r.gitbook.io/ml-university/natural-language-processing/llm/llm-pre-and-post-training.md?ask=<question>
```

The question should be specific, self-contained, and written in natural language.
The response will contain a direct answer to the question and relevant excerpts and sources from the documentation.

Use this mechanism when the answer is not explicitly present in the current page, you need clarification or additional context, or you want to retrieve related documentation sections.