This is a list of all terms related to large language models that I found while reading academic papers in that field.

I will keep adding to this glossary each time I encounter a new term (ISA), please let me know if you find a missing term in this list. This list is in ascending alphabetical order.

DPO: Direct performance optimization

FLOP: Floating-point operation

GAI: Generative Artificial Intelligence

GPT: Generative pre-trained transformer

GQA: Grouped query attention

HHH: Helpful, honest, harmless

LFQA: Long-form question answering

LLM: Large language model

NLG: Natural language generation

NLI: Natural language inference

NLP: Natural language processing

ORST: Object scene representation transformer

PRO: Proximal policy optimization

RAG: Retrieval augmented generation

RBRM: Rule based reward model

RLHF: Reinforcement learning from human feedback

RM: Reward model

SFT: Supervised-fine tuning

ViT: Vision transformer