ComputingNotes

Resources: Transformer ‌Transformer is an encoder and decoder model. It uses a mechanism called Attention. Transformer model consists of encoder and decoder. Analogy Imagine you are at a loud party. You hear fragments of conversations. To understand a specific sentence, your brain does three things instantly: Transformer Architecture The Transformer architecture is an Encoder-Decoder structure. ... Read More

LLMs: Fine-tuninghttps://developers.google.com/machine-learning/crash-course/llm/tuning Foundation Models A Foundation LLM (or base/pre-trained model) is a general-purpose model trained on vast amounts of data. It understands grammar and can perform creative tasks like writing poetry. However, to solve specific problems (like classification or regression), it often serves as a starting platform rather than a finished solution. Fine Tuning Fine-tuning ... Read More

Introduction to Large Language Modelshttps://developers.google.com/machine-learning/crash-course/llm LLMs: What is a Large Language Model? An LLM is a predictive technology that estimates the next “token” (word, character, or subword) in a sequence. They outperform older models (like N-grams) because they use vastly more parameters and can process significantly more context at once. Transformer It is most successful ... Read More

Introduction to Large Language Modelshttps://developers.google.com/machine-learning/crash-course/llm What is Language Model? At its simplest, a language model is a statistical tool that predicts the next piece of text in a sequence. The N-gram Approach Early language models used “N-grams,” which are simply ordered sequences of words where N represents the number of words. Context Context refers to ... Read More