Computing Notes

Example code: Fine-tunning LLM using LoRA

Best resources:

Building Large Language Models (LLMs)

Pre-Training. Post-Training. Language Modeling. P(the, mouse, ate, the, cheese) = 0.02 – syntactic knowledgeP(the, the, mouse, ate,cheese) = 0.0001 – semantic knowledgeP(…) Auto-Reggressive (AR) language model: Predict next word. Steps: she likely prefers: tokenize -> 1 -she, 2-likely, 3-prefers => pass to blackbox model => get probability distribution over next word prediction – sample & ... Read More

Fine Tuning LLMs

Large Language Models, Machine Learning

Requirements: Challenges: Parameter Tuning: References:

What is Transformer?

Large Language Models, Machine Learning

Used by: Primary Innovations: Key Terms: Visual Explaination: Example:https://aws.amazon.com/what-is/transformers-in-artificial-intelligence/ References:

Matlab Basics

Matlab

https://au.mathworks.com/help/satcom/gs/get-started-with-satellite-link-budget-app.html https://au.mathworks.com/help/satcom/gs/model-and-visualize-satelliteScenario.html https://au.mathworks.com/help/satcom/ref/satcom.satellitescenario.transmitter.html https://au.mathworks.com/help/satcom/ref/satellitelinkbudgetanalyzer-app.html