ComputingNotes

Building Large Language Models (LLMs)

by ComputingNotes
Pre-Training. Post-Training. Language Modeling. P(the, mouse, ate, the, cheese) = 0.02 – syntactic knowledgeP(the, the, mouse, ate,cheese) = 0.0001 – semantic knowledgeP(…) Auto-Reggressive (AR) language model: Predict next word. Steps: she likely prefers: tokenize -> 1 -she, 2-likely, 3-prefers => pass to blackbox model => get probability distribution over next word prediction – sample & ... Read More

What is Transformer?

by ComputingNotes
Used by: Primary Innovations: Key Terms: Visual Explaination: Example:https://aws.amazon.com/what-is/transformers-in-artificial-intelligence/ References:

Matlab Basics

by ComputingNotes
https://au.mathworks.com/help/satcom/gs/get-started-with-satellite-link-budget-app.html https://au.mathworks.com/help/satcom/gs/model-and-visualize-satelliteScenario.html https://au.mathworks.com/help/satcom/ref/satcom.satellitescenario.transmitter.html https://au.mathworks.com/help/satcom/ref/satellitelinkbudgetanalyzer-app.html

Socket Programming in Python

by ComputingNotes
https://docs.python.org/3/library/socket.html https://www.digitalocean.com/community/tutorials/python-socket-programming-server-client Client Server – TCP / Socket Client to Client – Peer to Peer Communication : UDP Protocol (User Datagram Protocol)
error: