Conda Environment
conda create -n env python=version conda activate env conda deactivate Useful tools: Starting jupyter notebook (env) file_path > jupyter notebook
Machine Learning
Famous Datasets
CIFAR 10 https://www.cs.toronto.edu/~kriz/cifar.html
Tensor basics
https://tensorly.org/stable/user_guide/tensor_basics.html Tensor – multi-dimensional array https://tensorly.org/stable/user_guide/tensor_decomposition.html
Intro to Weights and Biases
https://colab.research.google.com/github/wandb/examples/blob/master/colabs/intro/Intro_to_Weights_%26_Biases.ipynb
Training, Validation and Test Sets
Training Dataset: Evaluation Dataset: Test Dataset:
Convolutional Neural Networks
References: What are CNNs? Different steps:
Example code: Fine-tunning LLM using LoRA
Best resources:
Building Large Language Models (LLMs)
Pre-Training. Post-Training. Language Modeling. P(the, mouse, ate, the, cheese) = 0.02 – syntactic knowledgeP(the, the, mouse, ate,cheese) = 0.0001 – semantic knowledgeP(…) Auto-Reggressive (AR) language model: Predict next word. Steps: she likely prefers: tokenize -> 1 -she, 2-likely, 3-prefers => pass to blackbox model => get probability distribution over next word prediction – sample & ... Read More
Fine Tuning LLMs
Requirements: Challenges: Parameter Tuning: References:
What is Transformer?
Used by: Primary Innovations: Key Terms: Visual Explaination: Example:https://aws.amazon.com/what-is/transformers-in-artificial-intelligence/ References: