How Gradient Descent actually update model parameters (Example)?

Gradient Descent: Under the Hood At a concrete level, we can walk through the gradient descent steps using a small e-commerce dataset containing five examples, utilizing Mean Squared Error (MSE) as the loss metric, mathematically denoted as \( J(w, b) \): Ad Spend in $1000s (feature: \( x \)) Sales in $1000s (label: \( y ... Read More

Objective (Cost) Functions in Machine Learning

In machine learning, cost functions (also called loss or objective functions) quantify how wrong a model’s predictions are. They are divided primarily into functions for predicting continuous numbers (Regression) and functions for sorting data into categories (Classification). Regression Functions (Predicting continuous values) Mean Squared Error (MSE) / L2 Loss Most Common Measures the average squared ... Read More

What is Gradient Descent?

Optimization Algorithm Iterative in nature Minimizes specific objective functions. For example: Minimize error of regression model Maximize accuracy of classification task Core Purpose Reduces loss functions and optimizes parameters. Understanding Gradient Descent Gradient descent is an iterative optimization algorithm used to find the minimum of a function. In machine learning and artificial intelligence, it is ... Read More

What is a slope of a line?

The slope of a line measures its steepness and represents the average rate of change. It is calculated by dividing the vertical change (y) by the horizontal change (x) between two points. Core Rules Standard Slope: m = (y2 - y1) / (x2 - x1) Horizontal Lines: The slope is exactly 0. Vertical Lines: The ... Read More

How a Neural Network works?- An Example

Let’s take an example using the MNIST dataset. In the MNIST dataset, each input has a pixel size of 28 x 28. Each pixel has its corresponding numerical value ranging from 0 to 255. Here, we are taking an example of the digit 5. Thus, we will have 28 x 28 input features (784 neurons ... Read More

Types of Reinforcement Learning

First, we need to understand the key nomenclature in reinforcement learning, which includes: Agent, Environment, Reward, Action, State, Policy Function, and Value Function. Terms Agent It takes action; e.g., if you are training a drone, then the drone is the agent. Environment Where the agent exists and moves. Actions What the agent performs on the ... Read More

Multi-Objective Optimization

Multi-Objective Optimization is an interesting approach where instead of focusing on one objective we simultaneously try to minimize or maximize more than one objective function. The objective functions are conflicting in multi-objective optimization problem because a single solution doesn’t optimize each objective simultaneously. Thus, the solution in multi-objective function is called nondominated or pareto optimal ... Read More

Linear Algebra, Optimization Problem

Linear algebra is used to solve various optimization problems. Basic concepts in Linear algebra include vectors, vector space, linear transformations, systems of linear equations. While optimization problems can be linear or non linear. Vectors: Reference:C. C. Aggarwal, Linear Algebra and Optimization for Machine Learning: A Textbook. Cham: Springer International Publishing, 2020. doi: 10.1007/978-3-030-40344-7. Y. Geophys, ... Read More

Bayesian Decision Theory

Beginner’s Guide to Bayesian Decision Theory Making Sense of the Unknown The term “Bayesian Decision Theory” sounds like something you’d only hear in a graduate-level statistics lecture. It can definitely feel intimidating at first glance! But at its core, it’s actually a highly intuitive concept. In fact, it’s a mathematical formalization of how we naturally ... Read More

Deep Reinforcement Learning

Resources: 🛒 The Supermarket Analogy [Plaat et al. Page 25] Imagine you have just moved to a new city, you are hungry, and you want to buy some groceries. There is an unrealistic catch: you have no map and no smartphone. After some random exploration, you find a supermarket. You carefully note the route in ... Read More
error: