Combinatorial Optimization

(Mathematical Optimization) ↑ Combinatorial Optimization ↓ find optimal object { finite set ofobjects } → discrete Examples Travelling Salesman Problem (“TSP”) Minimum Spanning Tree problem (“MST”) Combinatorial Optimization is a specialized subfield within the broader category of Mathematical Optimization. Unlike continuous optimization where solutions exist along an infinite spectrum, combinatorial optimization focuses on finding the ... Read More

Quote of the Day

“ God used beautiful mathematics in creating the world. Paul Dirac Theoretical physicist, Nobel Prize in Physics 1933 About the quote: Paul Dirac, a pioneering theoretical physicist and Nobel laureate, firmly believed that mathematical beauty was a guiding principle in discovering the fundamental laws of nature. This quote reflects his view that elegance in mathematical ... Read More

Bloch Sphere

|0⟩ |1⟩ x y |ψ⟩ What is a Bloch Sphere? In quantum mechanics and quantum computing, the Bloch sphere is a geometrical representation of a single qubit (quantum bit). It allows us to visualize the mathematical state of a two-level quantum system as a point in 3D space. The Poles: The North Pole represents the ... Read More

How Gradient Descent actually update model parameters (Example)?

Gradient Descent: Under the Hood At a concrete level, we can walk through the gradient descent steps using a small e-commerce dataset containing five examples, utilizing Mean Squared Error (MSE) as the loss metric, mathematically denoted as \( J(w, b) \): Ad Spend in $1000s (feature: \( x \)) Sales in $1000s (label: \( y ... Read More

Chain Rule – Calculus

The Chain Rule is useful to differentiate a composite function. Let’s take an example ↓ Reference: Calculus, 9th Edition by George B. Thomas and Ross L. Finney Views: 16

Objective (Cost) Functions in Machine Learning

In machine learning, cost functions (also called loss or objective functions) quantify how wrong a model’s predictions are. They are divided primarily into functions for predicting continuous numbers (Regression) and functions for sorting data into categories (Classification). Regression Functions (Predicting continuous values) Mean Squared Error (MSE) / L2 Loss Most Common Measures the average squared ... Read More

What is Gradient Descent?

Optimization Algorithm Iterative in nature Minimizes specific objective functions. For example: Minimize error of regression model Maximize accuracy of classification task Core Purpose Reduces loss functions and optimizes parameters. Understanding Gradient Descent Gradient descent is an iterative optimization algorithm used to find the minimum of a function. In machine learning and artificial intelligence, it is ... Read More

What is a slope of a line?

The slope of a line measures its steepness and represents the average rate of change. It is calculated by dividing the vertical change (y) by the horizontal change (x) between two points. Core Rules Standard Slope: m = (y2 - y1) / (x2 - x1) Horizontal Lines: The slope is exactly 0. Vertical Lines: The ... Read More

How a Neural Network works?- An Example

Let’s take an example using the MNIST dataset. In the MNIST dataset, each input has a pixel size of 28 x 28. Each pixel has its corresponding numerical value ranging from 0 to 255. Here, we are taking an example of the digit 5. Thus, we will have 28 x 28 input features (784 neurons ... Read More

What is Neural Network ? From AI to Generative AI

Lets first understand field of Artificial Intelligence (AI) and how it is related with machine learning, deep learning and generative AI. The Evolution of Artificial Intelligence The overarching goal of artificial intelligence is to teach machines to perform tasks normally done by humans. The evolutionary progression toward this goal is divided into four major stages. ... Read More
error: