How Gradient Descent actually update model parameters (Example)?

Gradient Descent: Under the Hood At a concrete level, we can walk through the gradient descent steps using a small e-commerce dataset containing five examples, utilizing Mean Squared Error (MSE) as the loss metric, mathematically denoted as \( J(w, b) \): Ad Spend in $1000s (feature: \( x \)) Sales in $1000s (label: \( y ... Read More

Chain Rule – Calculus

The Chain Rule is useful to differentiate a composite function. Let’s take an example ↓ Reference: Calculus, 9th Edition by George B. Thomas and Ross L. Finney Views: 21

Calculus – Law of Exponential Change: Growth and Decay

We have differential equation, $\frac{dy}{dt} = ky$ where, $y$ is quantity that increases or decreases at a rate that at any given time $t$ is proportional to the amount present. In order to derive basic equation of growth and decay from differential equation of proportional change, we follow this. Now to derive formal equation for ... Read More

Calculus – $a^x$ and $log_a x$

In calculus, exponential functions with a base other than e (like ax) and logarithms with base a (like loga x) are handled by converting them into their “natural” forms. Since the natural exponential ex and natural log ln(x) have very simple derivatives, we use them as the bridge to understand ax and loga x. Interactive ... Read More

Caculus – Exponential Functions

Resource: The Exponential Function Suppose we have a quantity \(y\), whose rate of change over time is proportional to the amount present. We can describe this relationship using a differential equation: \[ \frac{dy}{dt} = ky \] If we define the initial state where \(y = y_0\) at time \(t = 0\), the solution to this ... Read More

Calculus – Natural Logarithms

Resources: What is Natural Logarithm? In calculus, the natural logarithm is the logarithm to the base e, where e is an irrational and transcendental constant approximately equal to 2.71828. Unlike base-10 logarithms (common logs), the natural logarithm, denoted as $ln(x)$, is preferred in calculus because it simplifies the differentiation and integration of exponential functions. 1. ... Read More

Euler’s Number $e$

Resources: What is Euler’s Number? Euler’s number (eā‰ˆ2.71828e is approximately equal to 2.71828) was first discovered by Swiss mathematician in Jacob Bernoulli in1683 while studying compound interest. However, it is named after Leonhard Euler, who popularized the constant, discovered its connection to calculus, calculated its value to 23 decimal places, and used the letter š‘’ ... Read More

Calculus – Inverse Functions

Resources: What is Inverse Function in Calculus? In calculus, an inverse function is a function that “undoes” the action of another function. If a function $f$ takes an input $x$ and gives an output y, its inverse $f^{āˆ’1}$ takes $y$ and brings you back to $x$. Mathematically: $f(x) = y \iff f^{-1}(y) = x$ 1. ... Read More

Calculus – Transcendental Functions

References: Transcendental Functions In mathematics, a transcendental function is a function that does not satisfy a polynomial equation with polynomial coefficients. To put it simply: it is any function that is not algebraic. While algebraic functions can be constructed using a finite number of elementary operations (addition, subtraction, multiplication, division, and taking roots), transcendental functions ... Read More

Calculus – Application of Integrals (Area between Curves)

References: Integrals can be used to calculate many things such as area between curves, volumes and surfaces of solids, length of curves etc. Areas between Curves: In calculus, we define the exact area under a curve not by measuring it directly, but by slicing it into rectangles, adding them up, and then making the slices ... Read More
error: