ML Breath

[C3.ai] Model Building End-To-End

[Uber] L1 & L2 Regularization

[Google] Regression Model Metrics

[Amazon] Euclidean and Manhattan Distances

[Capital One] Feature Selection

[Amazon] Underfitting and Overfitting

[Google] Model Evaluation

[Uber] Explain AUC

[Amazon] The Curse of Dimensionality

[Capital One] Handling Missing Values

[Amazon] Hyperparameter Tuning

[Salesforce] Outliers in Modeling

[PayPal] Imbalanced Labels

[Google] Multicollinearity

[Amazon] Cross-Validation

[Amazon] Variance-Bias Trade-Off

[Amazon] Model Ensembling

[Amazon] Handling Categorical Variables

[Meta] Feature Engineering

[Microsoft] Text Features

ML Algorithm

[Microsoft] Finding Optimal K in K-Means

[Amazon] GBTs Hyperparameters

[Amazon] GBTs Pseudocode

[Apple] KNN Pseudocode

[Microsoft] K-Means

[Microsoft] Principal Component Analysis

[Salesforce] K-Means on Scaled and Unscaled Data

[Intuit] Variance & Bias in Trees

[Amazon] Bagging vs Boosting

[PayPal] Random Forest vs Logistic Regression

[Meta] Decision Tree Pseudocode

[Intuit] Logistic Regression Pseudocode

[Google] How do you evaluate regression modeling?

[Meta] How Is the random forest model trained?

Deep Learning

[PayPal] Activation Functions

[Microsoft] Gradient Descent

[Microsoft] Backpropagation

[Google] RNN vs CNN

[Amazon] Neural Network Overfitting

[Intuit] Encoder-Decoder

[Google] Tuning Dense Neural Networks

[Google] Normalization

[Google] Optimizers

ML Production

[Intuit] Kubernetes in Model Deployment

[Capital One] Model Failure in Production

[Intuit] Model Deployment on AWS

[Google] Online vs Offline Model Performance

[PayPal] Prediction Point

[Capital One] Model Deployment Challenges

[Intuit] Model Orchestration

Machine Learning

Last Updated:&nbsp;April 2024

<h2 class="wp-block-heading">Problem</h2>

What are the differences between Gradient Descent, Stochastic Gradient Descent, and ADAM optimizers?

<hr>

<h2 class="wp-block-heading">Solution</h2>

Let’s break down the key differences between Gradient Descent (GD), Stochastic Gradient Descent (SGD), and Adam optimizers, focusing on how they update weights and their pros and cons:

1. Gradient Descent (GD)

<ul class="wp-block-list">
<li>How it works:
<ul class="wp-block-list">
<li>Calculates the gradient of the loss function with respect to all parameters for the entire training dataset.</li>

Last Updated : &nbsp;April 2024 Problem What are the differences between Gradient Descent, Stochastic Gradient Descent, and ADAM optimizers? Solution…

DataInterview

[Google] Optimizers

Problem#

Solution#

Unlock the full lesson

Problem

Solution