ML Breath

[C3.ai] Model Building End-To-End

[Uber] L1 & L2 Regularization

[Google] Regression Model Metrics

[Amazon] Euclidean and Manhattan Distances

[Capital One] Feature Selection

[Amazon] Underfitting and Overfitting

[Google] Model Evaluation

[Uber] Explain AUC

[Amazon] The Curse of Dimensionality

[Capital One] Handling Missing Values

[Amazon] Hyperparameter Tuning

[Salesforce] Outliers in Modeling

[PayPal] Imbalanced Labels

[Google] Multicollinearity

[Amazon] Cross-Validation

[Amazon] Variance-Bias Trade-Off

[Amazon] Model Ensembling

[Amazon] Handling Categorical Variables

[Meta] Feature Engineering

[Microsoft] Text Features

ML Algorithm

[Microsoft] Finding Optimal K in K-Means

[Amazon] GBTs Hyperparameters

[Amazon] GBTs Pseudocode

[Apple] KNN Pseudocode

[Microsoft] K-Means

[Microsoft] Principal Component Analysis

[Salesforce] K-Means on Scaled and Unscaled Data

[Intuit] Variance & Bias in Trees

[Amazon] Bagging vs Boosting

[PayPal] Random Forest vs Logistic Regression

[Meta] Decision Tree Pseudocode

[Intuit] Logistic Regression Pseudocode

[Google] How do you evaluate regression modeling?

[Meta] How Is the random forest model trained?

Deep Learning

[PayPal] Activation Functions

[Microsoft] Gradient Descent

[Microsoft] Backpropagation

[Google] RNN vs CNN

[Amazon] Neural Network Overfitting

[Intuit] Encoder-Decoder

[Google] Tuning Dense Neural Networks

[Google] Normalization

[Google] Optimizers

ML Production

[Intuit] Kubernetes in Model Deployment

[Capital One] Model Failure in Production

[Intuit] Model Deployment on AWS

[Google] Online vs Offline Model Performance

[PayPal] Prediction Point

[Capital One] Model Deployment Challenges

[Intuit] Model Orchestration

Machine Learning

Last Updated:&nbsp;August 2021

<h2 class="wp-block-heading">Problem</h2>

What’s the difference between bagging vs boosting?

<hr>

<h2 class="wp-block-heading">Solution</h2>

A single decision tree is prone to over-fitting as the number of tree depths increases. As the depth increases, the flexibility of the decision boundary increases, which in turn increases the variance of the model.

Hence, to reduce the model variance, averaging predictions from multiple trees trained on the same data can help. Two such techniques are bagging and boosting.

Bagging

Last Updated : &nbsp;August 2021 Problem What’s the difference between bagging vs boosting? Solution A single decision tree is prone to over-fitting as…

DataInterview

[Amazon] Bagging vs Boosting

Problem#

Solution#

Unlock the full lesson

Problem

Solution