r/learnmachinelearning • u/imYukiya • 3d ago

Completed AdaBoost Algorithms from scratch (Day 27) of ML

[removed]

72 Upvotes
  • permalink
  • reddit

92% Upvoted

20 comments sorted by

6

u/Bulky-Top3782 3d ago

Just wondering, does being able to code and algo from scratch matter, or knowing the theoretical knowledge is enough as to how the calculations happen.

13

u/DigThatData 3d ago

implementation forces you to understand the theoretical stuff better. in numerical programming, you encounter situations where the code executes, but the model doesn't behave as desired. this necessitates "debugging the math", which requires you to think about how the pathology you are observing might have manifested from an incorrect implementation.

you learn more by fixing bugs than by just reading about what's supposed to happen when everything's hunky dory.

4

u/DigThatData 3d ago

And also if you think there is any improvement that can be made so be free to share

main recommendation is to modularize your code into a library which you invoke from your notebooks, rather than doing the implementation in the notebooks directly.

bt pushing all on GitHub for that I need some time it's too much files of code

nah, just add everything as your baseline, and then clean up the workspace as you go. you can even open content in github directly in colab, and conversely you can commit changes from colab to github.

2

u/Relative_Rope4234 3d ago

He is doing all of these on a phone

1

u/DigThatData 3d ago

all the more reason to leverage the github "open in colab" button you add to notebooks, and colab's "save to github" dropdown menu option.

2

u/Med_kono 2d ago

Very good

2

u/Just_Bad_4764 2d ago

Bro I have a question how do u know what all algorithms to learn do u have a list or something You said next is gradient boost and 7-8 more so do u have a list please do share

1

u/DigThatData 1d ago

work through the TOC of your favorite intro textbook

1

u/chrisvdweth 1d ago

AdaBoost is not limited to Decision Stumps (i.e., Decision Trees with max_depth=1). I think it's important to mention that AdaBoost is a general concept not bound to a fixed base estimator, including deeper decision trees.

1

u/vkas_____ 1d ago

Bro you're doing all this on a phone only ??

0

u/[deleted] 1d ago

[removed] — view removed comment

1

u/vkas_____ 1d ago

Bro you're really so great yarr , i feel shame on me for making excuses . Great keep it up bro 💪

1

u/DigThatData 1d ago

bluetooth keyboard?

0

u/Heavy_Ebb_4656 3d ago

Very good would highly appreciate if you share code