Optimization techniques for Gradient Descent   Gradient Descent is an iterative optimiZation algorithm, used to find the minimum value for a function. The general idea is to initialize the parameters to random values, and then take small steps in the direction of the “slope” at each iteration. Gradient descent is highly used in supervised learning … Continue reading Machine Learning Mastery: Optimization techniques for Gradient Descent