ML | Linear Regression

A machine learning algorithm based on supervised learning is linear regression. It executes a regression operation. Regression uses independent variables to model a goal prediction value. It is mostly used to determine how variables and forecasting relate to one another. Regression models vary according to the number of independent variables they utilize and the type of relationship they take into account between the dependent and independent variables.

Predicting the value of a dependent variable (y) based on an independent variable is carried out using linear regression algorithm (x). Therefore, x (the input) and y (the output) are found to be linearly related using this regression approach (output). Thus, the term "linear regression" was coined.

In the diagram above, X represents a person's job history and Y represents their wage. The regression line is the line that fits our model the best.

Hypothesis Function Of Linear Regression:



As we train the provided model:

input training data (one input variable, or parameter), x

Labels to data, y (supervised learning)


The model fits the best line to predict the value of y for a given value of x during training. By locating the best 1 and 2 values, the model produces the best regression fit line.

One: interception

2: x's coefficient


The best fit line is obtained after determining the best 1 and 2 values. Therefore, when we ultimately use our model to make a prediction, it will forecast the value of y based on the value of the input x.


How can 1 and 2 values be updated to obtain the greatest fit line?

Cost Function{J}:

The model seeks to predict y values such that the error difference between projected value and real value is minimal by attaining the best-fit regression line. To find the optimal value that minimises the error between the predicted y value (pred) and real y value, it is crucial to change the 1 and 2 values (y).




The Root Mean Squared Error (RMSE) between the predicted y value (pred) and the real y value is the cost function(J) of linear regression (y).

Gradient Descent: The model employs Gradient Descent to update 1 and 2 values in order to minimise Cost function (minimising RMSE value) and get the best fit line. Starting with random values for 1 and 2, the goal is to repeatedly update the values until the minimal cost is reached.

#Artificial intelligence #Machine Learning #Python #Data Science

Comments

Post a Comment

Popular posts from this blog

Unleashing Creativity: The Latest Frontier of Animation AI

Image
 Introduction Animation AI is the result of the convergence of technology and creativity in the animation field. This groundbreaking fusion has not only transformed the animation landscape but also opened up exciting avenues for artists, storytellers, and tech enthusiasts alike. In this blog, we delve into the latest trends, advancements, and possibilities that Animation AI brings to the table. Lifelike Character Animation AI-driven character animation has taken realism to unprecedented levels. With machine learning algorithms studying human motion, characters move and interact in ways that mirror real-life actions. Expressions and emotions are portrayed authentically, immersing audiences in narratives that tug at heartstrings. Efficiency and Speed Automation is a hallmark of Animation AI. Inbetweening, traditionally a meticulous manual process, is now accelerated by AI, reducing production time. Creative minds can focus on refining the narrative while AI handles the technical intr
Read more

Tanh Activation Function

Image
With a difference in output range of -1 to 1, the tanh activation function is remarkably similar to the sigmoid/logistic activation function, and even has the same S-shape. The larger the input (more positive), the closer the output to 1.0, and the smaller the input (more negative), the closer the output to -1.0. Mathematically it can be represented as: The following are some of the benefits of using this activation function: We can simply map the output values as strongly negative, neutral, or very positive because the tanh activation function's output is Zero centred. Because its values range from -1 to, it's commonly utilised in hidden layers of neural networks. As a result, the hidden layer's mean is 0 or extremely close to it. It aids in data centering and makes learning the next layer much simpler. To understand the tanh activation function's limits, look at its gradient. As you can see, it, like the sigmoid activation function, has the problem of vanishing gradi
Read more

Unveiling the Hidden Gems: Exploring Data Mining Functionality

 Introduction:  In today's data-driven world, where information is abundant but insights are hidden, data mining functionality emerges as a powerful tool to unlock the hidden potential of vast datasets. By applying advanced algorithms and techniques, data mining allows us to extract valuable knowledge, patterns, and relationships from complex data. In this blog, we will delve into the functionality of data mining, uncovering its remarkable capabilities and highlighting its significance in various domains. Extracting Hidden Patterns: Data mining enables us to unearth hidden patterns and relationships within large datasets. By employing algorithms like association rule mining, we can discover interesting associations between different variables. These patterns can provide valuable insights for businesses, helping them understand customer behavior, market trends, and make informed decisions. Predictive Analytics: One of the key functionalities of data mining is predictive analytics
Read more