MLAlgos (Machine Learning Algorithms) – Describing and picturising machine learning algorithms is the main idea of this post. We will attempt to answer a few basic questions as well. Though these questions have been answered many a time in the past and are widely available on an open internet. Answering them again here from my very own experience on the ground may make the difference compared to simply answering them from PhD scholar books material perspective.

 

Points Covered in this Post:

This post is limited to below index items. The coverage of the points is from a layman perspective at a high level in simple English. Anyone looking for detailed explanations or codes should get in touch with me. This post is divided into 3 parts as below:

  • Machine Learning at a Glance
  • Types of Machine Learning
  • Algorithms in Machine Learning – MLAlgos

From the policy standpoint, we never share any code unless it’s an open source code or link to the published work. Some of you might wonder why we need to know all of them or what exactly is the meaning of each term. We have gathered all the information at one place i.e. in this blog post.

Supervised vs Unsupervised Learning

 

Machine Learning at a Glance

Types of Machine Learning

Before we get into MLAlgos lets understand some basics here. The approach of developing ML includes learning from data inputs based on “What has happened”. Evaluating and optimising different model results remains focus here. As on date Machine Learning is widely used in data analytics as a method to develop algorithms for making predictions on data. It is related to probability, statistics, and linear algebra.

Machine Learning – Introduction to Its Algorithms – MLAlgos

Machine Learning is classified into four categories at a high level depending on the nature of the learning and learning system. Semi-supervised learning is actually very interesting of them all:

  1. Supervised learning: Supervised learning gets labelled inputs and their desired outputs. The goal is to learn a general rule to map inputs to the output.MLAlgos
  2. Unsupervised learning: Machine gets inputs without desired outputs, the goal is to find structure in inputs. 
  3. Reinforcement learning: In this algorithm interacts with a dynamic environment, and it must perform a certain goal without a guide or teacher.
  4. Semi-supervised Learning: This type of ml i.e. semi-supervised algorithms are the best candidates for the model building in the absence of labels for some data. So if data is a mix of label and un-label then this can be the answer. Typically a small amount of labelled data with a large amount of unlabeled data is used here.

ML also has a very close relationship to statistics; which can be called as a graphical branch (From data representation point of view) of mathematics. It instructs an algorithm to learn for itself by analyzing data. The more data it processes, the smarter the algorithm gets.

 

Some of the popular Machine Learning Algorithms (MLAlgos)

  • Linear Regression – Simple Linear Regression- there is only an independent variable. Multiple Linear Regression- refers to defining a relationship between independent and dependent variables
  •  Logistic Regression – A super simple form of regression analysis in which the outcome variable is binary or dichotomous. Helps to estimate adjusted prevalence rates, adjusted for potential confounders (sociodemographic or clinical characteristics)
  • Linear Discriminant Analysis –  A generalization of Fisher’s linear discriminant, a method used in statistics, pattern recognition and machine learning to find a linear combination of features that characterizes or separates two or more classes of objects or events.

Data Set and Learning Techniques - #AILabPage

  • Classification and Regression Trees-  Decision trees are are an important type of algorithm for predictive modelling machine learning. A greedy algorithm based on divide and conquer rule. Split the records based on an attribute test that optimizes certain criterion. The real value is in determining how to split the records.
  • Naive Bayes – Naive Bayes classifiers are a family of simple probabilistic classifiers based on applying Bayes’ theorem with strong (naive) independence assumptions between the features.
  •  K-Nearest Neighbors – The laziest algorithm which is also a very simple algorithm that stores all available cases and predict the numerical target based on a similarity measure. In the beginning of 1970s as a non-parametric technique, KNN has been used in statistical estimation and pattern recognition already.
  • Learning Vector Quantization-  It has aim i.e. representation of large amounts of data by (few) prototype vectors by identification and grouping in clusters of similar data.
  • Support Vector Machines- A Support Vector Machine (SVM) is a supervised machine learning algorithm. This can be employed for both classification and regression purposes. SVMs are more commonly used in classification problems and as such.
  • Bagging and Random Forest- Bagging, in general, is an acronym like work that is a portmanteau of Bootstrap and aggregation. In general by taking a bunch of bootstrapped samples of from original dataset; fit models will be mainly be all bb model predictions this is bootstrap aggregation i.e. Bagging.
    • The fundamental difference between bagging and the random forest is that in Random forests, only a subset of features are selected at random out of the total and the best split feature from the subset is used to split each node in a tree, unlike in bagging where all features are considered for splitting a node.” Does that mean that bagging is the same as random forest if only one explanatory variable (predictor) is used as input?
  • Boosting and AdaBoost-  Boosting is a machine learning ensemble meta-algorithm for primarily reducing bias, and also variance in supervised learning, and a family of machine learning algorithms which convert weak learners to strong ones. Algorithms that achieve hypothesis boosting quickly became simply known as “boosting”.
  • Qlearning  – It’s a model-free reinforcement learning technique. It is able to compare the expected utility of the available actions (for a given state) without requiring a model of the environment.

Machine Learning Algorithms - Infographics. #AILabPage

 

Learning Process Machine & Human

The learning process for a human child or new machine algorithm is the same regardless of the fact that something is made up of bones and flash or wires and metal. The basic learning process is similar. It can be divided into four interrelated components:

  • Data storage
  • Information abstraction from stored data
  • Generalization of information abstracted from the data.
  • Evaluation of each piece of information and making use of the same.

Useful Machine Learning Algorithms - Infographics. #AILabPage

I will talk about each type of machine learning and respective algorithms in a detailed manner in my upcoming “Machine Learning Series” post from next week.
AA

Points to Note:

All credits if any remains on the original contributor only. We have covered a few machine learning algorithms at a high level in this post. Our last posts on Supervised Machine Learning and Unsupervised Machine Learning got some decent feedback. Our next post will talk about Reinforcement Learning — Markov Decision Processes

 

Books & Other Material Referred

 

Feedback & Further Question

Do you have any questions about Deep Learning or Machine Learning? Leave a comment or ask your question via email. Will try my best to answer it.

 

AA

MLAlgosConclusion – Point to note here is that AI is much more than ML. I particularly think that getting to know the types of MLAlgos actually helps to see a somewhat clear picture of AI. The answer to the question “What machine learning algorithm should I use?” is always “It depends.” It depends on the size, quality, and nature of the data. It depends on what you want to do with the answer.

It depends on how the math of the algorithm was translated into instructions for the computer you are using. And it depends on how much time you have. Only recently machine learning got spotlight and attention from the industry. Machine learning use cases like face recognition, image captioning, voice & text processing and self-driving cars now everyone talks about.

 

#MachineLearning #DeepLearning #ArtificialIntelligence #ArtificialNeuralNetworks

======================== About the Author ===================

Read about Author at : About Me

Thank you all, for spending your time reading this post. Please share your feedback / comments / critics / agreements or disagreement. Remark for more details about posts, subjects and relevance please read the disclaimer.

FacebookPage                 ContactMe                   Twitter         =============================================================

Posted by V Sharma

Technology specialist in Financial Technology(FinTech), Photography, Artificial Intelligence. Mobile Financial Services (Cross Border Remittances, Mobile Money, Mobile Banking, Mobile Payments), Data Science, IT Service Management, Machine Learning, Neural Networks and Deep Learning techniques. Mobile Data and Billing & Prepaid Charging Services (IN, OCS & CVBS) with over 15 years experience. Led start ups & new business units successfully at local and international levels with Hands-on Engineering & Business Strategy.

29 Comments

  1. […] will not define algorithms mentioned in above picture, These were defined in our previous post . Also in my upcoming  posts we will try to take each one of them in a very detailed manner […]

    Like

    Reply

  2. […] Unsupervised Learning available data have no target attribute. Machine Learning Algorithm takes training examples as the set of attributes/features alone. The purpose of unsupervised […]

    Like

    Reply

  3. […] created in the last two years. Will GDPR also going to impact historical data. Does GDPR require Machine Learning algorithms to explain their output? may be yes may be no or in short probably not, but there is […]

    Like

    Reply

  4. […] Demystified” for understanding DeepLearning only also you can find previous posts on Machine Learning – The Helicopter view, Supervised Machine Learning, Unsupervised Machine Learning and Reinforcement […]

    Like

    Reply

  5. John Kirkilis May 21, 2018 at 14:58

    In the third graphic, the light-blue rounded rect titled “Bagging and Random Forest” ends with “Random Forest has two parameters:” and then doesn’t list them.

    Like

    Reply

    1. Noted, will update the graphics, thank you very much for highlighting the missing part.

      Like

  6. […] credits if any remains on the original contributor only. You can find our posts on Basic Machine Learning Understanding, Supervised Machine Learning, Unsupervised Machine Learning and Reinforcement […]

    Like

    Reply

  7. […] RL has been around for many years as the third pillar for Machine Learning and now becoming increasingly important for Data Scientist to know when and how to implement. RL […]

    Like

    Reply

  8. […] have now summarised our last four posts here to give quick glimpse. You can find previous posts on Machine Learning – The Helicopter view, Supervised Machine Learning, Unsupervised Machine Learning and Reinforcement […]

    Like

    Reply

  9. […] are best suited for each approach is another task. Types of machine learning algorithms i.e. MLAlgos and which one to be used when is extremely important to […]

    Like

    Reply

  10. […] experiences and solve real-world problems. CNNs are also known as application of neuroscience to machine learning. It employe mathematical operations known as “Convolution”; which is a specialized kind […]

    Like

    Reply

  11. […] in Machine Learning (ML) borrows principles from computer science. There are many algorithms as no one algorithm works […]

    Like

    Reply

    1. Good One

      Like

  12. […] is no error or reward signal to check a potential solution. Since no labels are given to the learning algorithm, leaving it on its own to find structure in its input. This distinguishes unsupervised learning […]

    Like

    Reply

  13. […] ML and DL – Demystified” for understanding Deep Learning only. You can find earlier posts on Machine Learning – The Helicopter view, Supervised Machine Learning, Unsupervised Machine Learning and Reinforcement […]

    Like

    Reply

  14. […] other words Machine learning algorithms “learns” from the observations. When exposed to more observations, the algorithm improves its […]

    Like

    Reply

  15. […] Learning (RL) is around for many years as the third pillar for Machine Learning. It is now becoming increasingly important for Data Scientist to know when and how to implement. RL […]

    Like

    Reply

  16. That’s a quite comprehensive post on Machine Learning and AI along with supporting infographics. Good and informative for the ones wishing to add on their knowledge on ML Algos and AI.
    What machine learning algorithm should we use? This depends on the size, quality and nature of the data. So, true!

    Like

    Reply

  17. […] of the jargon used here includes Machine Learning, Neural Networks, Deep Learning and Data […]

    Like

    Reply

  18. […] you have any questions about AI, Data Science, Quantum Computing, Deep Learning or Machine Learning? for finTech or information security. Leave a comment or ask your question via email. Will try my […]

    Like

    Reply

  19. […] ML and DL – Demystified” for understanding Deep Learning only. You can find earlier posts on Machine Learning – The Helicopter view, Supervised Machine Learning, Unsupervised Machine Learning and Reinforcement […]

    Like

    Reply

  20. […] in Machine Learning (ML) borrows principles from computer science. There are many algorithms for same purpose because […]

    Like

    Reply

  21. […] Unsupervised Learning available data have no target attribute. Machine Learning Algorithm takes training examples as the set of attributes/features alone. The purpose of unsupervised […]

    Like

    Reply

  22. […] other words Machine learning algorithms “learns” from the observations. When exposed to more observations, the algorithm improves its […]

    Like

    Reply

  23. […] but availability of quality data basis which technique is chosen is far more important. Types of machine learning algorithms and which one to be used when is extremely important to […]

    Like

    Reply

  24. […] Machine Learning – Introduction to Its Algorithms […]

    Like

    Reply

Leave a Reply

Fill in your details below or click an icon to log in:

WordPress.com Logo

You are commenting using your WordPress.com account. Log Out /  Change )

Twitter picture

You are commenting using your Twitter account. Log Out /  Change )

Facebook photo

You are commenting using your Facebook account. Log Out /  Change )

Connecting to %s