Skip to content

Commit 31d1e2d

Browse files
new version test
1 parent a449bd3 commit 31d1e2d

32 files changed

+188
-17
lines changed

_config.yml

Lines changed: 17 additions & 17 deletions
Original file line numberDiff line numberDiff line change
@@ -7,33 +7,33 @@
77

88
# jekyll-seo-tag settings › https://github.com/jekyll/jekyll-seo-tag/blob/master/docs/usage.md
99
# --------------------------
10-
title: Chirpy # the main title
10+
title: Learning Algorithms # the main title
1111

12-
tagline: A text-focused Jekyll theme # it will display as the sub-title
12+
tagline: A blog about Maths and ML # it will display as the sub-title
1313

1414
description: >- # used by seo meta and the atom feed
15-
A minimal, portfolio, sidebar,
16-
bootstrap Jekyll theme with responsive web design
17-
and focuses on text presentation.
15+
A new blog about how mathematics
16+
are the base of Machine Learning
17+
and introductory examples of ML.
1818
1919
# fill in the protocol & hostname for your site, e.g., 'https://username.github.io'
20-
url: ''
20+
url: 'https://learningalgorithms.github.io'
2121

22-
author: your_full_name # change to your full name
22+
author: Carlos Marco # change to your full name
2323

2424
github:
25-
username: github_username # change to your github username
25+
username: LearningAlgorithms # change to your github username
2626

2727
twitter:
28-
username: twitter_username # change to your twitter username
28+
username: JC_MarcoG # change to your twitter username
2929

3030
social:
31-
name: your_full_name # it will shows as the copyright owner in Footer
32-
email: example@doamin.com # change to your email address
31+
name: Juan Carlos Marco # it will shows as the copyright owner in Footer
32+
email: thelearningalgorithms@gmail.com # change to your email address
3333
links:
3434
# The first element serves as the copyright owner's link
35-
- https://twitter.com/username # change to your twitter homepage
36-
- https://github.com/username # change to your github homepage
35+
- https://twitter.com/JC_MarcoG # change to your twitter homepage
36+
- https://github.com/learningalgorithms # change to your github homepage
3737
# Uncomment below to add more social links
3838
# - https://www.facebook.com/username
3939
# - https://www.linkedin.com/in/username
@@ -47,7 +47,7 @@ google_site_verification: google_meta_tag_verification # change to your verifica
4747
baseurl: ''
4848

4949
# Change to your timezone › http://www.timezoneconverter.com/cgi-bin/findzone/findzone
50-
timezone: Asia/Shanghai
50+
timezone: Europe/Madrid
5151

5252
google_analytics:
5353
id: '' # Fill with your Google Analytics ID
@@ -61,8 +61,8 @@ google_analytics:
6161
cache: false # pv data local cache, good for the users from GFW area.
6262

6363
disqus:
64-
comments: false # boolean type, the global switch for posts comments.
65-
shortname: '' # Fill with your Disqus shortname. › https://help.disqus.com/en/articles/1717111-what-s-a-shortname
64+
comments: true # boolean type, the global switch for posts comments.
65+
shortname: 'learningalgorithms' # Fill with your Disqus shortname. › https://help.disqus.com/en/articles/1717111-what-s-a-shortname
6666

6767

6868
# Prefer color scheme setting.
@@ -77,7 +77,7 @@ disqus:
7777
#
7878
# dark - Use the dark color scheme
7979
#
80-
theme_mode: # [light|dark]
80+
theme_mode: dark # [light|dark]
8181

8282
# The CDN endpoint for images.
8383
# Notice that once it is assigned, the CDN url

_posts/2020-11-02-Index.md

Lines changed: 14 additions & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -0,0 +1,14 @@
1+
---
2+
title: Index
3+
date: 2020-11-04 12:42:00 +0100
4+
categories: []
5+
tags: [] # TAG names should always be lowercase
6+
pin: true
7+
---
8+
9+
The purpose of this post is to serve as an **Index**.
10+
11+
# Machine Learning
12+
1. [Brief introduction]({%post_url _posts/machine-learning/2020-11-05-introduction%})
13+
14+
# Mathematics
Lines changed: 102 additions & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -0,0 +1,102 @@
1+
---
2+
title: Brief introduction
3+
date: 2020-11-05 12:42:00 +0100
4+
categories: [Machine Learning,General]
5+
tags: [introduction] # TAG names should always be lowercase
6+
image: /assets/img/img_posts/machine-learning/introduction/subsets_AI.png
7+
comments: true
8+
---
9+
10+
## What is Artificial Intelligence?
11+
12+
We can define **Artificial intelligence** (AI) as intelligence demonstrated by machines, contrasting with **natural intelligence** displayed by humans and animals, being intelligence described in a general form as the ability to discern information and use it to create knowledge that latter can be applied in similar situations. In this case, research in AI has been focused on learning, problem-solving, reasoning, perception, and use of language.
13+
14+
Talking about more concrete tasks, since the 1940s computers have been able to perform a complex task such as playing chess or proving mathematical theorems, problems that when solved by a machine have lost the property of being problems only solvables using intelligence, and therefore a task that doesn't need AI, the [AI effect](https://en.wikipedia.org/wiki/AI_effect).
15+
16+
This era of research in AI began in 1935 when the mathematician [Alan Turing](https://en.wikipedia.org/wiki/Alan_Turing) proposed his general-purpose computer, the [Turing Machine](https://en.wikipedia.org/wiki/Turing_machine). In a [public lecture](https://www.vordenker.de/downloads/turing-vorlesung.pdf) in 1947 Turing said:
17+
18+
>What we want is a machine that can learn from experience. The possibility of letting the machine alter its own instructions provides the mechanism for this.
19+
>
20+
> -- <cite>[Alan Mathison Turing](https://en.wikipedia.org/wiki/Alan_Turing)</cite>
21+
22+
We could call this an early definition of **Machine Learning**. In a non-published paper in 1948 Turing also introduced an [idea](http://www.alanturing.net/turing_archive/pages/Reference%20Articles/connectionism/Turing's%20neural%20networks.html) to train a neural network of artificial neurons to perform a specific task, like in **Deep Learning**.
23+
24+
## What is Machine Learning?
25+
26+
The computer science discipline of **Machine Learning** (ML) is a subfield of **Artificial Intelligence**. ML objective is to construct algorithms that using a collection of examples of some phenomenon can improve their performance by itself.
27+
28+
Let's see some examples of how experts have defined ML as:
29+
30+
> Field of study that gives computers the ability to learn without being explicitly programmed.
31+
>
32+
> -- <cite>[Arthur L. Samuel](https://en.wikipedia.org/wiki/Arthur_Samuel)</cite>
33+
34+
Arthur Samuel popularized the term _Machine Learning_ in 1959, and his Checkers-playing program was one of the first successful self-learning algorithms.
35+
36+
> A computer program is said to learn from experience E with respect to some class of tasks T and performance measure P, if its performance at tasks in T, as measured by P, improves with experience E.
37+
>
38+
> -- <cite>[Tom M. Mitchell](https://en.wikipedia.org/wiki/Tom_M._Mitchell)</cite>
39+
40+
Tom Mitchell is a former Chair of the Machine Learning Department at CMU. Mitchell is known for his contributions to the advancement of machine learning, artificial intelligence, and cognitive neuroscience.
41+
42+
In summary, Machine Learning algorithms learn by experience, in a similar way that natural organisms do.
43+
44+
## What is Deep Learning?
45+
46+
**Deep Learning** is a subfield of ML, and its methods are based on [artificial neural networks](https://en.wikipedia.org/wiki/Artificial_neural_network), which are algorithms inspired by the structure and function of the neurons, trying to simulate a brain. The term Deep Learning was introduced to the ML community by [Rita Dechter](https://en.wikipedia.org/wiki/Rina_Dechter) in 1986.
47+
48+
> Deep Learning is constructing networks of parameterized functional modules & training them from examples using gradient-based optimization.
49+
>
50+
> -- <cite>[Yann LeCun](https://en.wikipedia.org/wiki/Yann_LeCun)</cite>
51+
52+
In the last decade algorithms based on Deep Learning have produced results comparable to, and in some cases surpassing, human expert performance. Fields as diverse as:
53+
54+
- Computer vision:
55+
- [Posenet: Pose detection](https://github.com/tensorflow/tfjs-models/tree/master/posenet)
56+
- [YOLO: Real-Time Object Detection](https://pjreddie.com/darknet/yolo/)
57+
- [3D Model From 2D Images](https://ai.facebook.com/blog/powered-by-ai-turning-any-2d-photo-into-3d-using-convolutional-neural-nets/)
58+
- [Computer Vision in Healthcare Applications](https://www.ncbi.nlm.nih.gov/pmc/articles/PMC5857319/)
59+
- [Self-driving cars](https://www.tesla.com/autopilot)
60+
61+
- Speech recognition:
62+
- [Google’s Google Assistant](https://assistant.google.com/intl/es_es/)
63+
- [Speech recognition in healthcare](https://codeit.us/blog/speech-recognition-in-healthcare)
64+
- [Speech recognition with Amazon's Alexa and the internet of things](https://docs.aws.amazon.com/es_es/iot/latest/developerguide/avs-integration-aws-iot.html)
65+
66+
- Natural language processing:
67+
- [Spam detector in emails](https://www.spamtitan.com/spam-email-filter/)
68+
- [Search results with Google](https://blog.google/products/search/search-language-understanding-bert/)
69+
- [DeepL Language translator](https://www.deepl.com/home)
70+
- [GPT-3 Text generation](https://openai.com/blog/openai-api/)
71+
72+
- Games:
73+
- [AlphaZero in Go, Chess, and Shogi](https://en.wikipedia.org/wiki/AlphaZero)
74+
- [AlphaStar in StarCraft II](https://deepmind.com/blog/article/AlphaStar-Grandmaster-level-in-StarCraft-II-using-multi-agent-reinforcement-learning)
75+
76+
There are many examples of successful use of DL in today's world, and these models will only get better with more [data](https://www.forbes.com/sites/bernardmarr/2018/05/21/how-much-data-do-we-create-every-day-the-mind-blowing-stats-everyone-should-read/?sh=2440c20060ba).
77+
78+
## How is performed the "Learning"?
79+
80+
We can classify the type of learning used by the algorithm into four categories.
81+
82+
### Supervised Learning
83+
84+
In **supervised learning**, the dataset, the examples of the problem that we already have, are labeled and with them, our algorithms are going to infer a function, a **model** that would take inputs of the form of our examples and deduce an output. For example, a supervised learning algorithm could take as an input the square meters of a house and generate an output of how much it should cost.
85+
86+
### Unsupervised Learning
87+
88+
In **unsupervised learning**, our algorithm is going to try to find undetected patterns in the dataset, a dataset that doesn't contain any label.
89+
90+
### Semi-supervised Learning
91+
92+
**Semi-supervised** algorithms in machine-learning combine usually a small number of labeled examples and a much bigger quantity of unlabeled, the algorithm is going to use those unlabeled examples to produce a better model by being less biased.
93+
94+
95+
### Reinforcement Learning
96+
97+
In **reinforced learning**, our algorithm performs inside an environment in which is capable of perceiving its state and take actions, in consequence, those actions are going to report a benefit or a detriment, and this agent has to *learn* how to maximize its reward.
98+
99+
And now, a little joke from [XKCD](https://xkcd.com/1838/)
100+
101+
![XKCD Machine Learning](/assets/img/img_posts/machine-learning/introduction/xkcd-machine-learning.png)
102+
*XKCD Machine Learning*
Lines changed: 55 additions & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -0,0 +1,55 @@
1+
---
2+
title: Basic Linear Algebra
3+
date: 2020-11-16 12:42:00 +0100
4+
categories: [Mathematics,Linear Algebra]
5+
tags: [algebra] # TAG names should always be lowercase
6+
comments: true
7+
math: true
8+
---
9+
10+
> You cannot know too much Linear Algebra
11+
>
12+
> -- <cite>[Benedict Hyman Gross](https://boffosocko.com/2012/05/05/you-cannot-learn-too-much-linear-algebra/)</cite>
13+
14+
Prepostscript (PPS): This post will be updated when more knowledge of linear algebra to understand other posts is needed.
15+
16+
## Introduction:
17+
18+
You may have noticed that **Linear Algebra** is a term composed by _Linear_ + _Algebra_. So let's start by defining what is each of the two terms. An _algebra_ it's the union of a **set of objects** and a **set of rules** that applies to that objects. Etymologically the word _Algebra_ comes from the title of the book [_Ilm al-jabr wa l-muqābala_](https://en.wikipedia.org/wiki/The_Compendious_Book_on_Calculation_by_Completion_and_Balancing), '_The Compendious Book on Calculation by Completion and Balancing_', by the Persian mathematician [al-Khwarizmi](https://en.wikipedia.org/wiki/Muhammad_ibn_Musa_al-Khwarizmi), also, the word _Algorithm_ derivates from his name, so you can imagine that he was an influential mathematician. The word _Linear_ refers to that what we are traying to solve using those set of objects and rules are **Linear systems**. Systems of equations where those equations are of first order, the maximum degree of the variables is equal to one, so in $$\mathbb R^2$$ (in the plane) we have straight lines, in $$ \mathbb R ^3$$​ (in a space) we have a plane.
19+
20+
Those objects in our case, in ML, will be **vectors**, elements of $$\mathbb R ^n$$ (tuples of $$n$$ real numbers). For example, $$v$$ can be a vector of $$\mathbb R ^2$$ ($$ v \in \mathbb R ^2$$) with coordinates $$v_1 = 42$$ and $$v_2 = 73$$:
21+
22+
$$ v = \begin{bmatrix} 42 \cr 73 \end{bmatrix}\in \mathbb R ^2 $$
23+
24+
We can represent a vector of $$w \in \mathbb R^n$$:
25+
26+
$$ w = \begin{bmatrix} w_1 \cr w_2 \cr . \cr . \cr . \cr w_n \end{bmatrix}\in \mathbb R ^n $$
27+
28+
And the **rules** or _axioms_ that apply to those vectors are the following:
29+
30+
Being $$u, v, w$$ vectors, and $$a, b, 0$$ and $$1$$ _scalars_ (elements of $$\mathbb R$$), then:
31+
32+
- (A1) $$ u + (v + w) = (u + v) + w$$
33+
- (A2) $$u + v = v + u$$
34+
- (A3) Exists a vector, called the zero vector, such that $$v +0 = v$$
35+
- (A4) For every vector $$v$$ exists a vector $$-v$$ called the inverse
36+
- (A5) $$a(u+v) = au + av$$
37+
- (A6) $$(a + b) v = av + bv$$
38+
- (A7) $$ a(bv) = (ab)v$$
39+
- (A8) Exist a scalar called the identity, and denoted as $$1$$, such as $$1*v = v$$
40+
41+
Mathematically those rules are important, since they are defining how vectors interact with themselves and with scalars.
42+
43+
Now, specifically, we can define those operations on vectors of $$\mathbb R^n$$ . For example, if $$u, v \in \mathbb R^2$$ and $$a \in \mathbb R$$, then:
44+
45+
$$ u + v = \begin{bmatrix} u_1 \cr u_2 \end{bmatrix} + \begin{bmatrix} v_1 \cr v_2 \end{bmatrix} = \begin{bmatrix} u_1 + v_1 \cr u_2+ v_2 \end{bmatrix} $$
46+
47+
$$ a * u = a * \begin{bmatrix} u_1 \cr u_2 \end{bmatrix} = \begin{bmatrix} a * u_1 \cr a * u_2 \end{bmatrix}$$
48+
49+
50+
51+
**References**:
52+
53+
- [Mathematics for machine learning](https://mml-book.github.io/) by Marc Peter Deisenroth, Aldo Faisal, and Cheng Soon Ong
54+
- 3blue1brown's Linear Algebra [Videos](https://www.youtube.com/playlist?list=PLZHQObOWTQDPD3MizzM2xVFitgF8hE_ab)
55+
-11.9 KB
Loading
-17.2 KB
Loading
-1.43 KB
Loading
-2.23 KB
Loading
-4.05 KB
Loading
-6.48 KB
Loading

0 commit comments

Comments
 (0)