Convolutional Neural Network (CNN)

Convolutional neural network introduction and tutorial

Introduction

Convolutional neural network (CNN or ConvNet) is a type of neural network used in artificial intelligence that is commonly applied to analyzing images.

They can be considered a pre-processing compared to image classification algorithms. They have applications in image and video recognition, recommender systems, image classification, natural language processing, etc.

Notation

$f^l$ : filter size.
$p^l$ : padding.
$s^l$ : stride.
$n^{l-1}_H \times n^{l-1}_W \times n^{l-1}_C$ : input.
$n^{l}_H \times n^{l}_W \times n^{l}_C$ : output.
$n^l = \floor{\frac{n^{l-1}+2p^l-f^l}{s^l}+1}$ .
$f^l \times f^l \times n_c^l$ : filter.
$a^l$ : activation function.
$n_c^l$ : bias.

Layers

Convolutional

The convolution operation is the most representative. The convolutional operation is the Hadamard/Element-wise product.

$A^{'}=A\circ B$

We can rewrite our operation using our notation:

$A_{i j}^l=\sum_{i=1}^{f^l}{\sum_{j=1}^{f^l}{{A_{i j}^{l-1}B_{i j}^l}}}$

where $B$ is the matrix output and $A$ is a subset of the input matrix which first element is $i j$ and the same size of $B$ , the filter.

Pooling

The pooling layer combines the output of neuron clusters at one single neuron, it is used to reduce the size of the image.
Pooling layer needs two hyper-parameter: stride and filter size
There are two kinds of pooling layers: $\textit{max pooling}$ and $\textit{average pooling}$ .

Max pooling
Outputs the highest value of the cluster.
Average pooling
Outputs the average of the cluster.

ReLU

ReLU is the abbreviation of rectified linear unit. $f(x)=max(0,x)$ .
Consequently, it removes the negative values.

Residual

This neural network is based on the cerebral cortex. Its characteristic feature is that it jumps over some layers.

Fully connected

Fully connected layers connect every neuron in one layer to every neuron in another layer. It is in principle the same as the traditional multilayer perceptron neural network (MLP).

Multilayer Perceptron Tutorial

Link

Convolutional Neural Network paper

18 thoughts on “Convolutional Neural Network (CNN)”

folorentorium says:
February 11, 2019 at 6:31 am
Wow! This blog looks exactly like my old one! It’s on a completely different topic but it has pretty much the same layout and design. Superb choice of colors!
Reply
1. dprogrammer says:
  February 11, 2019 at 8:43 pm
  Thank you very much, I’m glad you liked it 🙂
  Reply
defter says:
February 14, 2019 at 2:17 pm
Çok iyi içerik teşekkür ederim
Reply
Wyatt Lipper says:
February 28, 2019 at 7:13 am
Everyone loves it when people get together and share opinions.Great site, keep it up!
Reply
cnn video troubleshooting says:
March 8, 2019 at 1:25 am
Hello! I simply would like to give a huge thumbs up for the nice data you’ve here on this post. I can be coming back to your weblog for more soon.
Reply
hilfe121 says:
March 8, 2019 at 1:56 am
Love your post, very interesting!!! Hope to be there where you are right now!
Reply
MCnew says:
March 9, 2019 at 5:33 am
Hello There. I found your blog using msn. This is a really well written article. I will make sure to bookmark it and return to read more of your useful info. Thanks for the post. I will definitely comeback.
Reply
vidaconklin says:
March 24, 2019 at 6:27 pm
Way cool! Some extremely valid points! I appreciate you writing
this article plus the rest of the website is very good.
Reply
jim_champlin says:
March 26, 2019 at 7:22 pm
Aw, this was a really nice post. Taking the time and actual effort to make a great article
Reply
hudsonsoutter says:
March 28, 2019 at 7:03 pm
Hello, outstanding website! Does running a blog like this require a massive amount work? I have absolutely no understanding of programming
however, I was hoping to start my own blog in the near future.
Anyway, if you have any ideas or tips for new blog owners please share.
I know this is off topic nevertheless, I just needed to ask.
Thank you!
Reply
DMC5 says:
March 31, 2019 at 9:44 am
I wanted to thank you for this excellent read!! I absolutely loved every bit of it. I have got you bookmarked to look at new stuff you post…
Reply
Damaris says:
April 1, 2019 at 2:18 pm
I located your site from Google and I have to say it was a terrific find.
Thanks!
Reply
Opsahl says:
April 6, 2019 at 9:22 am
I need to thank you for this excellent read!! I certainly loved every little bit of it. I have you book-marked to check out new things you post…
Reply
Pingback: CPU vs GPU | Neural Network
Lidey38680 says:
July 13, 2019 at 3:07 am
It is actually nearly impossible to encounter well-informed parties on this content, still you come across as like you fully understand what exactly you’re posting on! Bless You
Reply
5404Boyles says:
July 16, 2019 at 4:10 am
I am usually to running a blog and i actually recognize your content. The article has really peaks my interest. I am going to bookmark your site and keep checking for new information.
Reply
Helferty says:
July 20, 2019 at 8:38 am
Amazing blog layout here. Was it hard creating a nice looking website like this?
Reply
83857Pianalto says:
July 23, 2019 at 10:00 am
I wish to show my gratitude for your kindness for individuals that require guidance on this one subject matter. Your very own dedication to getting the message all around appears to be really good and has in every case empowered ladies much like me to realize their objectives. Your personal invaluable help and advice indicates much to me and somewhat more to my colleagues. Thanks a lot; from all of us.
Reply