Introduction
Convolutional neural network (CNN or ConvNet) is a type of neural network used in artificial intelligence that is commonly applied to analyzing images.
They can be considered a pre-processing compared to image classification algorithms. They have applications in image and video recognition, recommender systems, image classification, natural language processing, etc.
Notation
: filter size.
: padding.
: stride.
: input.
: output.
.
: filter.
: activation function.
: bias.
Layers
Convolutional
The convolution operation is the most representative. The convolutional operation is the Hadamard/Element-wise product.
We can rewrite our operation using our notation:
where is the matrix output and is a subset of the input matrix which first element is and the same size of , the filter.
Pooling
The pooling layer combines the output of neuron clusters at one single neuron, it is used to reduce the size of the image.
Pooling layer needs two hyper-parameter: stride and filter size
There are two kinds of pooling layers: and .
- Max pooling
Outputs the highest value of the cluster. - Average pooling
Outputs the average of the cluster.
ReLU
ReLU is the abbreviation of rectified linear unit. .
Consequently, it removes the negative values.
Residual
This neural network is based on the cerebral cortex. Its characteristic feature is that it jumps over some layers.
Fully connected
Fully connected layers connect every neuron in one layer to every neuron in another layer. It is in principle the same as the traditional multilayer perceptron neural network (MLP).
Multilayer Perceptron Tutorial
Wow! This blog looks exactly like my old one! It’s on a completely different topic but it has pretty much the same layout and design. Superb choice of colors!
Thank you very much, I’m glad you liked it 🙂
Çok iyi içerik teşekkür ederim
Everyone loves it when people get together and share opinions.Great site, keep it up!
Hello! I simply would like to give a huge thumbs up for the nice data you’ve here on this post. I can be coming back to your weblog for more soon.
Love your post, very interesting!!! Hope to be there where you are right now!
Hello There. I found your blog using msn. This is a really well written article. I will make sure to bookmark it and return to read more of your useful info. Thanks for the post. I will definitely comeback.
Way cool! Some extremely valid points! I appreciate you writing
this article plus the rest of the website is very good.
Aw, this was a really nice post. Taking the time and actual effort to make a great article
Hello, outstanding website! Does running a blog like this require a massive amount work? I have absolutely no understanding of programming
however, I was hoping to start my own blog in the near future.
Anyway, if you have any ideas or tips for new blog owners please share.
I know this is off topic nevertheless, I just needed to ask.
Thank you!
I wanted to thank you for this excellent read!! I absolutely loved every bit of it. I have got you bookmarked to look at new stuff you post…
I located your site from Google and I have to say it was a terrific find.
Thanks!
I need to thank you for this excellent read!! I certainly loved every little bit of it. I have you book-marked to check out new things you post…
It is actually nearly impossible to encounter well-informed parties on this content, still you come across as like you fully understand what exactly you’re posting on! Bless You
I am usually to running a blog and i actually recognize your content. The article has really peaks my interest. I am going to bookmark your site and keep checking for new information.
Amazing blog layout here. Was it hard creating a nice looking website like this?
I wish to show my gratitude for your kindness for individuals that require guidance on this one subject matter. Your very own dedication to getting the message all around appears to be really good and has in every case empowered ladies much like me to realize their objectives. Your personal invaluable help and advice indicates much to me and somewhat more to my colleagues. Thanks a lot; from all of us.