An explanation of how the high-speed capabilities and """"learning"""" abilities of neural networks can be applied to solving complex optimization problems in electromagnetics. It seeks to help the reader understand the basics and strengths and limitations of each main network architecture.