Regularization in machine learning

What is regularization in the context of machine learning, and why do we need it?

Explain what the two most common types of regularization are, along with their differences.