What should you do if Google has penalized your website?

Hi everyone,

There have been various situations when Google thinks your website is not following SEO guidelines and so it gives it penalty (whether in a sense of decreasing its current position on SERPs, or even blocking it entirely). What should one do if this happens to him? Let us discuss it here, shall we?

Regards,
James Ron