What is this "Link Exchange" of which you all speak?

Is there some kind soul who is willing explain the basics of this to the new guy?
I am assuming it's some method of boosting your ranking in search engines?
What is the deal? How does it work?