Explain how mutual information may be useful for NLP. What does pointwise mutual information tell us? What is the difference between mutual information and correlation? What kind of NLP tasks can it be used for?

Explain how mutual information may be useful for NLP. What does pointwise mutual information tell us? What is the difference between mutual information and correlation? What kind of NLP tasks can it be used for?