The invite messages wont go away

Even after I click the "x", the invite messages don't go away. Can someone help with that?

when the cursor changes from the point to the little hand is where you need to press to make the invite box go away.

thanks Sergeant Major 1771!