Check if there's any invite that has been pending for awhile.

Social > Friends Tab (3rd Tab) > Invites > Sent 

From there, you can see the Invite that has been sent and cancel any Invite that has been pending.