Add an assert to catch bg invited count underflowing.

Add an assert to catch bg invited count underflowing. #1119