In 1.1 incoming handoff can be rejected if a node has too much going on. When outbound handoff occurs the 'Starting handoff' message is logged before the connection takes place. Move the logging after the connection is established.
Fixed with merge to #153
Ryan says he verified this as fixed on Adium, honest.