Same issue here.
The problem could be caused by the fact that only click event is handled in bootstrap-alert.js. That should also accomodate the touch event.
On the other hand the click event is supposed to be triggered anyway (just with a slight ~300ms delay).
As it stands now, we do not support Android 2.3.3. If you can diagnose the problem and submit a fix, we'll take a look, but otherwise we're only supporting the latest versions of mobile browsers at this time. Just a matter of bandwidth between @fat and I.