fix: fix growing index data race and properly handle build error

[zhengbuqian]

issue: #31169

also properly handling index build error by re-create a new index so that nothing will be left in the previous failed index build attempt.

[zhengbuqian]

/hold

[foxspy]

/lgtm

[mergify]

@zhengbuqian ut workflow job failed, comment rerun ut can trigger the job again.

[zhengbuqian]

/unhold

#30629 has been merged and I have rebased this PR onto master, this PR now contains only 1 commit and is ready to merge.

[codecov]

Codecov Report

Attention: Patch coverage is 85.18519% with 4 lines in your changes are missing coverage. Please review.

Project coverage is 81.03%. Comparing base (1d96239) to head (e52d2ee).
Report is 10 commits behind head on master.

Additional details and impacted files

@@            Coverage Diff             @@
##           master   #31170      +/-   ##
==========================================
+ Coverage   80.97%   81.03%   +0.05%     
==========================================
  Files         975      965      -10     
  Lines      142177   142423     +246     
==========================================
+ Hits       115130   115408     +278     
+ Misses      23185    23162      -23     
+ Partials     3862     3853       -9     

Files	Coverage Δ
internal/core/src/segcore/FieldIndexing.h	68.37% <ø> (+1.70%)	⬆️
internal/core/src/segcore/FieldIndexing.cpp	67.48% <83.33%> (-0.34%)	⬇️
internal/core/src/segcore/SegmentGrowingImpl.cpp	73.80% <85.71%> (-0.19%)	⬇️

... and 221 files with indirect coverage changes

[foxspy]

/lgtm

[congqixia]

/approve

[sre-ci-robot]

[APPROVALNOTIFIER] This PR is APPROVED

This pull-request has been approved by: congqixia, foxspy, zhengbuqian

The full list of commands accepted by this bot can be found here.

The pull request process is described here

Needs approval from an approver in each of these files:

• internal/core/OWNERS [congqixia]

Approvers can indicate their approval by writing /approve in a comment
Approvers can cancel approval by writing /approve cancel in a comment