[feature] Proposal to change recursive call in processHelper to iterative solution

[neilnaveen]

Is your feature request related to a problem? Please describe.
The processHelper function currently employs tail recursion to avoid stack overflow, which is beneficial for stack safety. However, the current design has noticeable performance drawbacks when handling deeply nested structures, taking multiple seconds to process the example case.

Describe the solution you'd like
I suggest refactoring the processHelper function to use an iterative approach rather than a recursive one. This could potentially speed up the function's runtime performance, making it more efficient for handling deeply nested loops.

Additional context
Here is a Go code snippet to replicate the issue. When run, this test case takes multiple seconds to complete, signifying a need for optimization.

sd := SimpleDoc{  
   Issuer: "google.com",  
   Info:   "this is a cool document",  
   Nested: []SimpleDoc{},  
}  
cur := sd  
for i := 0; i < 4000; i++ {  
   k := SimpleDoc{Issuer: "google.com", Info: fmt.Sprintf("this is a cooler nested doc %d", i), Nested: []SimpleDoc{cur}}  
   cur = k  
}  
// marshal cur to json  
blob, _ := json.Marshal(cur)  
  
// create a document  
overflowDoc := processor.Document{  
   Blob:   blob,  
   Type:   simpledoc.SimpleDocType,  
   Format: processor.FormatJSON,  
}

[lumjjb]

Thanks for opening the issue! @neilnaveen is this something you'd like to work on - or should i label it as help wanted!

[neilnaveen]

I will work on this. Thanks

[pxp928]

completed with: #1245