feat: save webhook (/source transformation) failures to proc errors

[chandumlg]

Description

Save webhook (/source transformation) failures to proc errors.

To make this happen, I had to create two instances of proc error jobsdbs (one in read mode and one in write mode). Router and Batch router take write error jobsdb, gateway needs write error jobsdb & processor needs both read and write jobsdbs.

Multitenant scenario: This change should not create any problems in multi-tenant deployment (since proc error jobsdb behavior will be similar to gw jobsdb)

Notion Ticket

https://www.notion.so/rudderstacks/d5d15ce4be354e3caae11d4ea9f41477?v=2ad23dce1aeb431a82f783e6607d3cb0&p=334353dc6e204af188569cb5646f13d4&pm=c

Security

• The code changed/added as part of this pull request won't create any security issues with how the software is being used.

[codecov]

Codecov Report

Patch coverage: 61.26% and project coverage change: -0.34 ⚠️

Comparison is base (a8abd1d) 68.31% compared to head (5a8000d) 67.97%.

Additional details and impacted files

@@            Coverage Diff             @@
##           master    #3522      +/-   ##
==========================================
- Coverage   68.31%   67.97%   -0.34%     
==========================================
  Files         318      318              
  Lines       50284    50376      +92     
==========================================
- Hits        34353    34245     -108     
- Misses      13699    13895     +196     
- Partials     2232     2236       +4     

Impacted Files	Coverage Δ
app/apphandlers/gatewayAppHandler.go	12.62% <0.00%> (-1.67%)	⬇️
app/apphandlers/processorAppHandler.go	9.32% <0.00%> (-0.46%)	⬇️
gateway/webhook/setup.go	100.00% <ø> (ø)
gateway/webhook/webhook.go	56.11% <63.15%> (+0.37%)	⬆️
app/apphandlers/embeddedAppHandler.go	76.13% <85.00%> (+0.04%)	⬆️
gateway/gateway.go	79.82% <85.18%> (+0.13%)	⬆️
gateway/mocks/mockwebhook.go	100.00% <100.00%> (ø)
processor/manager.go	94.73% <100.00%> (+0.09%)	⬆️
processor/processor.go	87.61% <100.00%> (+<0.01%)	⬆️

... and 9 files with indirect coverage changes

☔ View full report in Codecov by Sentry.
📢 Do you have feedback about the report comment? Let us know in this issue.