feat(telemetry): Add tracking for dry_run, notifications, reuse

[zhaoqizqwang]

feat(telemetry): Add tracking for dry_run, notifications, reuse

[mujtaba1747]

Do we have approval to collect this in telemetry?

[zhaoqizqwang]

Yes we are reusing the decorator _telemetry_emitter. It has been used in other places

[mujtaba1747]

Few more spots where we can add telemetry:
evaluators dry run
stream logs / show metrics for evaluators (not sure if we implemented this for Evaluators)
model reuse for bedrock modelbuilder
Ideally if the model reuse telemetry can also show if model is_nova or not, that would be great, but it's a nice to have.

[mujtaba1747]

how does this work? What if bedrock model builder doesn't call _is_nova_model_for_telemetry() and calls _is_nova_model instead?

[zhaoqizqwang]

so every time BedrockModelBuilder.deploy() is called, the decorator runs _is_nova_model_for_telemetry before the actual deploy() body executes. The actual method called inside deploy doesn't matter

[mujtaba1747]

Thanks for explaining.