fix: clean up inference tasks after completion#4841

davidzhao merged 1 commit intomainlivekit/agents:mainfrom

dz/fix-inference-leaklivekit/agents:dz/fix-inference-leakCopy head branch name to clipboard