Empty best completions

[p-ferreira]

Currently we have 1% of the best completions on net1 being empty. This happens when all the responses from querying the network is empty. On the bright side, even though one empty completion is selected as the best answer, it rewards to 0.

This can lead to problematic flows like

Prompt:
"""{Prompt content...} 
Question:
Answer: 
Question: 
Answer the question step by step"""


Network response:
"I'm not sure if I understood your question"

One solution to this is to requery the network if all responses are empty for a given threshold and (maybe) raise exception when empty spaces completion threshold is surpassed. Solution TBD