Query ignoring condition and then failing for unknown reason

[JasperDekoninck]

The following query fails:

argmax(chatty_openai=True, max_len=256)
   "A rhyme:\n"
   "Verse: [RHYME_START]\n"
   for i in range(5):
      "Verse: [RHYME]\n"
from
   'openai/text-davinci-003'
where
   len(TOKENS(RHYME)) == 5 and len(TOKENS(RHYME_START)) == 5

I am not sure why, but the first RHYME variable does not stop after five tokens. However, if I remove the "RHYME START" variable completely, the query works fine again. I also ran several variations of this query where sometimes it works and sometimes it fails at the second RHYME variable. I cannot really figure out what is going wrong though.

[JasperDekoninck]

It seems that something is wrong with the equality operator, since the following query also fails for the same reason, but now on the variable "NAME". Changing the condition on RHYME to e.g. len(RHYME) < 10 fixes the issue. What's interesting here as well, is that in this case NAME stops on the second occurrence of the apostrophe, and not on the first.

argmax(chatty_openai=True, max_len=256)
   "A rhyme named '[NAME]':\n"
   for i in range(5):
      "Verse: [RHYME]\n"
from
   'openai/text-davinci-003'
where
   len(RHYME) == 10 and STOPS_BEFORE(NAME, "'")

[lbeurerkellner]

Thanks for reporting this. Both queries are now fixed on 'main' and on the web. The issue here was that internally the equality constraint was type-dispatched to the generic implementation and not the integer-specific one, because early in query execution, we do not know about the type of len(RHYME) yet.