How to run nested queries in python

[banacer]

@lmql.query
def hello():
    @lmql.query
    def chain_of_thought():
        '''lmql
            "A: Let's think step by step.\n [REASONING]"
            "Therefore the answer is[ANSWER]" where STOPS_AT(ANSWER, ".")
            return ANSWER.strip()
        '''
    
    '''lmql
    "Q: It is August 12th, 2020. What date was it 100 days ago? [ANSWER]" where [ANSWER: chain_of_thought]
    '''
x = hello()[0]
print(x)

Output I get:

@lmql.query
def hello():
    @lmql.query
    def chain_of_thought():
        '''lmql
            "A: Let's think step by step.\n [REASONING]"
            "Therefore the answer is[ANSWER]" where STOPS_AT(ANSWER, ".")
            return ANSWER.strip()
        '''
    
    '''lmql
    "Q: It is August 12th, 2020. What date was it 100 days ago? [ANSWER]" where [ANSWER: chain_of_thought()]
    '''

RuntimeError: Failed to parse docstring of query function as LMQL code

[lbeurerkellner]

Hi there, you almost got it right, there are only two small syntactic issues in your code.

The nested query chain_of_thought should be declared on the same level as hello itself. I just added an example of this to the docs, see here: https://docs.lmql.ai/en/latest/language/functions.html#nested-queries-in-python

The second one is on how you call the nested function. Your main query code should just be:

"Q: It is August 12th, 2020. What date was it 100 days ago? [ANSWER: chain_of_thought()]"

You don't need to specify a separate where clause, but instead specify the nested query in-line, i.e. [ANSWER: chain_of_thought()]

So overall, you get:

import lmql

@lmql.query
def chain_of_thought():
    '''lmql
        "A: Let's think step by step.\n [REASONING]"
        "Therefore the answer is[ANSWER]" where STOPS_AT(ANSWER, ".")
        return ANSWER.strip()
    '''

@lmql.query
def hello():
    '''lmql
    "Q: It is August 12th, 2020. What date was it 100 days ago? [ANSWER: chain_of_thought]"
    '''

r = hello()
print(r) # [LMQLResult(prompt='Q: It is August 12th, 2020. What date was it 100 days ago? May 4th, 2020.', variables={'ANSWER': 'May 4th, 2020.'}, distribution_variable=None, distribution_values=None)]

[banacer]

thanks a lot for your response!
is it supported in the last beta release or we need to point to main branch?

[banacer]

I pulled the master and it works! Thanks a lot!