Reask doesn't work on Langchain integration

[Chromadream]

Hello,

We are trying to integrate Guardrails with Langchain, but encountered an issue when a reask is required, where it would throw an exception of

TypeError: 'NoneType' object is not callable

Here is the most basic reproducible snippet of the code:

from langchain.llms import OpenAI

from langchain.output_parsers import GuardrailsOutputParser

from langchain.prompts import PromptTemplate

def main():
    llm = OpenAI()
    rail_spec = """
<rail version="0.1">

<output>
<object name="patient_info">
    <string name="gender" description="Patient's gender" />
    <integer name="age" format="valid-range: 0 100"/>  


    <list name="symptoms" description="Symptoms that the patient is currently experiencing. Each symptom should be classified into  separate item in the list.">
        <object>
            <string name="symptom" description="Symptom that a patient is experiencing" />
            <string name="affected area" description="What part of the body the symptom is affecting"
                format="valid-choices: {['head', 'neck', 'chest']}"
                on-fail-valid-choices="reask"
            />  


        </object>
    </list>
    <list name="current_meds" description="Medications the patient is currently taking and their response">
        <object>
            <string name="medication" description="Name of the medication the patient is taking" />
            <string name="response" description="How the patient is responding to the medication" />
        </object>
    </list>
</object>
</output>

<prompt>

Given the following doctor's notes about a patient, please extract a dictionary that contains the patient's information.

{{doctors_notes}}

@complete_json_suffix_v2
</prompt>
</rail>
"""
    output_parser = GuardrailsOutputParser.from_rail_string(rail_spec)
    prompt = PromptTemplate(
        template=output_parser.guard.base_prompt,
        input_variables=output_parser.guard.prompt.variable_names,
    )

    doctors_notes = """
49 y/o Male with chronic macular rash to face & hair, worse in beard, eyebrows & nares.
Itchy, flaky, slightly scaly. Moderate response to OTC steroid cream
"""
    output = llm(prompt.format_prompt(doctors_notes=doctors_notes).to_string())
    print(output_parser.parse(output))
        
if __name__ == "__main__":
    main()

Any advice would be greatly appreciated.

[fuergaosi233]

same problem

[irgolic]

The reason this happens is because https://github.com/hwchase17/langchain/blob/master/langchain/output_parsers/rail_parser.py#L43 calls guard.parse without an api.

[irgolic]

@Chromadream @fuergaosi233 Could you give langchain-ai/langchain#6089 a try? Pass a openai.ChatCompletion.create as you instantiate the parser, and reasks should work fine now.

[irgolic]

Closing due to inactivity.