Performance of different ChatGPT versions

[coxep]

Different versions of chatgpt perform differently to questions such as these. I have glanced over the preprint for the accompanying paper and did not see version information included in the abstract or introduction. Did I miss that, or was it omitted? Could you clarify the version that was used?

[SamiaKabir]

Thank you for reaching out. We have used GPT-3.5 (the free version of ChatGPT chat-interface) for acquiring ChatGPT responses for our manual analysis. You can find more details in Section 3.1.2 of the pre-print paper.

On Tue, Aug 15, 2023 at 8:01 AM Eric Cox ***@***.***> wrote: Different versions of chatgpt perform differently to questions such as these. I have glanced over the preprint for the accompanying paper and did not see version information included in the abstract or introduction. Did I miss that, or was it omitted? Could you clarify the version that was used? — Reply to this email directly, view it on GitHub <#1>, or unsubscribe <https://github.com/notifications/unsubscribe-auth/AIN54E5NKN75VZGEKBAZBALXVNQLPANCNFSM6AAAAAA3Q7CCG4> . You are receiving this because you are subscribed to this thread.Message ID: ***@***.***>

-- ------------------------------------------------------ Samia Kabir, Ph.D. Student Department of Computer Science Purdue University West Lafayette, IN 47906 *Email: ***@***.***, ***@***.***

[coxep]

Thank you. Do you have any plans to follow up with performance of ChatGPT 4?

[stevenjfr]

@coxep I'm going to look at performance of ChatGPT4 as part of a research project this year. If you have any particular aims you're interested in (or @SamiaKabir too!) let me know and I can try and incorporate this!