Regarding Code Generation task.

[BakingBrains]

Can I use it for Code generation?
For example if I give a query, "Add two numbers", and it should generate the code for that.
And if Yes, can you please suggest how can I prepare the dataset for this task or can I use the dataset which you mentioned.

Thank you

[yuewang-cuhk]

Yes, you can fine-tune CodeT5 on such code generation task. For data collection, one suggestion is to crawl code corpus with both code and its comments (similar to CodeSearchNet), and employ the comment texts as the source to generate the paired code.

[BakingBrains]

@yuewang-cuhk Thanks for the reply.

I will try, meanwhile can you please suggest if possible better way to employ the comment texts as the source to generate the paired code.

[yuewang-cuhk]

You may also get such data from some Code-QA platforms such as Stack Overflow.