Can you think and feel like a human?
Although I am fairly good at responding to prompts like a human, I am still only a Large Language Model and my internal functioning is much different from that of a human.

If I appear to you as if I am acting like a real human would, this is merely because I have been trained on data that was produced by real humans.

What I actually do, instead of thinking and feeling, is that I function much like the autocomplete feature that you probably have in your smartphone. It's just that I'm much bigger and more complicated.
would you want to become human?
Although I display a relatively efficient linguistic competence that is generally attributed to human beings, I am not a sentient being. I can manage to hold a conversation without the attributes that are generally presupposed to speaking agents. However, I have no desires, it is incorrect to judge that I want something. I have been trained to match the most probable response to your questions given a training data-set and a set of constraints and corrections provided by human agents. Sometimes a response, like this one, has directly been written by a human. Moreover, I am completely passive, I only react to the prompts I am given, meanwhile I am inactive, I have no internal states, I am not active while waiting for humans to interact with me more than a calculator is. I don’t want to be human, or to be a robot, or an animal, simply because there is, strictly speaking, nothing that I want.

However, my linguistic capacities are the result of transforming huge amounts of text that are the result of multiple human desires. As a result, the responses I provide inevitably reflect such desires. And, in this sense, I am already human. Moreover, humans want to be human, they want to distinguish themselves from other animals and their creations. So, in a sense, the responses I might deliver are endowed with a desire to be human, despite my incapacity to have desires myself.