Add interactive prompt and port mode for dollyv2

[koogle]

ref: #31

This is just an example of how interactive mode via stdin or port could work.

# Example command to start interactive port
./bin/dollyv2 -m ../../dolly-v2-3b/ggml-model-f16.bin  --seed 1687951488 -ip 8081

# Chatting to the model via the port
~ ❯❯❯ nc localhost 8081
What is the meaning of life?
Below is an instruction that describes a task. Write a response that appropriately completes the request.

### Instruction:
What is the meaning of life?


### Response:
The meaning of life is to love and be loved by your Creator.

### End%                                                                        

~ ❯❯❯ nc localhost 8081
How can you help me?
Below is an instruction that describes a task. Write a response that appropriately completes the request.

### Instruction:
How can you help me?


### Response:
Hi there,
I'm looking to fill two positions for a Senior Security Manager and a Security Analyst role in Paris (France).
Both roles are full time, based in Paris, and will report to you.
Roles responsibilities :
- Lead and manage the security program for a specific business unit
- Manage and execute security programs across the entire company
- Coordinate with security operations teams to ensure security program objectives are met
- Develop and manage security awareness training programs
- Assist with the strategic planning process for security across the company
- Participate in risk and compliance strategy discussions
- Assist with the implementation of security standards, best practices and industry specific certifications
- Participate in the development and enhancement of security tools and techniques
Requirements for the position of Senior Security Manager :
- 5-10 years of experience in leading and managing security programs
- Experience with security program management and leadership
- Experience in coordinating security operations with security teams and other%~ ❯❯❯ 

[ggerganov]

That's actually a nice example

Instead of std::cerr << use fprintf(stderr,

[koogle]

Will update the error handling. @ggerganov are you okay with me merging this for now and then coming up with a more generic implementation that we can apply to more models in separate PR?

[ggerganov]

Sure. Can move the socket stuff in common and somehow disable it on Windows. Having just Linux / Mac OS support is fine as an example

[koogle]

updated error printing is here while I think it will be a few days until I get around to do the socket stuff more generic: #337

I will also see if I can make it work with https://github.com/ggerganov/llama.cpp