Opconversion Failure for gemma-7b_INT4

[saivivekseeram1]

here i'm attaching the screenshots.

[eaidova]

@saivivekseeram1 hello, please make sure that you executed cell with installing requirements in notebook before running model conversion. This issue required to use openvino-nightly package for resolving, while error what you see appears in openvino 2024.0.0

[saivivekseeram1]

okay Thank you @eaidova , it ran successfully. But while conversation with the llm in dialogue box , it's throwing an error in the middle of dialogue box.

1. i gave temperature as 1.0 and 0.1 , but still the issue was same
   
   

i'm attaching here the doument.

Exception in thread Thread-22 (_do_normal_analytics_request):
Traceback (most recent call last):
File "c:\Users\Local_Admin\AppData\Local\Programs\Python\Python310\lib\site-packages\httpx_transports\default.py", line 69, in map_httpcore_exceptions
Exception in thread Thread-24 (_do_normal_analytics_request):
Traceback (most recent call last):
File "c:\Users\Local_Admin\AppData\Local\Programs\Python\Python310\lib\site-packages\httpx_transports\default.py", line 69, in map_httpcore_exceptions
yield
File "c:\Users\Local_Admin\AppData\Local\Programs\Python\Python310\lib\site-packages\httpx_transports\default.py", line 233, in handle_request
yield
File "c:\Users\Local_Admin\AppData\Local\Programs\Python\Python310\lib\site-packages\httpx_transports\default.py", line 233, in handle_request
resp = self._pool.handle_request(req)
File "c:\Users\Local_Admin\AppData\Local\Programs\Python\Python310\lib\site-packages\httpcore_sync\connection_pool.py", line 216, in handle_request
resp = self._pool.handle_request(req)
File "c:\Users\Local_Admin\AppData\Local\Programs\Python\Python310\lib\site-packages\httpcore_sync\connection_pool.py", line 216, in handle_request
raise exc from None
File "c:\Users\Local_Admin\AppData\Local\Programs\Python\Python310\lib\site-packages\httpcore_sync\connection_pool.py", line 196, in handle_request
raise exc from None
File "c:\Users\Local_Admin\AppData\Local\Programs\Python\Python310\lib\site-packages\httpcore_sync\connection_pool.py", line 196, in handle_request
response = connection.handle_request(
File "c:\Users\Local_Admin\AppData\Local\Programs\Python\Python310\lib\site-packages\httpcore_sync\connection.py", line 99, in handle_request
response = connection.handle_request(
File "c:\Users\Local_Admin\AppData\Local\Programs\Python\Python310\lib\site-packages\httpcore_sync\connection.py", line 99, in handle_request
raise exc
File "c:\Users\Local_Admin\AppData\Local\Programs\Python\Python310\lib\site-packages\httpcore_sync\connection.py", line 76, in handle_request
raise exc
...
self.gen.throw(typ, value, traceback)
File "c:\Users\Local_Admin\AppData\Local\Programs\Python\Python310\lib\site-packages\httpx_transports\default.py", line 86, in map_httpcore_exceptions
raise mapped_exc(message) from exc
httpx.ConnectTimeout: _ssl.c:980: The handshake operation timed out

[eaidova]

@saivivekseeram1 this issue looks like some issue with your proxy settings encode/httpx#1433