TypeError: a bytes-like object is required, not 'str' #8142

turha71 · 2023-02-26T17:27:45Z

turha71
Feb 26, 2023

Hi,

Recently I have found this error "TypeError: a bytes-like object is required, not 'str'" every time I try to upscale an image using the Extras tab. Don't know if it is a bug, or if I did something that is causing this. What could be causing this error?

I'm using the latest version of automatic1111 and python 3.6

Thanks

ClashSAN · 2023-02-26T18:48:16Z

ClashSAN
Feb 26, 2023
Collaborator

https://github.com/AUTOMATIC1111/stable-diffusion-webui#automatic-installation-on-windows

python 3.6 is not compatible. you must use python 3.10.X specifically, never versions are also unsupported.

2 replies

turha71 Feb 26, 2023
Author

It didn't work. This is what I have done:

1 - Upgraded Python to 3.10.10
2 - Deleted the folder venv
3 - Run the script and reinstall all the files in venv
4 - Checked the Python version inside venv folder. It's 3.10.10
5 - Went to the Extras tab and tried to upscale an image. Got the same error.

What else could be causing this?

Thanks

turha71 Feb 26, 2023
Author

Well, it seems that the problem was with the image itself. Don't know why. The image it's just fine. Tried a different image and it worked. Very strange.
Thanks

erhathaway · 2023-03-20T22:11:56Z

erhathaway
Mar 20, 2023

I'm also getting this on inpainting when i use png but not jpeg for the same image.

I'm using:

python: 3.10.9  •  torch: 1.13.1+cu117  •  xformers: 0.0.16rc425  •  gradio: 3.16.2  •  commit: [a9fed7c3](https://github.com/AUTOMATIC1111/stable-diffusion-webui/commit/a9fed7c364061ae6efb37f797b6b522cb3cf7aa2)  •  checkpoint: [6ce0161689](https://google.com/search?q=6ce0161689b3853acaa03779ec93eafe75a02f4ced659bee03f50797806fa2fa)

The trace is:

ERROR:    Exception in ASGI application
Traceback (most recent call last):
  File "/opt/conda/lib/python3.10/site-packages/uvicorn/protocols/websockets/websockets_impl.py", line 254, in run_asgi
    result = await self.app(self.scope, self.asgi_receive, self.asgi_send)
  File "/opt/conda/lib/python3.10/site-packages/uvicorn/middleware/proxy_headers.py", line 78, in __call__
    return await self.app(scope, receive, send)
  File "/opt/conda/lib/python3.10/site-packages/fastapi/applications.py", line 273, in __call__
    await super().__call__(scope, receive, send)
  File "/opt/conda/lib/python3.10/site-packages/starlette/applications.py", line 122, in __call__
    await self.middleware_stack(scope, receive, send)
  File "/opt/conda/lib/python3.10/site-packages/starlette/middleware/errors.py", line 149, in __call__
    await self.app(scope, receive, send)
  File "/opt/conda/lib/python3.10/site-packages/starlette/middleware/gzip.py", line 26, in __call__
    await self.app(scope, receive, send)
  File "/opt/conda/lib/python3.10/site-packages/starlette/middleware/exceptions.py", line 79, in __call__
    raise exc
  File "/opt/conda/lib/python3.10/site-packages/starlette/middleware/exceptions.py", line 68, in __call__
    await self.app(scope, receive, sender)
  File "/opt/conda/lib/python3.10/site-packages/fastapi/middleware/asyncexitstack.py", line 21, in __call__
    raise e
  File "/opt/conda/lib/python3.10/site-packages/fastapi/middleware/asyncexitstack.py", line 18, in __call__
    await self.app(scope, receive, send)
  File "/opt/conda/lib/python3.10/site-packages/starlette/routing.py", line 718, in __call__
    await route.handle(scope, receive, send)
  File "/opt/conda/lib/python3.10/site-packages/starlette/routing.py", line 341, in handle
    await self.app(scope, receive, send)
  File "/opt/conda/lib/python3.10/site-packages/starlette/routing.py", line 82, in app
    await func(session)
  File "/opt/conda/lib/python3.10/site-packages/fastapi/routing.py", line 289, in app
    await dependant.call(**values)
  File "/opt/conda/lib/python3.10/site-packages/gradio/routes.py", line 436, in join_queue
    session_info = await websocket.receive_json()
  File "/opt/conda/lib/python3.10/site-packages/starlette/websockets.py", line 133, in receive_json
    self._raise_on_disconnect(message)
  File "/opt/conda/lib/python3.10/site-packages/starlette/websockets.py", line 105, in _raise_on_disconnect
    raise WebSocketDisconnect(message["code"])
starlette.websockets.WebSocketDisconnect: 1001
Traceback (most recent call last):
  File "/opt/conda/lib/python3.10/site-packages/gradio/routes.py", line 337, in run_predict
    output = await app.get_blocks().process_api(
  File "/opt/conda/lib/python3.10/site-packages/gradio/blocks.py", line 1018, in process_api
    data = self.postprocess_data(fn_index, result["prediction"], state)
  File "/opt/conda/lib/python3.10/site-packages/gradio/blocks.py", line 956, in postprocess_data
    prediction_value = block.postprocess(prediction_value)
  File "/opt/conda/lib/python3.10/site-packages/gradio/components.py", line 1530, in postprocess
    return processing_utils.encode_pil_to_base64(y)
  File "/opt/conda/lib/python3.10/site-packages/gradio/processing_utils.py", line 143, in encode_pil_to_base64
    pil_image.save(
  File "/opt/conda/lib/python3.10/site-packages/PIL/Image.py", line 2431, in save
    save_handler(self, fp, filename)
  File "/opt/conda/lib/python3.10/site-packages/PIL/PngImagePlugin.py", line 1331, in _save
    data = name + b"\0\0" + zlib.compress(icc)
TypeError: a bytes-like object is required, not 'str'

0 replies

a-l-e-x-d-s-9 · 2023-03-22T13:19:55Z

a-l-e-x-d-s-9
Mar 22, 2023

I have this problem with a few upscaled images too, 6 files out of 75 have this problem, and the rest are fine.
Using Python 3.10.7.
I've tried to open the file with 'rb', but it's throwing another exception.
Any workarounds?

0 replies

vladmandic · 2023-03-23T02:39:44Z

vladmandic
Mar 23, 2023
Collaborator

can you somehow share one of probematic images? seems the issue is in pillow library itself, but i'd like to check.

0 replies

a-l-e-x-d-s-9 · 2023-03-28T07:06:18Z

a-l-e-x-d-s-9
Mar 28, 2023

@vladmandic
The error message slightly changed for me, to "Error: not a TIFF file (header b"b'Exif\x" not valid)".
The images were upscaled, and the problem appeared on some of them. Looks like it appeared for those that had Exif data from Photoshop and other editing software.
I'm attaching Image.info for one of them, and an error from using Image.getexif() after that. This is the link to the file, you can test it yourself.
I also reported this problem on Pillow thread, not sure if relevant.

the_699518.png, info: {'exif': b"b'Exif\\x00\\x00II*\\x00\\x08\\x00\\x00\\x00\\x04\\x00\\x12\\x01\\x03\\x00\\x01\\x00\\x00\\x00\\x01\\x00\\x00\\x001\\x01\\x02\\x00\\x11\\x00\\x00\\x00>\\x00\\x00\\x00\\x13\\x02\\x03\\x00\\x01\\x00\\x00\\x00\\x01\\x00\\x00\\x00i\\x87\\x04\\x00\\x01\\x00\\x00\\x00P\\x00\\x00\\x00\\x00\\x00\\x00\\x00Shotwell 0.30.16\\x00\\x00\\x03\\x00\\x90\\x92\\x02\\x00\\x04\\x00\\x00\\x00442\\x00\\x02\\xa0\\t\\x00\\x01\\x00\\x00\\x00u\\x02\\x00\\x00\\x03\\xa0\\t\\x00\\x01\\x00\\x00\\x00\\xd5\\x03\\x00\\x00\\x00\\x00\\x00\\x00'", 'postprocessing': 'Postprocess upscale to: 2560x2560, Postprocess upscaler: 4x-AnimeSharp, Postprocess upscaler 2: RealESRGAN_x4plus_anime_6B', 'extras': 'Postprocess upscale to: 2560x2560, Postprocess upscaler: 4x-AnimeSharp, Postprocess upscaler 2: RealESRGAN_x4plus_anime_6B'}
Error occurred while processing the_699518.png. Error: not a TIFF file (header b"b'Exif\\x" not valid), Traceback (most recent call last):
  File "/home/username/Documents/stable_diffusion/Training/images_find_bad.py", line 23, in check_image_integrity
    image_exif = img.getexif()
  File "/home/username/Training/lib/python3.10/site-packages/PIL/PngImagePlugin.py", line 1040, in getexif
    return super().getexif()
  File "/home/username/Training/lib/python3.10/site-packages/PIL/Image.py", line 1454, in getexif
    self._exif.load(exif_info)
  File "/home/username/Training/lib/python3.10/site-packages/PIL/Image.py", line 3670, in load
    self._info = TiffImagePlugin.ImageFileDirectory_v2(self.head)
  File "/home/username/Training/lib/python3.10/site-packages/PIL/TiffImagePlugin.py", line 504, in __init__
    raise SyntaxError(msg)
SyntaxError: not a TIFF file (header b"b'Exif\\x" not valid)

When checking PNG info for the file, this is shown:

OSError: [Errno 36] File name too long: b"b'Exif\\x00\\x00II*\\x00\\x08\\x00\\x00\\x00\\x04\\x00\\x12\\x01\\x03\\x00\\x01\\x00\\x00\\x00\\x01\\x00\\x00\\x001\\x01\\x02\\x00\\x11\\x00\\x00\\x00>\\x00\\x00\\x00\\x13\\x02\\x03\\x00\\x01\\x00\\x00\\x00\\x01\\x00\\x00\\x00i\\x87\\x04\\x00\\x01\\x00\\x00\\x00P\\x00\\x00\\x00\\x00\\x00\\x00\\x00Shotwell 0.30.16\\x00\\x00\\x03\\x00\\x90\\x92\\x02\\x00\\x04\\x00\\x00\\x00442\\x00\\x02\\xa0\\t\\x00\\x01\\x00\\x00\\x00u\\x02\\x00\\x00\\x03\\xa0\\t\\x00\\x01\\x00\\x00\\x00\\xd5\\x03\\x00\\x00\\x00\\x00\\x00\\x00'"

0 replies

vladmandic · 2023-03-28T13:03:12Z

vladmandic
Mar 28, 2023
Collaborator

i took a look at the image you've uploaded and it seems that Shotwell inserted a byte-encoded exif metadata into png info section and that is confusing built-in metadata parser.

exif metadata is always byte-encoded, but it should be decoded if storing in png info section
as a result, this png is frankenstein containing jpg-style exif byte-encoded metadata inside png info section.

i wrote an "universal" metadata handler with the intention of possibly replace one in webui (which is based on broken/obsolete pixexif)
https://github.com/vladmandic/sd-extension-aesthetic-scorer/blob/main/exif.py

with that, i don't have a problem loading image or extracting metadata:

./exif.py ~/downloads/nm87t4.png

image: /home/vlado/downloads/nm87t4.png
format: PNG
metadata: {
'exif': "b'Exif\x00\x00II*\x00\x08\x00\x00\x00\x04\x00\x12\x01\x03\x00\x01\x00\x00\x00\x01\x00\x00\x001\x01\x02\x00\x11\x00\x00\x00>\x00\x00\x00\x13\x02\x03\x00\x01\x00\x00\x00\x01\x00\x00\x00i\x87\x04\x00\x01\x00\x00\x00P\x00\x00\x00\x00\x00\x00\x00Shotwell 0.30.16\x00\x00\x03\x00\x90\x92\x02\x00\x04\x00\x00\x00442\x00\x02\xa0\t\x00\x01\x00\x00\x00u\x02\x00\x00\x03\xa0\t\x00\x01\x00\x00\x00\xd5\x03\x00\x00\x00\x00\x00\x00'",
'postprocessing': 'Postprocess upscale to: 2560x2560, Postprocess upscaler: 4x-AnimeSharp, Postprocess upscaler 2: RealESRGAN_x4plus_anime_6B', 'extras': 'Postprocess upscale to: 2560x2560, Postprocess upscaler: 4x-AnimeSharp, Postprocess upscaler 2: RealESRGAN_x4plus_anime_6B'
}

0 replies

a-l-e-x-d-s-9 · 2023-03-28T16:21:49Z

a-l-e-x-d-s-9
Mar 28, 2023

@vladmandic
Here is this image(link fixed) before the upscaling with WebUI.
It was horizontally flipped with Shotwell previously.
PNG info for it looks empty, although it was flipped.
After upscaling it with WebUI, the error appeared in the image that you've already seen.
Can you please explain, do you think that the problem is with Shotwell (and other editing programs) messing up the EXIF data with a wrong format, and not with the part of WebUI upscaling adding PNG info wrong somehow?

2 replies

vladmandic Mar 28, 2023
Collaborator

i think you uploaded wrong image as its same as previous one?
also, can you clearly outline all steps (is it generate in webui -> save to png -> edit in shotwell -> save to png -> upscale in webui -> save to png? i'm wondering why is there exif tag in png info at all if it was never saved as jpg? or was it?

a-l-e-x-d-s-9 Mar 28, 2023

@vladmandic
Sorry for the confusion. By mistake I copied the same link the second time too.
The original image is this one: original. It is a JPG file, not generated by SD.
Not sure if I converted it first to PNG with the "convert" command or python script, or neither of them.
Then I flipped it horizontally with Shotwell and saved it as PNG: flipped and converted.
Then I upscaled it with WebUI and got this image, which caused the problem.
I hope it will help to understand which step is the source of the problem.

There is another bug report about this problem: #9078
Also, I've seen that another person has encountered it on the EveryDream2 discord server.
I've used a workaround with a script that removes exif from files that have this problem, but I've been told that exif may contain rotation data that can be important.

vladmandic · 2023-03-29T13:09:58Z

vladmandic
Mar 29, 2023
Collaborator

i found the root cause, but if would be great if you can test on my fork before i create a pr due to possible side-effects.
https://github.com/vladmandic/automatic

(or edit your code in place using patch notes below)

reproduction:

select any JPG with pre-existing metadata
load it into WebUI Extras tab
perform a task (upscale, face restore, anything)
save as PNG

extras when loading image simply takes existing exif metadata and without any decoding (its an encoded bytearray per exif standard) adds it to output pnginfo section thus creating a PNG file with invalid info section.

patch is vladmandic/automatic@b8ffe29

0 replies

Provide feedback

Saved searches

Use saved searches to filter your results more quickly

TypeError: a bytes-like object is required, not 'str' #8142

{{title}}

Replies: 8 comments 4 replies

{{title}}

{{title}}

{{title}}

{{title}}

{{editor}}'s edit

{{editor}}'s edit

{{title}}

{{title}}

{{title}}

{{editor}}'s edit

{{editor}}'s edit

{{title}}

{{title}}

{{editor}}'s edit

{{editor}}'s edit

{{title}}

{{title}}

{{editor}}'s edit

{{editor}}'s edit

{{title}}

{{editor}}'s edit

{{editor}}'s edit

Select a reply

TypeError: a bytes-like object is required, not 'str' #8142

turha71 Feb 26, 2023

Replies: 8 comments · 4 replies

ClashSAN Feb 26, 2023 Collaborator

turha71 Feb 26, 2023 Author

turha71 Feb 26, 2023 Author

erhathaway Mar 20, 2023

a-l-e-x-d-s-9 Mar 22, 2023

vladmandic Mar 23, 2023 Collaborator

a-l-e-x-d-s-9 Mar 28, 2023

vladmandic Mar 28, 2023 Collaborator

a-l-e-x-d-s-9 Mar 28, 2023

vladmandic Mar 28, 2023 Collaborator

a-l-e-x-d-s-9 Mar 28, 2023

vladmandic Mar 29, 2023 Collaborator

turha71
Feb 26, 2023

Replies: 8 comments 4 replies

ClashSAN
Feb 26, 2023
Collaborator

turha71 Feb 26, 2023
Author

turha71 Feb 26, 2023
Author

erhathaway
Mar 20, 2023

a-l-e-x-d-s-9
Mar 22, 2023

vladmandic
Mar 23, 2023
Collaborator

a-l-e-x-d-s-9
Mar 28, 2023

vladmandic
Mar 28, 2023
Collaborator

a-l-e-x-d-s-9
Mar 28, 2023

vladmandic Mar 28, 2023
Collaborator

vladmandic
Mar 29, 2023
Collaborator