Streamlit UI Evaluation mode

[PiffPaffM]

PR for issue #864

[Timoeller]

I would love to see the functionality in our streamlit app.
I made a comment to make it more adjustable from the outside.

Does it make sense to create tests about this feature and resulting feedback labels?

[Timoeller]

Thanks for adding the detailed user feedback section to our docs.

I made some more comments on the code.

There was also an open comment about file upload or attaching to an existing ES with pre indexed docs. Can we add some documentation on how to do that as well, please?

[Timoeller]

Some thoughts added on the st_state_patch.py

[PiffPaffM]

@Timoeller I went through your comments and added more information.
The gist st_state_patch.py still exists but the other implementation seems to be newer and is more likely the way going forward. Therefore, I changed that.

[Timoeller]

Hey yes my bad. I saw these changes already briefly yesterday and was very happy about them. I did not find the time to properly check and approve the PR. Will do now.

[Timoeller]

Nice, thanks for adjusting the code.

About specifying EVAL_FILE=eval_labels_example.csv we can worry later. Because if somebody specifies a custom file that file still needs to somehow get into the docker at build time like you did with COPY eval_labels_example.csv /home/user/, correct?

[PiffPaffM]

Nice, thanks for adjusting the code.

About specifying EVAL_FILE=eval_labels_example.csv we can worry later. Because if somebody specifies a custom file that file still needs to somehow get into the docker at build time like you did with COPY eval_labels_example.csv /home/user/, correct?

Yes, that is true. Let's find a better way in the future

[tholor]

About specifying EVAL_FILE=eval_labels_example.csv we can worry later. Because if somebody specifies a custom file that file still needs to somehow get into the docker at build time like you did with COPY eval_labels_example.csv /home/user/, correct?

Why not mounting the file into the container at runtime? We could add a volume in the docker-compose ...