Cannot access /file-upload endpoint on the API

[jatinvinkumar]

Thank you for adding this feature! However, when I go to http://127.0.0.1/docs#/ the upload-file section does not appear and I can't seem to access http://127.0.0.1/upload-file either. Could you please advise on how to use this feature?

[tanaysoni]

Hi @jatinvinkumar, the /file-upload is an API endpoint without a UI. You can use an API tool like Postman or the curl command to upload files with an HTTP POST request.

Using curl, you can try with: curl -i -X POST -H "Content-Type: multipart/form-data" -F "file=@/path/to/file" http://127.0.0.1:8000/file-upload.

[jatinvinkumar]

Thank you for the fast response! Here is my current postman request. Unfortunately, I am getting 'not found' when trying to access the end-point.

[tanaysoni]

It seems like the API route is not found. Can you ensure you're on the latest commit of Haystack by doing a git pull?

[jatinvinkumar]

It's able to make a call to the endpoint now, but I'm getting the following error traceback:

[2020-06-19 20:51:03 -0500] [4644] [INFO] Started server process [4644]
[2020-06-19 20:51:03 -0500] [4644] [INFO] Waiting for application startup.
[2020-06-19 20:51:03 -0500] [4644] [INFO] Application startup complete.
[2020-06-19 20:51:07 -0500] [4644] [ERROR] Exception in ASGI application
Traceback (most recent call last):
File "/usr/local/lib/python3.7/site-packages/uvicorn/protocols/http/httptools_impl.py", line 385, in run_asgi
result = await app(self.scope, self.receive, self.send)
File "/usr/local/lib/python3.7/site-packages/uvicorn/middleware/proxy_headers.py", line 45, in call
return await self.app(scope, receive, send)
File "/usr/local/lib/python3.7/site-packages/fastapi/applications.py", line 171, in call
await super().call(scope, receive, send)
File "/usr/local/lib/python3.7/site-packages/starlette/applications.py", line 102, in call
await self.middleware_stack(scope, receive, send)
File "/usr/local/lib/python3.7/site-packages/starlette/middleware/errors.py", line 181, in call
raise exc from None
File "/usr/local/lib/python3.7/site-packages/starlette/middleware/errors.py", line 159, in call
await self.app(scope, receive, _send)
File "/usr/local/lib/python3.7/site-packages/starlette/middleware/cors.py", line 78, in call
await self.app(scope, receive, send)
File "/usr/local/lib/python3.7/site-packages/starlette/exceptions.py", line 82, in call
raise exc from None
File "/usr/local/lib/python3.7/site-packages/starlette/exceptions.py", line 71, in call
await self.app(scope, receive, sender)
File "/usr/local/lib/python3.7/site-packages/starlette/routing.py", line 550, in call
await route.handle(scope, receive, send)
File "/usr/local/lib/python3.7/site-packages/starlette/routing.py", line 227, in handle
await self.app(scope, receive, send)
File "/usr/local/lib/python3.7/site-packages/starlette/routing.py", line 41, in app
response = await func(request)
File "/usr/local/lib/python3.7/site-packages/fastapi/routing.py", line 199, in app
dependant=dependant, values=values, is_coroutine=is_coroutine
File "/usr/local/lib/python3.7/site-packages/fastapi/routing.py", line 151, in run_endpoint_function
return await run_in_threadpool(dependant.call, **values)
File "/usr/local/lib/python3.7/site-packages/starlette/concurrency.py", line 34, in run_in_threadpool
return await loop.run_in_executor(None, func, *args)
File "/usr/local/Cellar/python/3.7.7/Frameworks/Python.framework/Versions/3.7/lib/python3.7/concurrent/futures/thread.py", line 57, in run
result = self.fn(*self.args, **self.kwargs)
File "/Users/jatinkumar/Desktop/haystack/haystack/api/controller/file_upload.py", line 72, in upload_file_to_document_store
pages = txt_converter.extract_pages(file_path)
File "/Users/jatinkumar/Desktop/haystack/haystack/indexing/file_converters/txt.py", line 88, in extract_pages
cleaned_pages, n_chars=300, n_first_pages_to_ignore=1, n_last_pages_to_ignore=1
File "/Users/jatinkumar/Desktop/haystack/haystack/indexing/file_converters/base.py", line 86, in find_and_remove_header_footer
found_header = self._find_longest_common_ngram(start_of_pages)
File "/Users/jatinkumar/Desktop/haystack/haystack/indexing/file_converters/base.py", line 135, in _find_longest_common_ngram
intersection = reduce(set.intersection, seqs_ngrams)

TypeError: reduce() of empty sequence with no initial value

---

I'm currently using a python 3.7 environment, should I be using 2.7?

[tanaysoni]

Moved this error in a new issue #164.