MySQL timeout with big db

[johnroper100]

I have a big database using flask and MySQL. It has about 1,060,000 items to search and index. I'm trying to update the search index for all the items at once using search.update_index() however, MySQL keeps timing out halfway through. Any ideas on how to fix this?

[honmaple]

You can use update_index(yield_per=1000) for big data, please check output of log

[johnroper100]

Ok, I'll try that

[johnroper100]

It didn't work. Here is a picture of my error:

[honmaple]

This looks like a problem about database connection.

[johnroper100]

Yes, the site is working fine, and the regular search.update_one_index calls are also working fine, it's just the search.update_index that's not working

[honmaple]

What's your configuration of sqlalchemy, maybe it's a issue about SQLALCHEMY_POOL_RECYCLE or SQLALCHEMY_POOL_TIMEOUT

Similar problem https://stackoverflow.com/questions/42163359/flask-sqlalchemy-2013-lost-connection