New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
Make connection login and password TEXT #32815
Make connection login and password TEXT #32815
Conversation
Congratulations on your first Pull Request and welcome to the Apache Airflow community! If you have any issues or are unsure about any anything please check our Contribution Guide (https://github.com/apache/airflow/blob/main/CONTRIBUTING.rst)
|
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
It appears like MySQL doesn't like your change:
sqlalchemy.exc.OperationalError: (MySQLdb.OperationalError) (1118, 'Row size too large. The maximum row size for the used table type, not counting BLOBs, is 65535. This includes storage overhead, check the manual. You have to change some columns to TEXT or BLOBs')
Yep. I was talking about it in the related issue. The TL;DR is that it doesn't fail on my migration (128), nor in its downgrade. But rather it fails to downgrade migration 79 after applying that and 128 just fine. |
Why do we even have a limit anyway? Since we don’t search against the column we can just use Text. |
For my usecase that'd also work. I don't think there's an index against either But I'm new to Airflow, as well as the codebase, so figured I'd open an issue first to ask about it, and then I pushed the code to see if current DB engines would support this change (clearly MySQL doesn't for some reason), and get opinions from Airflow committers/devs. |
can you modify the PR for that? |
Sure, sounds good. I'm guessing it will require rebasing and getting it up to date now that 2.7.0 is out |
Yep. Rebase early-rebase often (as I often repeat) |
airflow/migrations/versions/0130_2_8_0_make_connection_login_password_text.py
Outdated
Show resolved
Hide resolved
Seems what's failing is |
This commit will change the connection `login` and `password` fields to be of type `TEXT`, so it won't have a length limitation anymore.
Awesome work, congrats on your first merged pull request! You are invited to check our Issue Tracker for additional contributions. |
Congrats on your first commit 🎉 |
This commit will change the connection
login
andpassword
fields to be of typeTEXT
, so it won't have a length limitation anymore.Closes #32657