I'd really suggest being explicit in conversions/interop with sqlalchemy, and avoid a generic assumption that "sql = sqlalchemy" in this library.
One day, you may wish to add support for sqlglot (a similar, well-supported sql manipulation tool that's arguably better-suited for non-ORM purposes). Making a sensible API for that will be easier if the sqlalchemy interop is explicit.