Skip to content

feat(backend): add the Python Notebook Migration Tool (backend only)#4437

Open
zyratlo wants to merge 5 commits intoapache:mainfrom
zyratlo:migration-tool-backend
Open

feat(backend): add the Python Notebook Migration Tool (backend only)#4437
zyratlo wants to merge 5 commits intoapache:mainfrom
zyratlo:migration-tool-backend

Conversation

@zyratlo
Copy link
Copy Markdown
Contributor

@zyratlo zyratlo commented Apr 21, 2026

What changes were proposed in this PR?

This PR introduces the backend portion of the Python Notebook Migration Tool, a new tool that converts a user-uploaded Python Jupyter notebook into a Texera workflow. New backend code includes:

  • notebook-migration-service
    • a new backend service which communicates with the Jupyter server (below) and the Texera database
  • Jupyter docker-compose which hosts the Jupyter server that renders the Jupyter notebook and has custom logic for the mapping feature
  • A SQL file to add the necessary tables for the tool

Details about the frontend are in a separate PR #4436 .

Any related issues, documentation, discussions?

Closes #4427
This PR closes the sub-issue related to the backend, the parent issue is #4301.

New tables in DB

image

Architecture Diagram (these can also be found on the parent issue)

Image Image Image

How was this PR tested?

This project was built locally and manually tested to ensure functionality. Pre-existing tests, builds, and checks were ran and passed.

Was this PR authored or co-authored using generative AI tooling?

Generated-by: ChatGPT (GPT-5.3)

@github-actions github-actions Bot added dependencies Pull requests that update a dependency file ddl-change Changes to the TexeraDB DDL service common labels Apr 21, 2026
@mengw15 mengw15 self-requested a review April 21, 2026 23:44
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

common ddl-change Changes to the TexeraDB DDL dependencies Pull requests that update a dependency file service

Projects

None yet

Development

Successfully merging this pull request may close these issues.

Add the Python-Notebook-Migration Tool Backend

2 participants