Add async UDFs

Add a new 'AsyncMapOperator' that applies an async UDF to its input. Async UDFs use the existing interface for defining the UDF and are called in SQL the same as non-async UDFs. Options are specified in a comment similar to dependencies.
ArroyoSystems · Jan 11, 2024 · 29e1c59 · 29e1c59
1 parent 0e5376f
commit 29e1c59
Show file tree

Hide file tree

Showing 23 changed files with 964 additions and 107 deletions.
diff --git a/Cargo.lock b/Cargo.lock
diff --git a/arroyo-controller/src/compiler.rs b/arroyo-controller/src/compiler.rs
@@ -106,6 +106,7 @@ impl ProgramCompiler {
             use arroyo_worker::operators::sinks;
             use arroyo_worker::operators::joins::*;
             use arroyo_worker::operators::windows::*;
+            use arroyo_worker::operators::async_map::*;
             use arroyo_worker::engine::{Program, SubtaskNode};
             use arroyo_worker::{LogicalEdge, LogicalNode};
             use types::*;