Skip to content

Commit

Permalink
Updating code to support the bytewax versions incompatibility after t…
Browse files Browse the repository at this point in the history
…he upgrade. These classes ManualInputConfig and ManualOutputConfig have been removed from the new versions. hope this fixes the lint errors.

Signed-off-by: Lokesh Rangineni <lokeshforjava@gmail.com>

Signed-off-by: Lokesh Rangineni <lokeshforjava@gmail.com>
  • Loading branch information
lokeshrangineni committed Mar 6, 2024
1 parent ab7f1eb commit 3c89ce3
Showing 1 changed file with 4 additions and 4 deletions.
Original file line number Diff line number Diff line change
Expand Up @@ -6,8 +6,8 @@
import pyarrow.parquet as pq
from bytewax.dataflow import Dataflow # type: ignore
from bytewax.execution import cluster_main
from bytewax.inputs import ManualInputConfig
from bytewax.outputs import ManualOutputConfig
from bytewax.inputs import DynamicSource
from bytewax.outputs import DynamicSink

from feast import FeatureStore, FeatureView, RepoConfig
from feast.utils import _convert_arrow_to_proto, _run_pyarrow_field_mapping
Expand Down Expand Up @@ -77,7 +77,7 @@ def output_fn(mini_batch):

def _run_dataflow(self):
flow = Dataflow()
flow.input("inp", ManualInputConfig(self.input_builder))
flow.input("inp", DynamicSource(self.input_builder))
flow.flat_map(self.process_path)
flow.capture(ManualOutputConfig(self.output_builder))
flow.output(DynamicSink(self.output_builder))
cluster_main(flow, [], 0)

0 comments on commit 3c89ce3

Please sign in to comment.