You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
Copy file name to clipboardExpand all lines: readme.md
+15-2Lines changed: 15 additions & 2 deletions
Display the source diff
Display the rich diff
Original file line number
Diff line number
Diff line change
@@ -15,7 +15,18 @@ Building a demo which combines
15
15
16
16
## Step-by-step guide
17
17
18
-
Check out [these steps](https://github.com/kaiwaehner/python-jupyter-apache-kafka-ksql-tensorflow-keras/blob/master/live-demo___python-jupyter-apache-kafka-ksql-tensorflow-keras.adoc) to start the backend and notebook. The main demo is running in the Jupyter notebook then.
18
+
We will do the following:
19
+
20
+
1) Data Integration (Kafka Connect): Integrate a stream of data from CSV file or continuous data stream (in real world you can connect directly to an existing Kafka stream from the Jupyter notebook)
21
+
2) Data Preprocessing (KSQL): Preprocess the data, e.g. filter, anonymize, aggreate / concatenate
22
+
3) ML-specific preprocessing (NumPy, Scikit-learn): Normalize, split train / test data
23
+
4) Train model (TensorFlow + Keras)
24
+
5) Deploy model (KSQL + Tensorflow)
25
+
6) Monitor model inference (KSQL)
26
+
27
+
While all of this can be done in a Jupyter notebook for interactive analysis, we can then deploy the same pipeline to production at scale. For instance, you can re-use the KSQL preprocessing statements and run them in your production infrastructure to to model inference with KSQL and the TensorFlow model at scale.
28
+
29
+
Check out [this document](https://github.com/kaiwaehner/python-jupyter-apache-kafka-ksql-tensorflow-keras/blob/master/live-demo___python-jupyter-apache-kafka-ksql-tensorflow-keras.adoc) to start the backend and notebook. The main demo is running in the Jupyter notebook then and shows all above steps.
19
30
20
31
21
32
## Autoencoder for Credit Card Fraud Detection build with Keras and TensorFlow
@@ -50,4 +61,6 @@ The Python tool [Keras to TensorFlow](https://github.com/amir-abdi/keras_to_tens
0 commit comments