This is a Bash application for logging HTTP traffic and sending the logs to Kafka for further processing.
- Logs HTTP request and response details to a log file.
- Sends the logs to a Kafka topic for real-time processing.
- Easy installation and setup using provided scripts.
- Bash shell
- Kafka broker(s) for log processing
wget
andtar
for downloading and extracting Kafka (if not already installed)
- Clone the repository or download the source code.
git clone https://github.com/tangobeee/traffic-processor.git
cd "traffic-processor"
- Run the setup script to install Kafka and start the application.
./setup
- Verify that Kafka is running and the application is logging traffic.
-
Modify the
src/main.sh
script to customize logging behavior or Kafka configuration as needed. -
Run the application using the provided start script.
./start.sh
-
Monitor the log file
(traffic.log)
for HTTP traffic logs. -
Optionally, configure Kafka consumers to process the logged data from the Kafka topic.
-
Kafka broker details can be configured in
etc/kafka.cfg
. -
Logging behavior and other application settings can be adjusted in
src/main.sh
.
This project is licensed under the MIT License.