Skip to content

Update assignment.sh for data organization #1

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Merged
dingling0818 merged 1 commit into from
Oct 18, 2025
Merged

Update assignment.sh for data organization #1

Changes from all commits
Commits
Show all changes
1 commit
Select commit
File filter

Filter by extension

Filter by extension
Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
14 changes: 10 additions & 4 deletions 02_activities/assignments/assignment.sh
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -28,21 +28,27 @@ unzip -q rawdata.zip
# Complete assignment here

# 1. Create a directory named data

mkdir data
# 2. Move the ./rawdata directory to ./data/raw

mv rawdata data/raw
# 3. List the contents of the ./data/raw directory

ls data/raw
# 4. In ./data/processed, create the following directories: server_logs, user_logs, and event_logs
mkdir -p data/processed/server_logs data/processed/user_logs data/processed/event_logs

# 5. Copy all server log files (files with "server" in the name AND a .log extension) from ./data/raw to ./data/processed/server_logs
cp data/raw/*server*.log data/processed/server_logs/

# 6. Repeat the above step for user logs and event logs
cp data/raw/*user*.log data/processed/user_logs/
cp data/raw/*event*.log data/processed/event_logs/

# 7. For user privacy, remove all files containing IP addresses (files with "ipaddr" in the filename) from ./data/raw and ./data/processed/user_logs
rm data/raw/*ipaddr*.log
rm data/processed/user_logs/*ipaddr*.log

# 8. Create a file named ./data/inventory.txt that lists all the files in the subfolders of ./data/processed

find data/processed -type f > data/inventory.txt

###########################################

Expand Down