VDK Logs Usability Testing

Usability Testing:

Objective:

The primary goal is to assess how users interact with VDK, especially in terms of navigating logs and identifying as well as troubleshooting errors.

Participants:

-TO BE ADDED

Environment:

-TO BE ADDED

Data Job for Testing:

Job Design:

Create a data processing job within VDK that is intentionally designed to fail due to a common and identifiable error. The job should be simple yet reflective of real-world tasks users might encounter.

Task for Participants:

1. Run the Job: Instruct participants to execute the data job.
2. Identify the Error: Participants should use the logs to identify what caused the job to fail.
3. Attempt to Fix: After identifying the error, participants should try to fix it based on their understanding and available resources.

Usability Testing Process:

• Introduction: Briefly introduce participants to the testing environment and the task at hand.
• Execution: Allow participants to run the job, examine the logs, and attempt to rectify the error.
• Observation: Observe and record their approach, focusing on how they interact with the logs and the troubleshooting steps they take.
• Feedback: Conduct a short post-task conversation to gather feedback on their experience, challenges faced, and suggestions for improvement.

Post-Testing:

• Report on data collected - common patterns, difficulties, and areas of improvement.
• Action items for improvements.