FIRST Tech Challenge introduces VisionPortal, a comprehensive new interface for vision processing.
For FTC Blocks and Java teams, VisionPortal offers key capabilities of AprilTag and EasyOpenCV, along with TensorFlow Object Detection (TFOD) – at the same time!
Dual Preview with both AprilTags and TensorFlow
- AprilTag detections include ID code and pose: tag location and orientation, relative to the camera.
- Camera Controls, which can improve AprilTag and TFOD performance for webcam, are now fully available to FTC Blocks users.
Multiple cameras can operate at the same time – phone camera and/or webcam.
Multiple Camera View
- Sample OpModes and new tools are available to operate and customize these features, including the Builder pattern.
- For heavy video processing, many options are available to manage CPU resources and USB bandwidth.
DS and RC previews can be BIG!
Full Screen Preview
Many other new and improved features await your discovery in VisionPortal and beyond.
In preparation for the 2023-2024 CENTERSTAGE season, the new Software Development Kit (SDK) VisionPortal includes built-in support for AprilTag technology. Previously, Teams needed to download and incorporate external libraries, complicating the programming effort.
AprilTag is a popular vision technology for detecting a simple black-and-white tag, used to estimate position and orientation. In the 2022-2023 POWERPLAY game, many Teams enjoyed AprilTag’s reliable Autonomous performance for Signal Sleeve recognition.
Photo Credit: Mike Silversides
All sections of this Guide assume prior reading of the AprilTag
Introduction <../apriltag_intro/apriltag-intro> .
The SDK describes AprilTag pose relative to the camera, by default. This computing process is called pose estimation, a term that emphasizes this is an estimate only, based on many factors including camera calibration. You must determine AprilTag’s best use for reaching your goals.
AprilTag Introduction <../apriltag_intro/apriltag-intro> Vision Processor Initialization <../vision_processor_init/vision-processor-init> VisionPortal Initialization <../visionportal_init/visionportal-init> VisionPortal Previews <../visionportal_previews/visionportal-previews> AprilTag ID Codes <../apriltag_id_code/apriltag-id-code> AprilTag Metadata <../apriltag_metadata/apriltag-metadata> AprilTag Reference Frame <../apriltag_reference_frame/apriltag-reference-frame> AprilTag Camera Calibration <../apriltag_camera_calibration/apriltag-camera-calibration> AprilTag Pose <../apriltag_pose/apriltag-pose> AprilTag Library <../apriltag_library/apriltag-library> VisionPortal CPU and Bandwidth <../visionportal_cpu_and_bandwidth/visionportal-cpu-and-bandwidth> VisionPortal Camera Controls <../visionportal_camera_controls/visionportal-camera-controls> Vision Multiportal <../vision_multiportal/vision-multiportal> AprilTag Advanced Use <../apriltag_advanced_use/apriltag-advanced-use>
Much credit to
- EasyOpenCV developer @Windwoes
- FTC Blocks developer @lizlooney
- FIRST Tech Challenge navigation expert @gearsincorg
- and the smart people at UMich/AprilTag.
Questions, comments and corrections to westsiderobotics@verizon.net