Tasks

[lamarrr]

2D

• Implement Renderer-Agnostic Canvas API
• Implement Vulkan Renderer for Canvas
• Integrate Audio and Video codecs for WebM (video: AVI + audio: Opus/Vorbis) (to be used showcase)
• Integrate animation codec for AVIF (to be used in showcase)
• Integrate audio codec for Opus and Vorbis (to be used in showcase)
• Implement WebP, JPG, and PNG image decoders
• Implement 2D animations (i.e. easein, easeout, etc.)
• Wide Gamut Support for image decoding (png and some formats specify color space) and swapchain images i.e. P3, Adobe SRGB (see: https://developer.android.com/training/wide-color-gamut, https://registry.khronos.org/vulkan/specs/1.3-extensions/man/html/VK_EXT_swapchain_colorspace.html, https://en.wikipedia.org/wiki/DCI-P3, https://docs.google.com/document/d/17C7UAaLSX2hHOq-hYENeJ1HwMhPCL-e0pb9Pn8rXUok/edit)
  Terms: Gamut: color range supported by device from a color space, Color space: range of values

Widgets & Engine

• Implement Box widget
• Implement Button widget
• Implement Grid widget
• Implement Padding widget
• Implement Stack widget
• Implement text widget
• Implement Flex widget
• Implement image widget
• Integrate and evaluate 2d animations in widgets
• Drag and drop (see: Support drag and drop across Flutter boundary flutter/flutter#30719)
• Add NetworkImageSource for Image Widget, with optional caching specified via image widget props (try_load_from_cache, cache_image)
• Fix text layout
• Remove use of pointers for identifying widgets

3D (Optional. low priority)

• Implement quaternions and operations
• Implement 3d render pipeline
• Implement bloom post-processing (based on unreal engine's) https://www.youtube.com/watch?v=ml-5OGZC7vE
• Implement blur post-processing https://github.com/GPUOpen-LibrariesAndSDKs/FidelityFX-SDK/blob/main/docs/samples/blur.md
• Implement PBR rendering post-processing
• Implement chromatic aberration post-processing
• Implement depth of field post-processing https://github.com/GPUOpen-LibrariesAndSDKs/FidelityFX-SDK/blob/main/docs/samples/depth-of-field.md
• Implement shadow mapping
• Implement particle effects
• Implement bokeh effect
• Implement global illumination

Plugins

• Implement an async streaming http client using CuRL as backend
• Implement async file io streaming (with io_uring as backend on linux if supported otherwise c-posix api, and ioring on windows)
• Implement window controller API and explore solutions to allow creating and attaching widgets to multi-window supported platforms
• Implement clipboard plugin that can copy and paste multimedia content
• Implement vulkan font loader plugin

Infrastructure

• Implement CI for checking for build errors
• Implement basic unit tests where reasonable
• Consider implementing regression tests once the code becomes more complex and more churn is performed in the system

Abstract

• Survey Flutter, React Native, SwiftUI, Web, Chromium, UE5, and Unity's features, strengths, and areas of weaknesses we can work on or improve

Statistics

• Memory Usage and widget
• CPU utilization API and widget
• GPU utilization
• API and task tracing
• Add Vulkan Command Query Pool

Custom UI Graphics Pipelines