Skip to content
No description, website, or topics provided.
C C++ Makefile Jupyter Notebook GLSL Python Other
Branch: master
Clone or download
hanatos pipe: thumbnail creation
initial checkin of this feature: completely unwired and untested.
Latest commit 4935ab2 Sep 17, 2019
Permalink
Type Name Latest commit message Commit time
Failed to load latest commit information.
bin
ext
src pipe: thumbnail creation Sep 17, 2019
.gitignore
.gitmodules
LICENCE licence: 2-clause bsd May 23, 2019
Makefile
TODO
readme.md

readme.md

darktable which sucks less

this is an experimental complete rewrite of darktable, naturally at this point with a heavily reduced feature set.

build instructions

you should have checked out this repo recursively. if not, do

git submodule init
git submodule update

to grab the dependencies in the ext/ folder. you should then be able to simply run 'make' from the bin/ folder. for debug builds (which enable the vulkan validation layers), try

cd bin/
make debug -j12

please see the 'bin/run.sh' shell scripts for notes on my current setup using the vulkan sdk instead of what your system ships, if you want to run that.

running

the binaries are currently wired to run from the bin/ directory:

cd bin/
./vkdt -g ./examples/histogram.cfg -d all

note that you have to edit the filename in the example cfg to point to a file that actually exists on your system. if you want to run the command line interface 'vkdt-cli', you need to replace the 'display' nodes by 'export' nodes (yes thes is inconvenient and will change).

licence

our code is licenced under the 2-clause bsd licence (if not clearly marked otherwise in the respective source files). there are parts from other libraries that are licenced differently. in particular:

rawspeed: LGPLv2 pthread-pool: LGPLv2 imgui: MIT

and we may link to some others, too.

differences to olden darktable

like:

  • job manager
  • some iops
  • noise profiling (but maybe auto?)
  • modularity

dont like:

  • bloat
  • cmake
  • gtk
  • lab
  • dead features
  • multi module pipeline
  • speed

a few random thoughts and notes

arch:

  • vulkan / glsl compute shaders
    • this is not only about vs. opencl but also completely scheduling things on GPU, interleaving jobs right, and overall getting more performance for small jobs (thumbnail creation..)
  • imgui with tightly encapsulated c++ part responsible for the interfacing
  • python bindings (pybind11)?

dependencies:

  • vulkan, glslangValidator
  • sdl2
  • submodule imgui
  • submodule rawspeed (pulls in pugixml and stdc++)
  • submodule pybind11?
  • libjpeg
  • build: make, sed

image list:

  • on-device thumbnail cache
  • write back on shutdown?
  • render as vertex list (see vkpt stretch_pic for text rendering)

pipeline:

  • match pixels (dense correspondences, multi image)
    • highlight recon
    • denoise
  • wavelet blend mode (separable a trous? even decimated a trous?)
    • heal/clone/blur
    • denoise (try multi-scale trick?)
  • local laplacian
    • tone manipulation in low freqs
    • may allow us to use less octaves
  • do we need local edits/masks
    • transform list of points interface
    • rasterise some shapes
  • output colour management on display/export

pipeline implementation:

  • two pipeline setups:
    • full (low res) image for thumbnail
    • one lowres preview and one cropped both setup with fixed size buffers, for interactive edit or tiled export
  • fixed buffer allocs for all images
  • number of pipelines for parallel GPU scheduling
  • don't run preview if full is full roi
  • see vkrun compute shaders

pipeline interface:

  • "human readable" 64-bit tokens to identify module/param?
    • very simple serialisation as binary and "human readable"
  • has a cli that does not link x
  • gui separate in a c++ compiled thing that calls into imgui
    • auto generate from params + meta description (curve etc)

iop:

  • crop/rotate
  • colour lut (but go from camera rgb directly?)
  • tone curve
  • local contrast
  • sharpen
  • demosaic
  • highlights
  • spot heal

camera specific data:

  • require target shot/spectral calibration for input colour
  • fallback matrices?

metadata:

  • probably no way around exiv2
  • something with more comprehensive and simple interface
  • editable?
  • searchable?

db:

  • special case to scale up to 1M images, can put everything into memory at all times (and write out at the end)
    • 4MB 32-bit indices of all images
    • 4MB sorted indices for list of stars
    • 5x4MB lists of colour labels
    • 30MB avg 30chars file names
  • build bvh on demand for 3 dimensions sort query should be a matter of milliseconds
  • rebuild after batch insertion of full directory
  • built-in undo lists
  • transactional interface with tokens similar to pipeline/iop
You can’t perform that action at this time.