This project is still ongoing, while the UI element detection part is useable and can be download in this repo of UIED. Besides, I implemented a web app of GUI element detection based on our algorithm, you are welcome to have a try http://www.uied.online.
UI2CODE is a system converting the GUI image into cooresponding front-end code that achieves the same visual effect and expected functionality of the input GUI.
It comprises two major parts:
- UI components detection: localize and classify all UI elements on the given image
- Graphical components detection
- Text recognition through EAST
- Code generation
- Repititive component recognition
- DOM tree construction
- HTML + CSS generation
