Layout Index

[NNTin]

https://pixel-agents-hq.github.io/index/

Fresh new project. Contributions and ideas welcome: https://github.com/pixel-agents-hq/index

Caveat: for now I am maintaining the backend so you are blocked by me.
Filling the layout index with data would be cool. A discord account is required + being in the official Pixel Agents server (https://discord.gg/qmq3VhzCC) is required. Our user management is powered by Discord.
-> we can have moderators who curate through Discord Role ID
-> we can moderate the submission since the layouts are owned by Discord Users.

I have more ideas to stabilize the index. It is however usable now. I'm not really active on GitHub discussions, so ping me (b6d / Tin) on the Discord server

The layout index is powered by a public API. So third party integration are welcome. My Discord Bot will be powered enabling it to list layouts indivudal users have created (WIP).

[NNTin]

kuBYFX4DqQ.mp4

Discord Bot on the official server is integrated with the pixel (layout) index

[NNTin]

xTZ2fx8Kr9.mp4

ntWEkpwMka.mp4

Working towards a multi agent system. There is an orchestrator image (in video the Pico discord bot) who talks via a2a to subagents. As of now only the architect agent is implemented. This agent is color blind and sees the pixel agents office via prose tokens, e.g. tile/furniture/wall is at row and column position. It understands the different furniture types (chair, desk, ...) as well as their styles but not the color.

A painter agent needs to be added. This agent should have vision capability and can judge if the layout and furniture arrangement is color pleasing to the eye.

Flow:

• User requests a room to be added
  • orchestrator delegates the task to the architect agent
• User requests the floor and wall to be painted in warm blue colors
  • orchestrator delegates the task to the painter agent

This implementation focuses that the subagents are implemented as agent cards provided via an agent server. This means the agents are not locked into the discord ecosystem and can therefore be in the future integrated into the index website: https://pixel-agents-hq.github.io/index/

[NNTin]

V3hYJjuOS0.mp4

Architect agent can move furniture, place tiles and walls.
Painter agent can color them.

Vision capability wasn't used for the painter agent because I am still looking for a LLM model with vision capability.

[NNTin]

The cog bootcamp allows the user to add more custom agent. User can define the system prompt.
The cog telephonepole allows the user to define custom MCP servers and assign them to the agents.
(suggestionbox also allows adding a custom MCP server to agents and toolbox allows turning discord commands into tools.)

Below is demonstration how neka-nat/freecad-mcp is used to talk to the program FreeCAD.

uClt2cGw2k.mp4

[NNTin]

Note: I have mixed feeling about AI generated art but I am blocked by having custom animated art assets so I am dabbling into generated art assets.

Below is a video how I made AI generate an animated oil lamp in different rotation. This is available as a spritesheet and can be integrated as a furniture object in pixel agents.
A text to image prompt is not suitable because it can not show the rotation properly. This is why the 3D model of it is AI generated whereas the rendering pipeline is deterministic.

This is using GPT 6 Astra. Astra is a newly released model and is supposedly really good at 3D animation. I'll open source the MCP tools server but I cannot provide a community agent for this since this is so token hungry.

I will explore it more. My goal is:

1. dynamically create a pixel art asset
2. integrate the object into pixel agents webview (<- pixel agents supports importing a custom layout..)

Both steps aren't so trivial.

Small blocker on the pixel agents webview:
Furnitures in pixel agents can be animated, see e.g. the computer. But it is only done when an agent interacts with it. Since I want to implement a visualization of my smart home showing temperature, water levels, light states I don't need an agent to interact with it.

GawnwP1g2V.mp4

8MzFjrybIb.mp4