Repository navigation
Large maps, Dashboard, Scripted Baselines
- Blade: Full rework to support large environments and scripted players/NPCs
- Map representation
- Terrain generation for large maps
- Environment caching to enable fast resets
- Tiles are now limited to one occupying agent
- Reworked tile material enum and properties
- NPCs
- Passive: Meanders around the map
- Neutral: Meanders around the map until attacked, then fights back
- Hostile: Actively hunts and attacks players and other NPCs
- Level ranges and spawning locations are configurable for all NPC types
- Navigation based on A* search
- Scripted Baselines
- Extension of the NPC AI module to support scripted player policies
- Fixed-horizon food/water min-max search with Dijkstra's algorithm and dynamic programming backends
- Intentional exploration capabilities enable broad coverage of large and small maps
- Equipment
- NPCs spawn with chestplates/platelegs of a level appropriate for their skills
- Players/NPCs wearing equipment drop it upon death
- Players automatically equip any items better than their current items
- Equipment provides a large bonus to defense
- Reworked combat formulas to account for this new system
- Map representation
- Trinity: New home for non-neural-specific infrastructure and tools
- Serialized observations
- Maintains a flat tensor representation of the environment state
- This representation is kept synchronous with the game state representation
- Each entity (Player/Tile) is represented as discrete and continuous vectors
- Observations are computed by slicing from tensor representations without traversing game objects
- Discrete values are flat-indexed for ease of use in embedding layers
- Evaluation
- Runs the given model on multiple maps and aggregates data for the dashboard
- Outputs a tabular summary of the results for baselines and publications
- Usable on training maps, held-out evaluation maps (default), and transfer maps
- Dashboard
- Environment log function records customizable data for customizable plot types whenever an agent dies
- Data is aggregated during training and at the end of evaluation
- Bokeh dashboard is built using the aggregated data for the specified plot types
- Dashboard is rendered in an interactive browser session
- Serialized observations
- Ethyr: Simplified attribute processing
- The Trinity additions flatten the bottom layer of the observation hierarchy
- This removes a slow loop and significant complexity from IO embedding/unembed modules
- We have standardized on the Recurrent baseline architecture for this release
- Embyr: Full rework to support large environments and scripted players/NPCs
- Map representation
- All terrain representation code has been rewritten using the performant Unity Entity Component System
- Tiles are loaded into and welded together in chunks
- Lava/water assets have been replaced with more performant variants
- Visuals
- Tile textures are now configurable with the hifi (default)/medfi/lofi command
- Attack animations have been replaced with more distinctive and aesthetic assets
- A graphical bug causing sharp normals in some tile models has been fixed
- UI and console retouched to match the new website theme
- Map representation
- /projekt: Demo code for evaluation, overlays and logging
- Unified command-line utility for map generation, training, evaluation, visualization, and rendering
- Experiment config for canonical large/small baseline tasks
- Single-file ~400 line RLlib wrapper/demo
- Non-RLlib specific code has been moved to Trinity
- Improved overall code cohesion and quality