Skip to content

Neural MMO v1.5

Latest

Choose a tag to compare

@jsuarez5341 jsuarez5341 released this 15 Feb 20:54

Large maps, Dashboard, Scripted Baselines

  • Blade: Full rework to support large environments and scripted players/NPCs
    • Map representation
      • Terrain generation for large maps
      • Environment caching to enable fast resets
      • Tiles are now limited to one occupying agent
      • Reworked tile material enum and properties
    • NPCs
      • Passive: Meanders around the map
      • Neutral: Meanders around the map until attacked, then fights back
      • Hostile: Actively hunts and attacks players and other NPCs
      • Level ranges and spawning locations are configurable for all NPC types
      • Navigation based on A* search
    • Scripted Baselines
      • Extension of the NPC AI module to support scripted player policies
      • Fixed-horizon food/water min-max search with Dijkstra's algorithm and dynamic programming backends
      • Intentional exploration capabilities enable broad coverage of large and small maps
    • Equipment
      • NPCs spawn with chestplates/platelegs of a level appropriate for their skills
      • Players/NPCs wearing equipment drop it upon death
      • Players automatically equip any items better than their current items
      • Equipment provides a large bonus to defense
      • Reworked combat formulas to account for this new system
  • Trinity: New home for non-neural-specific infrastructure and tools
    • Serialized observations
      • Maintains a flat tensor representation of the environment state
      • This representation is kept synchronous with the game state representation
      • Each entity (Player/Tile) is represented as discrete and continuous vectors
      • Observations are computed by slicing from tensor representations without traversing game objects
      • Discrete values are flat-indexed for ease of use in embedding layers
    • Evaluation
      • Runs the given model on multiple maps and aggregates data for the dashboard
      • Outputs a tabular summary of the results for baselines and publications
      • Usable on training maps, held-out evaluation maps (default), and transfer maps
    • Dashboard
      • Environment log function records customizable data for customizable plot types whenever an agent dies
      • Data is aggregated during training and at the end of evaluation
      • Bokeh dashboard is built using the aggregated data for the specified plot types
      • Dashboard is rendered in an interactive browser session
  • Ethyr: Simplified attribute processing
    • The Trinity additions flatten the bottom layer of the observation hierarchy
    • This removes a slow loop and significant complexity from IO embedding/unembed modules
    • We have standardized on the Recurrent baseline architecture for this release
  • Embyr: Full rework to support large environments and scripted players/NPCs
    • Map representation
      • All terrain representation code has been rewritten using the performant Unity Entity Component System
      • Tiles are loaded into and welded together in chunks
      • Lava/water assets have been replaced with more performant variants
    • Visuals
      • Tile textures are now configurable with the hifi (default)/medfi/lofi command
      • Attack animations have been replaced with more distinctive and aesthetic assets
      • A graphical bug causing sharp normals in some tile models has been fixed
      • UI and console retouched to match the new website theme
  • /projekt: Demo code for evaluation, overlays and logging
    • Unified command-line utility for map generation, training, evaluation, visualization, and rendering
    • Experiment config for canonical large/small baseline tasks
    • Single-file ~400 line RLlib wrapper/demo
    • Non-RLlib specific code has been moved to Trinity
    • Improved overall code cohesion and quality