Skip to content
FAtiMA Toolkit is a collection of tools/assets designed for the creation of characters with social and emotional intelligence.
C# HTML
Branch: master
Clone or download

Latest commit

Fetching latest commit…
Cannot retrieve the latest commit at this time.

Files

Permalink
Type Name Latest commit message Commit time
Failed to load latest commit information.
AffectRecognition
Applications
Assets
AuthoringTools
Components
DllDependencies
LocalPackagesRepository
Tests
Tutorials
Utilities
Web/WebAPIWF
Wrappers/WebServer
docs
media
tools/pdb2mdb
.gitignore
.travis.yml
FAtiMA-Toolkit.sln
License.txt
NuGet.config
ReadMe.md
appveyor.yml
desktop.ini

ReadMe.md

FAtiMA Toolkit

Build status AppVeyor tests

Code Coverage (76%)

Oficial Website: https://fatima-toolkit.eu/

Description

FAtiMA Toolkit is a collection of tools/assets designed for the creation of characters with social and emotional intelligence. Currently, the project is actively being developed in the context of the EU-funded project named RAGE. As implied by its name, the toolkit is a continuation of the work done in developing the FAtiMA agent architecture. This architecture was initially released in 2005 and, since then, it has been used to control the behaviour of virtual characters and social robots in several research applications such as:

  • Traveller - A serious game for raising intercultural awareness;
  • SUECA - A social robot that plays an augmented reality card game;
  • FearNot! - A serious game for teaching children how to cope with bullying;

Besides porting the code from Java to C#, the toolkit offers many significant improvements over the previous form of FAtiMA. These improvements were guided by the following goals:

  • Modular design;
  • Simple integration with current game engines and other AI frameworks;
  • Accessible authoring tools and proper documentation;
  • Able to work on multiple application environments (Windows, Mac, Browser, iOS, Android)

With these goals in mind, the toolkit is composed of several assets. Each has a single core purpose, reflected in its external API that provides an abstraction for the asset's internal mechanisms. All assets can be used directly in any game engine that is able to import C# standard libraries, such as Unity. Each asset also contains an authoring tool with a GUI to aids its configuration. Currently, the following assets are included in the toolkit:

  • Emotional Appraisal - Manages the beliefs and the emotional state of the character according to how it is configured to judge the events that happen in the game world;

  • Emotional Decision Making - Decides how the character acts taking into account its emotions and beliefs about the state of the world;

  • Social Importance Dynamics - Adds the ability for the character to judge if an action is socially appropriate or not depending on how it perceives others from a relational standpoint.

  • Role Play Character - Integrates a combination of the previous three assets in a simplified perception-action cycle.

  • Integrated Authoring Tool - Manages the authoring of a scenario including its characters and respective dialogues.

  • Real Time Emotion Recognition - Able to infer the player's emotional state by combining multiple sources of affective inputs.

Latest Release: https://github.com/GAIPS-INESC-ID/FAtiMA-Toolkit/releases/tag/v4.0

Tutorials

To get started, we recommed that you check the code examples of each asset in the project folder named Tutorials

Additionally users car check the oficial website's "Get Started" section to learn more: https://fatima-toolkit.eu/home/get-started/

Training Materials

Unity Starter Kit

To start using a compiled version of the toolkit in your Unity game, download the following zip and read the instructions therein: https://www.dropbox.com/s/kl06lbanwkbwrqx/UnityStarterKit.zip?dl=0

Executable Demos

The following demos can be executed without Unity and they can be used to test different scenarios created with the Integrated Authoring Tool.

Note: These have been recently updated to correct a bug that occurred when the strongest emotion for one of the characcters corresponded to Shame/Pride/Gratitude

(NEW) The demo with two 3D characters had a severe issue that prevented Dialogue States from working properly. This problem has now been fixed.

Unity Demo Repository

The following repository contains the source code for the prototypes made in Unity to showcase the toolkit: https://github.com/GAIPS-INESC-ID/FAtiMA-Toolkit-UnityDemo

FAtiMA-Toolkit Integrated Authoring Tool Video Demonstration:

https://www.youtube.com/watch?v=6-oLZ_DJW2U

FAtiMA-Toolkit Role Play Character Tool Video Demonstration:

https://www.youtube.com/watch?v=2WgKs3-iI7g

Integrated Authoring Tool

The Integrated Authoring tool is a Windows application that is used to create and edit game scenarios with the toolkit. The latest version now includes a world model that allows the author to define the effects of actions. These effects will then be used by the chat simulator so the author can fully test a conversational scenario between a player and one or more characters. Additionally, there is now a graph tool in the dialogue editor that automatically creates a graph structure of the existing dialogues.

Android

We also support android: https://www.dropbox.com/s/vdebxhowao3yqcw/FAtiMA-Demo.apk?dl=0

Documentation

For each asset, there is a pdf document describing its API in the folder named Documentation

License

Apache 2.0

Contact

For any questions, suggestions and feedback please contact Samuel Mascarenhas (samuel.mascarenhas@gaips.inesc-id.pt).

You can’t perform that action at this time.