FAtiMA Toolkit is a collection of tools/assets designed for the creation of characters with social and emotional intelligence.
Clone or download
Fetching latest commit…
Cannot retrieve the latest commit at this time.
Permalink
Failed to load latest commit information.
.vs Small fix to the Simulator way of calculating the Players options Sep 4, 2018
AffectRecognition Fixed nugets and compilation erros in the AffectRecognition Solution Jan 31, 2018
Assets Fixed a bug on the volitions dynamic property about how it was calcul… Jul 26, 2018
AuthoringTools Another quick fix to the simulator Sep 4, 2018
Components Merge branch 'master' of https://github.com/GAIPS-INESC-ID/FAtiMA-Too… Jul 12, 2018
DllDependencies Manual merge of changes to emotion detection assets and WF due to pro… Aug 26, 2017
Executables Executables for the release Sep 4, 2018
LocalPackagesRepository Started removing most of the nuget packages from the repository. Jan 10, 2018
Tests Improved the Step method Jul 17, 2018
Tutorials Small fix to the Simulator way of calculating the Players options Sep 4, 2018
Utilities Removed the tracked "packages" folder from the other subsolutions Aug 3, 2017
docs Added missing coverage files Jan 31, 2018
media Forgot to upload the new icon Aug 29, 2018
tools - Updated IAT dialog system to allow multiple meanings and styles for… Sep 27, 2016
.gitignore Changed Git Ignore to ignore the Axo Cover reports Jan 11, 2018
.travis.yml Test Travis 3 Aug 3, 2017
ExportAuthTools.bat Separated the Auhtoring Tools to a Different Visual Studio Solution (… Aug 3, 2017
ExportDlls.bat - Applied minor tweaks and fixes Sep 13, 2016
FAtiMA-Toolkit.sln Massive Update to the Comme il Faut Component along with an Authoring… Jul 12, 2018
License.txt Create License.txt Feb 17, 2016
NuGet.config Changed the Path of the NuGet Local Repository Package Jan 22, 2018
ReadMe.md Update ReadMe.md Sep 4, 2018
appveyor.yml Another try Oct 8, 2017
desktop.ini Comme ill Faut initial implementation Nov 30, 2016

ReadMe.md

FAtiMA Toolkit

Build status AppVeyor tests

Code Coverage (76%)

Oficial Website: https://fatima-toolkit.eu/

Description

FAtiMA Toolkit is a collection of tools/assets designed for the creation of characters with social and emotional intelligence. Currently, the project is actively being developed in the context of the EU-funded project named RAGE. As implied by its name, the toolkit is a continuation of the work done in developing the FAtiMA agent architecture. This architecture was initially released in 2005 and, since then, it has been used to control the behaviour of virtual characters and social robots in several research applications such as:

  • Traveller - A serious game for raising intercultural awareness;
  • SUECA - A social robot that plays an augmented reality card game;
  • FearNot! - A serious game for teaching children how to cope with bullying;

Besides porting the code from Java to C#, the toolkit offers many significant improvements over the previous form of FAtiMA. These improvements were guided by the following goals:

  • Modular design;
  • Simple integration with current game engines and other AI frameworks;
  • Accessible authoring tools and proper documentation;
  • Able to work on multiple application environments (Windows, Mac, Browser, iOS, Android)

With these goals in mind, the toolkit is composed of several assets. Each has a single core purpose, reflected in its external API that provides an abstraction for the asset's internal mechanisms. All assets can be used directly in any game engine that is able to import C# standard libraries, such as Unity. Each asset also contains an authoring tool with a GUI to aids its configuration. Currently, the following assets are included in the toolkit:

  • Emotional Appraisal - Manages the beliefs and the emotional state of the character according to how it is configured to judge the events that happen in the game world;

  • Emotional Decision Making - Decides how the character acts taking into account its emotions and beliefs about the state of the world;

  • Social Importance Dynamics - Adds the ability for the character to judge if an action is socially appropriate or not depending on how it perceives others from a relational standpoint.

  • Role Play Character - Integrates a combination of the previous three assets in a simplified perception-action cycle.

  • Integrated Authoring Tool - Manages the authoring of a scenario including its characters and respective dialogues.

  • Real Time Emotion Recognition - Able to infer the player's emotional state by combining multiple sources of affective inputs.

Latest Release: https://github.com/GAIPS-INESC-ID/FAtiMA-Toolkit/releases/tag/v2.5

Tutorials

To get started, we recommed that you check the code examples of each asset in the project folder named Tutorials

Additionally users car check the oficial website's "Get Started" section to learn more: https://fatima-toolkit.eu/home/get-started/

Training Materials

Unity Starter Kit

To start using a compiled version of the toolkit in your Unity game, download the following zip and read the instructions therein: https://www.dropbox.com/s/kl06lbanwkbwrqx/UnityStarterKit.zip?dl=0

Executable Demos

The following demos can be executed without Unity and they can be used to test different scenarios created with the Integrated Authoring Tool.

Note: These have been recently updated to correct a bug that occurred when the strongest emotion for one of the characcters corresponded to Shame/Pride/Gratitude

(NEW) The demo with two 3D characters had a severe issue that prevented Dialogue States from working properly. This problem has now been fixed.

Unity Demo Repository

The following repository contains the source code for the prototypes made in Unity to showcase the toolkit: https://github.com/GAIPS-INESC-ID/FAtiMA-Toolkit-UnityDemo

FAtiMA-Toolkit Integrated Authoring Tool Video Demonstration:

https://www.youtube.com/watch?v=6-oLZ_DJW2U

FAtiMA-Toolkit Role Play Character Tool Video Demonstration:

https://www.youtube.com/watch?v=2WgKs3-iI7g

Integrated Authoring Tool

The Integrated Authoring tool is a Windows application that is used to create and edit game scenarios with the toolkit. The latest version (2.5) now includes a world model that allows the author to define the effects of actions. These effects will then be used by the chat simulator so the author can fully test a conversational scenario between a player and one or more characters. Additionally, there is now a graph tool in the dialogue editor that automatically creates a graph structure of the existing dialogues.

Android

We also support android: https://www.dropbox.com/s/vdebxhowao3yqcw/FAtiMA-Demo.apk?dl=0

Documentation

For each asset, there is a pdf document describing its API in the folder named Documentation

License

Apache 2.0

Contact

For any questions, suggestions and feedback please contact Samuel Mascarenhas (samuel.mascarenhas@gaips.inesc-id.pt).