Barton
3D Puzzle game using generative AI dialogue.
Integrating generative AI into an NPC to fuel NPC dialog and interactions. A school project made by interdisiplinary team of 21
Barton
tools & resources used, credits too
- Unreal Engine C++ and Blueprints.
- Unreal Engine AES Encryption.
- OpenAI API Unreal Engine Plugin.
- Team: Giorgio Jimenez, Abigail Scheidler, Madds DeVlaeminck, Abbie Goodmansen, Ethan Koss, Nathaniel Roldan, Finn McElwain, Kieran McKee, Dylan Schultz, Bryan Tai, Ethan Volonte, Bonte Kochanek, Zavion Collier, Alice Mikhaylyuta, Abigail Ebert, Jacob Ikeda, Carter Hoke, CJ Osborne, Samantha Dunn, Camila Basualdo Cibils.
API integration
To utilize GPT models in game, integrating an OpenAI API plugin was done to make API calls primarily using Unreal's Blueprints for text generation
An API key is needed to use the models, and with the key being sensitive data, code obfuscation was necessary for distributing builds. I opted for Unreal's Advanced Encryption Standard and c++ code obfuscation methods for security
UI/UX
For the player to create prompts to generate responses, keyboard input was necessary. Collaborating with Alice Mikhaylyuta, a smooth user experience was implemented for communication
Blueprint for user input with keyboard
AI game world interactions
Multiple iterations were prototyped for getting a consistent experience between text and world interactions, but all proved inconsistent and over-enginnered. Collaborating with Madds DeVlaeminck, the current solution was to avoid overcomplicating and having each action self-contained in separate blueprints
Blueprint of the "Fetch" action