Lead Software Engineer at the UNC Eshelman School of Pharmacy Center for Innovation in Pharmacy Simulation (CIPS)
James Tiller is the Lead Software Engineer at the UNC Eshelman School of Pharmacy Center for Innovation in Pharmacy Simulation (CIPS) where he’s worked for 2+ years. James is an alumni of Vanderbilt University, where he studied Computer Engineering and Biomedical Engineering. He has worked as a Network Engineer for Fortune 500 companies, as well as a PM. Currently, he is inspired by researching procedurally generated dialog, as well as procedural animation. James’s future projects include building games for inter-professional networked multiplayer interactions with a virtual patient, and procedural encounter generation for goal-based education.
Techniques for Dynamic Dialog, Voice, and Lip Sync for Character Encounters
(With Speakers: Robert Hubal)
The nXhuman project at the Center for Innovation in Pharmacy Simulation (CIPS) at UNC is designed for training students in the healthcare fields in conversations with a variety of patients. The simulation is constructed to portray different patient encounters and monitor the student as the student works through each encounter. A crucial component of any clinician-patient encounter is, certainly, their dialog. When taking a natural language approach, however, simple dialog trees are unsustainable. As a result, dynamic dialog that can adapt to user-driven conversations is necessary to have a large coverage for the encounter. In this talk, CIPS will describe techniques for building dynamic dialog, procedural lip sync, voice cloning, and gesture animation. The team will also talk about how to deploy each of these techniques in the cloud to offload computation, trade-offs with latency, and other web service-based topics that are of interest for computation-heavy features.