Investigating Conversational Programming for End-Users in Smart Environments through Wizard of Oz Interactions

Kate Howland; James Jackson

Natural language programming has long been an aspiration, but is fraught with challenges that have so far prevented genuinely useful and useable applications. End-user programming for smart environments is increasingly being pursued through trigger-action rule services that include simplified natural language description of rules. Along with the increasing prevalence of Voice User Interfaces (VUIs) in smart environments, this points to new opportunities for supporting understanding, debugging and editing of rules through speech. However, there is a lack of contextually relevant data on how end-users without programming experience describe and understand rules for smart environment behaviours through speech. This paper describes how the CONVER-SE project is developing methodology and software for capturing this data, and prototyping VUIs that attempt to mitigate the many challenges with supporting programming interactions through speech in this context.

Type of Publication: Paper
Conference: PPIG 2018 - 29th Annual Conference
Publication Year: 2018
Paper #: 21
TitleInvestigating Conversational Programming for End-Users in Smart Environments through Wizard of Oz Interactions
Publication TypePaper
AuthorsHowland, K, Jackson, J
PPIG Workshop: 
2018-09-29th