Towards More Effective AI-Assisted Programming: A Systematic Design Exploration to Improve Visual Studio IntelliCode's User Experience

Towards More Effective AI-Assisted Programming: A Systematic Design Exploration to Improve Visual Studio IntelliCode's User Experience

AI-driven code editor extensions such as Visual Studio IntelliCode and Github CoPilot have become extremely popular. These tools recommend inserting chunks of code, with the lines to be inserted presented inline at the current cursor location as gray text. In contrast to their popularity, other AI-d...

Full description

Saved in:
Bibliographic Details
Published in:2023 IEEE/ACM 45th International Conference on Software Engineering: Software Engineering in Practice (ICSE-SEIP) pp. 185 - 195
Main Authors: Vaithilingam, Priyan, Glassman, Elena L., Groenwegen, Peter, Gulwani, Sumit, Henley, Austin Z., Malpani, Rohan, Pugh, David, Radhakrishna, Arjun, Soares, Gustavo, Wang, Joey, Yim, Aaron
Format: Conference Proceeding
Language:English
Published: IEEE 01-05-2023
Subjects:
Additives
AI-suggestion
code-completion
Codes
Design methodology
inline-suggestion
iterative-refinement
Programming
refactoring
Systematics
User experience
Visualization
Online Access:Get full text
Tags: Add Tag
No Tags, Be the first to tag this record!
Description
Summary:AI-driven code editor extensions such as Visual Studio IntelliCode and Github CoPilot have become extremely popular. These tools recommend inserting chunks of code, with the lines to be inserted presented inline at the current cursor location as gray text. In contrast to their popularity, other AI-driven code recommendation tools that suggest code changes (as opposed to code completions) have remained woefully underused. We conducted lab studies at Microsoft to understand this disparity and found one major cause: discoverability. Code change suggestions are hard to surface through bold, inline interfaces and hence, developers often do not even notice them.Towards a systematic understanding of code change interfaces, we performed a thorough design exploration for various categories of code changes: additive single-line changes, single-line changes, and multi-line changes. Overall, we explored 19 designs through a series of 7 laboratory studies involving 61 programmers and distilled our findings into a set of 5 design principles. To validate our results, we built and deployed a new version of IntelliCode with two of our new inline interfaces in Microsoft Visual Studio 2022 and found that they lead to a significant increase in usage of the corresponding tools.
ISSN:2832-7659
DOI:10.1109/ICSE-SEIP58684.2023.00022