Code Shaping: Iterative Code Editing with Free-form Sketching

CHI 2025

Ryan Yen, Jian Zhao, Daniel Vogel

[ preprint] [ DOI] [ poster] [ video] [ Presentation]

Abstract

We present an initial step towards building a system for programmers to edit code using free-form sketch annotations drawn directly onto editor and output windows. Using a working prototype system as a technical probe, an exploratory study examines how programmers sketch to annotate Python code to communicate edits for an AI model to perform.

Discussion

I have posted some thoughts on about the insider scoop of this work on my blog, The Untold Story of Code Shaping.

Keywords

BibTeX

1
2
3
4
5
6
7
8
@inproceedings{yen2025codeshaping,
  title={Code Shaping: Iterative Code Editing with Free-form Sketching},
  author={Yen, Ryan and Zhao, Jian and Vogel, Daniel},
  booktitle={Proceedings of the 2025 CHI Conference on Human Factors in Computing Systems},
  year={2025},
  publisher={ACM},
  address={New York, NY, USA}
}