Garbage in, Garbage out? An Empirical Look at Oracle Mistakes by End-User Programmers

End-user programmers, because they are human, make mistakes. However, past research has not considered how visual end-user debugging devices could be designed to ameliorate the effects of mistakes. This paper empirically examines oracle mistakes 驴 mistakes users make about which values are right and which are wrong 驴 to reveal differences in how different types of oracle mistakes impact the quality of visual feedback about bugs. We then consider the implications of these empirical results for designers of end-user software engineering environments.