Roman Bednarik   citations [ :resume: ] [ :contact: ]
August 2003

I am a professor of interactive technologies at the School of Computing, University of Eastern Finland. Since 2012 I am an adjunct professor (docent) of interactive technologies at UEF. In 2013 I was a visiting scientist at the Simon Fraser University, and 2011 I was a visiting scholar at the School of Information Sciences, University of Pittsburgh. In 2007-2010 I was an assistant professor at the University of Joensuu.
I am interested in understanding and modeling of human behavior, cognition, learning, and interaction with computerized systems in general. My particular interests lie in applying eye-tracking to study and support thinking and interaction. In my PhD. work I investigated and used eye-movement recording as a measure of visual attention of computer programmers during program comprehension and debugging.

 Current 
  • A new funding from Academy of Finland! More support for our interdisciplinary team.
  • I received a competitive three-years project funding from the Emil Aaltonen Foundation!
  • Our Academy of Finland FIRST project continues conducting recordings in training and intra-operative microsurgical environments.
  • Nokia Foundation awarded me with Visiting Professor Award
  • A new project funded by the Academy of Finland on interoperative interactive technologies!
  • TEKES funded my project on Gaze in Medical Optical Technologies!
  • We launched a Distributed collection of eye-movement data in programming.
  • A joint paper with SFU and U.o.Alberta got "best of CHI honorable mention" award at ACM CHI'14.
  • Research:
    Eye-tracking methodology and data analysis
    Gaze in medical technologies, along with UEF Medical Optics Research Center
    Collaborative uses of eye-movement tracking, see MultiGaze
    Intelligent user interfaces
    Eye-movement biometrics (with Tomi Kinnunen and Filip Sedlak)
    Program Visualization (with Niko Myller, Andrés Moreno & Jeliot)
    Evaluating Educational Software Environments

  • Teaching: Eye-tracking, 2020

  • Thesis topics: I supervise and offer these topics for BSc/MSc theses and special projects.
  • Try TUP online, the evaluation tool cs.joensuu.fi/~tup
  • My shared links and recent photos.

 Past   Publications 

      Journals and Book Chapters
    1. Lee, A., Torkamani-Azar, M., Zheng, B., & Bednarik, R. (2023). Unpacking the Broad Landscape of Intraoperative Stressors for Clinical Personnel: A Mixed-Methods Systematic Review. Journal of Multidisciplinary Healthcare, 1953-1977.

    2. Afkari, H., & Bednarik, R. (2023). Seize the moment: the role of scrub nurses’ proactivity in microsurgical operating-room collaborations. Behaviour & Information Technology, 42(10), 1640-1657.

    3. Puustinen, S., Vrzáková, H., Hyttinen, J., Rauramaa, T., Fält, P., Hauta-Kasari, M., ... & Elomaa, A. P. (2023). Hyperspectral Imaging in Brain Tumor Surgery—Evidence of Machine Learning-Based Performance. World Neurosurgery.

    4. Koskinen, J., He, W., Elomaa, A. P., Kaipainen, A., Hussein, A., Zheng, B., ... & Bednarik, R. (2023). Utilizing Grasp Monitoring to Predict Microsurgical Expertise. Journal of Surgical Research, 282, 101-108.

    5. Torkamani-Azar, M., Lee, A., & Bednarik, R. Methods and Measures for Mental Stress Assessment in Surgery: A Systematic Review of 20 Years of Literature. IEEE journal of biomedical and health informatics.

    6. Hannonen, S, Andberg, S., et al. (2022). Shortening of Saccades as a Possible Easy-to-Use Biomarker to Detect Risk of Alzheimer´s Disease To appear in Journal of Alzheimer’s Disease, 2022.

    7. Tyni, J., Turunen, A., Kahila, J., Bednarik, R., & Tedre, M. (2022). Reward Types in Popular Recreational and Educational Mobile Games. IEEE Access, 11, 1166-1174.

    8. Tyni, J., Tarkiainen, A., López-Pernas, S., Saqr, M., Kahila, J., Bednarik, R., & Tedre, M. (2022). Games and Rewards: A Scientometric Study of Rewards in Educational and Serious Games. IEEE Access, 10, 31578-31585

    9. Koskinen, J., Torkamani-Azar, M., Hussein, A., Huotarinen, A. and Bednarik, R., 2022. Automated tool detection with deep learning for monitoring kinematics and eye-hand coordination in microsurgery. Computers in Biology and Medicine 141, 105121.

    10. Tolvanen, O., Elomaa, A.-P. A.-P., Itkonen, M., Vrzakova, H., Bednarik, R., and Huotarinen, A., 2022. Eye-tracking indivators of workload in surgery—A systematic review. Journal of Investigative Surgery. 1-10.

    11. Koskinen, J., Huotarinen, A., Elomaa, A.P., Zheng, B. and Bednarik, R., 2021. Movement-level process modeling of microsurgical bimanual and unimanual tasks. International Journal of Computer Assisted Radiology and Surgery, 1-10.

    12. Chainey, J., Zheng, B., Kim, M., Elomaa, A., Bednarik, R. and O’Kelly, C., 2021. C. 6 Action-Related Fixation in Microsuturing, a New Gaze Behavior Metric to Differentiate the Level of Expertise. Canadian Journal of Neurological Sciences 48 (s3), S19-S19.

    13. Chainey, J., Elomaa, A.P., O’Kelly, C.J., Kim, M.J., Bednarik, R. and Zheng, B., 2021. Eye-Hand Coordination of Neurosurgeons: Evidence of Action-Related Fixation in Microsuturing. World Neurosurgery 155, e196-e202

    14. Ogawa-Ochiai, K., Kiyokawa, T., Kiyomitsu, K., Bednarik, R., Mitani, Y. and Tsumura, N., 2021. Comparison of noncontact camera-based methods for measuring pulse-rate of awake infants. Artificial Life and Robotics, 1-8.

    15. Zheng, B., Jiang, X., Bednarik, R. and Atkins, M.S., 2021. Action-related eye measures to assess surgical expertise. BJS Open 5 (5), zrab068.

    16. Chitalkina, N., Puurtinen, M., Gruber, H. and Bednarik, R., 2021. Handling of incongruences in music notation during singing or playing. International Journal of Music Education 39 (1), 18-38

    17. Koskinen, J., Bednarik, R., Vrzakova, H. and Elomaa, A.P., 2020. Combined Gaze Metrics as Stress-Sensitive Indicators of Microsurgical Proficiency. Surgical Innovation 27 (6), 614-622.

    18. Bednarik, R., Busjahn, T., Gibaldi, A., Ahadi, A., Bielikova, M., Crosby, M., Essig, K., Fagerholm, F., Jbara, A., Lister, R. and Orlov, P., 2020. EMIP: The eye movements in programming dataset. Science of Computer Programming, 198, p.102520

    19. Sharafi, Z., Sharif, B., Guéhéneuc, Y.G., Begel, A., Bednarik, R. and Crosby, M., 2020. A practical guide on conducting eye tracking studies in software engineering. Empirical Software Engineering 25 (5), 3128-3174.

    20. Puustinen, S., Alaoui, S., Bartczak, P., Bednarik, R., Koivisto, T., Dietz, A., von Und Zu Fraunberg, M., Iso-Mustajärvi, M. and Elomaa, A.P., 2020. Spectrally Tunable Neural Network-Assisted Segmentation of Microneurosurgical Anatomy. Frontiers in Neuroscience 14, 640.

    21. Vrzakova, H., Begel, A., Mehtätalo, L., & Bednarik, R. (2020). Affect recognition in code review: An in-situ biometric study of reviewer’s affect. Journal of Systems and Software, 159,

    22. Gil De Gómez Pérez, D., Bednarik, R.: POnline: An Online Pupil Annotation Tool Employing Crowd-sourcing and Engagement Mechanisms. Human Computation 6:1:176-191, 2019.

    23. Eivazi, S., Hafez, A., Fuhl, W., Afkari, H., Kasneci, E., Lehecka, M., Bednarik, R.: Optimal eye movement strategies: a comparison of neurosurgeons gaze patterns when using a surgical microscope. Acta Neurochirurgica, 2017.

    24. Orlov, P., Bednarik, R.: The role of extrafoveal vision in source code comprehension Perception 46(5), 2017.

    25. Afkari, H., Bednarik, R., Makela, S., Eivazi, S.: Mechanisms for Maintaining Situation Awareness in Micro-Neurosurgical Operating Room. International Journal of Human-Computer Studies, 2016. http://dx.doi.org/10.1016/j.ijhcs.2016.05.004

    26. Kajan, R., Herout, A., Bednarik, R., Povolny, F.: PeepList: Adapting Ex-Post Interaction with Pervasive Display Content Using Eye Tracking. Pervasive and Mobile Computing, 2016. http://dx.doi.org/10.1016/j.pmcj.2015.12.004

    27. Eivazi, S., Bednarik, R., Leinonen, V., von und Fraunberg, M., Jaaskelainen, J. E.: Embedding an Eye Tracker into a Surgical Microscope: Requirements, Design, and Implementation. IEEE Sensors, 2015. http://dx.doi.org/10.1109/JSEN.2015.2501237

    28. Orlov, P., Bednarik, R.: ScreenMasker: An open-source gaze-contingent screen masking environment. Behaviour Research Methods 48(3), 2016.

    29. Eivazi, S., Afkari, H., Bednarik, R., Leinonen, V., Tukiainen, M., Jaaskelainen, J.: Analysis of disruptive events and precarious situations caused by interaction with neurosurgical microscope. Acta Neurochirurgica 157(7), pp- 1147-1154, 2015. http://dx.doi.org/10.1007/s00701-015-2433-5

    30. Jiang, X., Zheng, B., Bednarik, R., Atkins, M.S.: Pupil responses to continuous aiming movements. International Journal of Human-Computer Studies 83, pp 1-11, 2015. http://dx.doi.org/10.1016/j.ijhcs.2015.05.006

    31. Bednarik, R., Krohns, J.: User-centered design practice and adoption in smaller ICT companies in Eastern Finland: An Interview Study. International Journal of Business Information Systems, 18(3), pp. 285- 298, 2015.

    32. Bednarik, R., Eivazi, S., Vrzakova, H.: A computational approach for prediction of problem-solving behavior using Support Vector Machines and eye-tracking data. In Eye Gaze in Intelligent User Interfaces - Gaze-based Analyses, Models, and Applications, Springer, pp. 111-134, 2013. ISBN 978-1-4471-4783-1. http://dx.doi.org/ 10.1007/978-1-4471-4784-8_7

    33. Bednarik, R., Gowases, T., Tukiainen, M.: Gaze-augmented interaction improves problem-solving: new evidence from verbal protocols. Behaviour & Information Technology 32 (8), 2013. http://dx.doi.org/10.1080/0144929X.2012.659216

    34. Bednarik, R.: Expertise-dependent Visual Attention Strategies Develop Over Time During Debugging with Multiple Code Representations. International Journal of Human - Computer Studies 70 (2012), pp. 143-155. http://dx.doi.org/10.1016/j.ijhcs.2011.09.003

    35. Ben-Ari, M., Bednarik, R., Ben-Bassat Levy, R., Ebel, G., Moreno, A., Myller, N., Sutinen, E.: A decade of research and development on program animation: The Jeliot experience. Journal of Visual Languages and Computing, 22, pp 375 - 384, 2011. doi:10.1016/j.jvlc.2 011.04.004

    36. Bednarik, R., Gowases, T., Tukiainen, M.: Gaze interaction enhances problem solving: Effects of dwell-time based, gaze-augmented, and mouse interaction on problem-solving strategies and user experience. Journal of Eye Movement Research, 3(1)3, 1-10, 2009. Available online: http://www.jemr.org/online/3/1/3

    37. Myller, N., Bednarik, R., Ben-Ari, M., Sutinen, E.: Extending the Engagement Taxonomy: Software Visualization and Collaborative Learning. ACM Transactions on Computing Education, 9(1), article 7, 2009.

    38. Randolph, J. J., & Bednarik, R.: Publication bias in the computer science education literature. Journal of Universal Computer Science, 14(4), 2008, pp. 575-589.

    39. Randolph, J. J., Rogers, P. C., Kakkonen, T., Myller, N., & Bednarik, R.: Emerging technologies for educational evaluation. In M. Ortiz & C. Rubio (Eds.) Educational Evaluation: 21st Century Issues and Challenges. Hauppauge, NY: Nova, 2009, pp. 417-442.

    40. Randolph, J.J., Julnes, G., Bednarik, R., & Sutinen, E.: A comparison of the methodological quality of articles in computer science education journals and conference proceedings. Computer Science Education, 17(4), 2007, pp. 263-274.

    41. Bednarik, R., Randolph, J.: Studying Cognitive Processes in Computer Program Comprehension. In Hammoud, R. I. (Ed): Passive Eye Monitoring: Algorithms, Applications and Experiments, Springer, ISBN 9783540754114, pp. 373-386, 2008.

    42. Bednarik, R., Moreno, A., Myller, N.: Program Visualization for Programming Education - Case of Jeliot 3. ACM NZ Bulletin, 2(2), ISSN 1176-9998, 2006. Avalailable online from http://is-alt.massey.ac.nz/acmnz/bulletin/vol2/issue2/

    43. Bednarik, R., Moreno, A., Myller, N.: Various Utilizations of an Open-Source Program Visualization Tool, Jeliot 3. Informatics in Education 5(2), 2006, pp. 195-206.

    44. Bednarik, R., Tukiainen, M.: Validating the Restricted Focus Viewer: A Study Using Eye-Movement Tracking. Behavior Research Methods, 39(2), 2007, pp. 274-282. Available online: http://brm.psychonomic-journals.org/content/39/2/274.full.pdf

    45. Bednarik, R., Myller, N., Sutinen, E., Tukiainen, M.: Analyzing Individual Differences in Program Comprehension. Technology, Instruction, Cognition and Learning (TICL), 3 (3-4), special issue on modeling and simulation, 2006, pp. 205-232.

      Books and Edited Proceedings
    46. Tamm, S., Bednarik, R., Busjahn, T., Schulte, C., Vrzakova, H., Budde, L. (Eds.): Eye Movements in Programming: Spring Academy 2017. Freie Universität Berlin, Department of Mathematics and Computer Science, Berlin, Germany, Technical Report TR-B-17-02, 2017. PDF

    47. Bednarik, R.; Busjahn, T.; Schulte, C.; Tamm, S. (Eds.): Eye Movements in Programming: Models to Data. University of Eastern Finland, Joensuu, Finland: Reports and Studies in Forestry and Natural Sciences, no 23, 2016. (ISBN: 978-952-61-2040-9)

    48. Busjahn, T., Schulte, C., Tamm, S., Bednarik, R.: Eye Movements in Programming Education II: Analyzing the Novice’s Gaze. Freie Universität Berlin, TR-B-15-01, 2015. PDF

    49. Huang, H.-H., Bednarik, R., Jokinen, K., Nakano, Y.: Gaze-in 2014: the 7th Workshop on Eye Gaze in Intelligent Human Machine Interaction. In Proceedings of the 16th International Conference on Multimodal Interaction (ICMI '14). ACM, New York, NY, USA, 527-528.

    50. Bednarik, R., Busjahn, T., Schulte, C.: Eye Movements in Programming Education: Analyzing the Expert's Gaze. Publications of the University of Eastern Finland. Reports and Studies in Forestry and Natural Sciences, no 18, ISBN: 978-952-61-1539-9. PDF

    51. Bednarik, R., Huang, H.-H., Nakano, Y., Jokinen, K.: GazeIn'13 -The 6th Workshop on Eye Gaze in Intelligent Human Machine Interaction. http://dx.doi.org/10.1145/2522848.2535892, 2013, ACM.

    52. Bednarik, R.: Computer Science Days 2010, the proceedings of the conference Tietojenkasittelytieteen paivat 2010, in Publications of the University of Eastern Finland. Reports and Studies in Forestry and Natural Sciences, vol 2, 2010. ISBN 978-952-61-0130-9.

    53. Buckley, J., Rooksby, J., Bednarik, R.: Proceedings of the 20th Annual Workshop of the Psychology of Programming Interest Group (PPIG08). Lancaster, UK, 2008. Lancaster University, ISBN 978-1-86220-215-3.

    54. Sajaniemi, J., Tukiainen, M., Bednarik, R., Nevalainen, S.: Proceedings of the 19th Annual Workshop of the Psychology of Programming Interest Group (PPIG07). Joensuu, Finland, July, 2007. International Proceedings Series 7, University of Joensuu, Department of Computer Science and Statistics.

      International Conferences with Referee Procedure
    55. Moustafa, R. S., Karhu, H., Andberg, S., & Bednarik, R. (2023, May). Seeing Through Their Eyes-A Customizable Gaze-Contingent Simulation of Impaired Vision and Other Eye Conditions Using VR/XR Technology. In Proceedings of the 2023 Symposium on Eye Tracking Research and Applications (pp. 1-2).

    56. Bednarik, R., Blandford, A., Feng, F., Huotarinen, A., Iso-Mustajärvi, M., Lee, A., ... & Zheng, B. (2022, April). Integration of Human Factors in Surgery: Interdisciplinary Collaboration in Design, Development, and Evaluation of Surgical Technologies. In CHI Conference on Human Factors in Computing Systems Extended Abstracts (pp. 1-7)

    57. Lee, A. and Bednarik, R., 2021. 3D Exoscopes in Microsurgery: How 3D Exoscopes Reconfigure the Workflow of Assistant Surgeons and Nurses in the Operating Room. Companion Publication of the 2021 Conference on Computer Supported Cooperative Work and Social Computing, 112-116.

    58. Bednarik, R., Vrzakova, H., Elomaa, A.P. and Skön, J.P., 2020. Experts in Medical Computing: Designing a continuous education program with clinical relevance and industrial applicability. 2020 IEEE Frontiers in Education Conference (FIE), 1-5.

    59. Koskinen, J. and Bednarik, R., 2020. Gaze-grabber distance in expert and novice forest machine operators: the effects of automatic boom control. ACM Symposium on Eye Tracking Research and Applications, 1-7.

    60. Chitalkina, N., Bednarik, R., Puurtinen, M. and Gruber, H., 2020. When you ignore what you see: How to study proof-readers’ error in pseudocode reading. ACM Symposium on Eye Tracking Research and Applications, 1-5.

    61. Chitalkina, N., Bednarik, R., Puurtinen, M. and Gruber, G., 2019. Prediction as a prerequisite of skilled reading: The cases of source-code and music notation. Proceedings of the 19th Koli Calling International Conference on Computing Education Research.

    62. Kiyokawa, T; Kiyomitsu, K; Bednarik, R; Ogawa-Ochi, K; Tsumura, N. : Comparison of non-contact camera based methods to measure the pulse rate for awake infants. 26th Color and Imaging Conference: Color Science and Engineering Systems, Technologies, and Applications, CIC 2018. https://doi.org/10.2352/ISSN.2169-2629.2018.26.157

    63. Bednarik, R., Budde, L., Heinemann, B., Schulte, C., Vrzakova, H.: Eye-movement Modeling Examples in Source Code Comprehension: A Classroom Study. To appear in Koli Calling, 2018. ACM.

    64. Bednarik, R., Koskinen, J., Vrzakova, H., Bartczak, P., Elomaa, A-P.: Blink-based estimation of suturing task workload and expertise in microsurgery. 2018 IEEE 31st International Symposium on Computer-Based Medical Systems, pp. 233-238. https://doi.org/10.1109/CBMS.2018.00048 PDF

    65. Bartczak, P., Iso-Mustajärvi, M., Vrzakova, H., Bednarik, R., Fraunberg, M., Elomaa, A-P.: Portable System for On-site Spectral Imaging: Pre-Clinical Development and Early Evaluation 2018 IEEE 31st International Symposium on Computer-Based Medical Systems. PDF

    66. Bartczak, P., Vrzakova, H., Bednarik, R., Iso-Mustajärvi, M., ..., Elomaa, A-P.: Spectral Video in Image-guided Microsurgical Applications: Integrating Imaging Technology into the Clinical Environment and Ergonomic Considerations. 2018 IEEE 31st International Symposium on Computer-Based Medical Systems. PDF

    67. Leppänen, T., Vrzakova, H., Bednarik, R., Kanervisto, A., Elomaa, A-P., et al.: Augmenting Microsurgical Training: Microsurgical Instrument Detection using Convolutional Neural Networks. 2018 IEEE 31st International Symposium on Computer-Based Medical Systems, pp. 211-216. https://doi.org/10.1109/CBMS.2018.00044 PDF

    68. Bednarik, R., Bartczak, P., Vrzakova, H., Elomaa, A-P., Koskinen, J., et al.: Pupil size as an indicator to visual-motor workload and expertise in microsurgical training tasks. In Proceedings of the 2018 ACM Symposium on Eye Tracking Research & Applications (p. 60). ACM.

    69. Gil de Gómez Pérez, D., Suokas, M., Bednarik, R.: Crowdsourcing pupil annotation datasets: boundary vs. center, what performs better? In Proceedings of the 7th Workshop on Pervasive Eye Tracking and Mobile Eye-Based Interaction (p. 3). ACM

    70. Afkari, H., Gil de Gómez, D., Bednarik, R.: Command Selection in Gaze-based See-through Virtual Image-Guided Environments Proceedings of the 9th Augmented Human International Conference, 2018. https://doi.org/10.1145/3174910.3174940

    71. Gil de Gómez, D., Bednarik, R.: CrowdPupil: A crowdsourced, pupil-center annotated image dataset In Proceedings of Cogain 2017

    72. Orlov, P., Bednarik, R., Orlova, L.: Programmers' experiences with working in the restricted-view mode as indications of parafoveal processing differences In Proceedings of PPIG 2016.

    73. Zheng, B., Jiang, X., Bednarik, R., Atkins, M. S.: Gaze Characteristics of Video Watching in a Surgical Setting IEEE 2nd Workshop on Eye Tracking and Visualization, pp- 11-15, 2016. https://doi.org/10.1109/ETVIS.2016.7851158

    74. Quang, D. N., Vrzakova, H., Bednarik, R.: WTP: Web-Tracking Plugin for Real-time Automatic AOI Annotations In Proceedings of PETMEI 2016.

    75. Gebejes, A., Fält, P., Bednarik, R., Hauta-Kasari, M.: SPEED: Spectral Eye Video Database In Proceedings of UbiComp '16 Proceedings of the 2016 ACM International Joint Conference on Pervasive and Ubiquitous Computing: Adjunct, pp. 1666-1675. https://doi.org/10.1145/2968219.2968335

    76. Vrzakova, H., Bednarik, R., Nakano, Y., Nihei, F.: Speakers' head and gaze dynamics weakly correlate in group conversation Proceedings of the Ninth Biennial ACM Symposium on Eye Tracking Research & Applications, pp. 77-84, ACM, 2016. http://dx.doi.org/10.1145/2857491.2857522

    77. Vrzakova, H., Bednarik, R.: Quiet Eye Affects Action Detection from Gaze more than Context Length In 2015 User Modelling, Adaptation and Personalization, pp. 277-288. PDF http://dx.doi.org/10.1007/978-3-319-20267-9_23

    78. Busjahn, T., Bednarik, R., Begel, A., Crosby, M., Peterson J., Schulte, C., Sharif, B., Tamm, S.: Eye Movements in Code Reading: Relaxing the Linear Order 23rd IEEE International Conference on Program Comprehension., 2015. PDF

    79. Vrzakova, H., Bednarik, R., Nihei, F., Nakano, Y.: Influential statements and gaze for persuasion modeling In the 8th Nordic Conference on Human-Computer Interaction, 2014., pp. 915-918, PDF http://dx.doi.org/10.1145/2639189.2670192

    80. Afkari, H., Eivazi, S., Bednarik, R., Makela, S.: The Potentials for Hands-free Interaction in Micro-neurosurgery In the 8th Nordic Conference on Human-Computer Interaction, 2014, pp. 401-410, http://dx.doi.org/10.1145/2639189.2639213 PDF

    81. Orlov, P., Bednarik, R.: Low-cost Latency Measurement System for Eye-mouse Software In the 8th Nordic Conference on Human-Computer Interaction, 2014, pp. 1085-1088, http://doi.acm.org/10.1145/2639189.2670282

    82. Busjahn, T., Schulte, C., Sharif, B., Simon, Begel, A., et al.: Eye tracking in computing education. In Proceedings of the tenth annual conference on International computing education research (ICER '14). ACM, pp. 3-10. http://doi.acm.org/10.1145/2632320.2632344

    83. Malmi, L., Sheard, J., Simon, Bednarik, R., et al.: Theoretical Underpinnings of Computing Education Research ? What is the Evidence? Accepted to ACM ICER 2014.

    84. Jiang, X., Atkins, M. S., Tien, G., Bednarik, R., and Zheng, B.: Pupil Responses during Discrete Goal-directed Movements. In Proceedings of the 32nd annual ACM conference on Human factors in computing systems (CHI '14). ACM, New York, NY, USA, 2075-2084. http://dx.doi.org/10.1145/2556288.2557086. Best of CHI honorable mention.

    85. Jiang X., Atkins, M. S., Tien, G, Zheng, B., Bednarik, R.: Pupil dilations during target-pointing respect Fitt's Law. In Proceedings of the Symposium on Eye Tracking Research and Applications (ETRA '14). ACM, New York, NY, USA, 175-182. http://doi.acm.org/10.1145/2578153.2578178

    86. Dao, C., Bednarik, R., Vrzakova, H.: Heatmap Rendering from Large-scale Distributed Datasets using Cloud Computing. In Proceedings of the Symposium on Eye Tracking Research and Applications (ETRA '14). ACM, New York, NY, USA, 215-218. http://doi.acm.org/10.1145/2578153.2578187

    87. Tien, J., Atkins, M. S., Jiang, X., Zheng, B., Bednarik, R.: Verbal gaze instruction matches visual gaze guidance in laparoscopic skills training. In Proceedings of the Symposium on Eye Tracking Research and Applications (ETRA '14). ACM, New York, NY, USA, 331-334. http://doi.acm.org/10.1145/2578153.2578217

    88. Busjahn, T., Bednarik, R., Schulte, C.: What influences dwell time during source code reading? Analysis of element type and frequency as factors In Proceedings of the Symposium on Eye Tracking Research and Applications (ETRA '14). ACM, New York, NY, USA, 335-338. http://doi.acm.org/10.1145/2578153.2578211

    89. Bednarik, R., Kauppinen, M.: Unravelling the Interaction Strategies and Gaze in Collaborative Learning with Online Video Lectures. In proceedings of GazeIn'13 -The 6th Workshop on Eye Gaze in Intelligent Human Machine Interaction, http://dx.doi.org/10.1145/2535948.2535959, ACM, 20013.

    90. Vrzakova, H., Bednarik, R.: EyeCloud: Cloud Computing for Pervasive Eye-Tracking In the proceedings of PETMEI 2013, 3rd International Workshop on Pervasive Eye Tracking and Mobile Eye-Based Interaction, 2013. PDF

    91. Vrzakova, H., Bednarik, R.: That's not Norma(n/l)! A Detailed Analysis of Midas Touch in Gaze-based Problem-solving To appear in the proceedings of ACM CHI'13, 2013. PDF

    92. Mäkelä, S., Bednarik, R., Tukiainen, M.: Evaluating User Experience of Autistic Children through Video Observation. To appear in the proceedings of ACM CHI'13, 2013.

    93. Erkut, C., Bednarik, R., M‰kel‰, S., Kleimola, J.: Apps for Me, Too: Gaze and Natural Interaction Applications for Varying Cognitive Strengths on a Multi-touch Table Network To appear in the proceedings of the Gaze Interaction in the Post-WIMP World Workshop, CHI'13, 2013.

    94. Vrzakova, H., Bednarik, R.: Fast and Comprehensive Extension to Intention Prediction from Gaze In the proceedings of IUI2013 Second Workshop on Interacting with Smart Objects, 2013. PDF.

    95. Bednarik, R., Orlov, P.: Investigating the role of programmers' peripheral vision: a gaze-contingent tool and an experiment proposal. In the proceedings of Psychology of Programming Interest Group PPIG 2012. PDF.

    96. Wang, P., Bednarik, R., Moreno, A.: During automatic program animation, explanations after animations have greater impact than before animations. In Proceedings of the 12th Koli Calling International Conference on Computing Education Research, pp. 100-109, 2012 http://dx.doi.org/10.11 45/2401796.2401808

    97. Bednarik, R., Herout, A.: What Students Want: A Study on the Role of Supervisor of Final Works in Computing Education . In Proceedings of the 12th Koli Calling International Conference on Computing Education Research, pp. 118-125, 2012 http://dx.doi.org/10.11 45/2401796.2401811

    98. Bednarik, R., Eivazi, S., Hradis, M.: Gaze and Conversational Engagement in Multiparty Video Conversation: An annotation scheme and classification Gaze-In '12 Proceedings of the 4th Workshop on Eye Gaze in Intelligent Human Machine Interaction, Article 10, 2012. http://dx.doi.org/10.1145/2401836.2401846

    99. Vrzakova, H., Bednarik, R.: Hard lessons learned: Mobile eye-tracking in cockpits Gaze-In '12 Proceedings of the 4th Workshop on Eye Gaze in Intelligent Human Machine Interaction, Article 7, 2012. http://dx.doi.org/10.1145/2401836.2401843

    100. Bednarik, R., Shipilov, A.: Usability of gaze-transfer in collaborative programming: How and when could it work, and some implications for research agenda. In proceedings of DUET 2012, Dual Eye-Tracking in CSCW. PDF

    101. Bednarik, R., Vrzakova, H., Hradis, M.: What you want to do next: A novel approach for intent prediction in gaze-based interaction. In proceedings of ETRA'12, pp. 83-90. http://dx.doi.org/10.11 45/2168556.2168569 Best paper honorable mention.

    102. Hradis, M., Eivazi, S., Bednarik, R.: Voice activity detection in video mediated communication from gaze. In proceedings of ETRA'12, pp. 329-332. http://dx.doi.org/10.11 45/2168556.2168628

    103. Eivazi, S., Bednarik, R., Tukiainen, M., von und zu Fraunberg, M., Leinonen, V., J‰‰skel‰inen J.: Gaze Behaviour of Expert and Novice Microneurosurgeons Differs During Observations of Tumor Removal Recordings. In proceedings of 2012 ACM ETRA'12, pp. 377-380. http://dx.doi.org/10.11 45/2168556.2168641

    104. Bednarik, R., Shipilov, A.: Gaze Cursor During Distant Collaborative Programming: A Preliminary Analysis. In the proceedings of DUET 2011: Dual Eye Tracking in CSCW, 2011. ECSCW 2011. PDF

    105. Gowases, T., Bednarik, R., Tukiainen, M.: Text highlighting improves user experience for reading with magnified displays. In the proceedings of Extended Abstracts of ACM CHI, pp. 1891-1896, 2011. http://dx.doi.org/10.1145/1979742.1979917

    106. Bednarik, R., Shipilov, A., Pietinen, S.: Bidirectional Gaze in Remote Computer Mediated Collaboration: Setup and Initial Results from Pair-Programming In the proceedings of the Computer Supported Cooperative Work, CSCW, ACM, pp. 597-600, 2011. http://dx.doi.org/10.1145/1958824.1958923

    107. Eivazi, S., Bednarik, R.: Predicting Problem-Solving Behavior and Performance Levels from Visual Attention Data In the proceedings of 2nd Workshop on Eye Gaze in Intelligent Human Machine Interaction at IUI 2011, pp 9-16, 2011. PDF

    108. Eivazi, S., Bednarik, R.: Inferring Problem Solving Strategies Using Eye-Tracking: System Description and Evaluation. Proceedings of the 10th Koli Calling International Conference on Computing Education Research. Koli Calling'10, New York, NY, USA, ACM, 2010, pp. 55-61, http://dx.doi.org/10.1145/1930464.1930472

    109. Malmi, L., Sheard, J., Simon, Bednarik, R., Helminen, J., Korhonen, A., Myller, N., Sorva, J., Taherkhani, A.: Characterizing research in computing education: a preliminary analysis of the literature. In the proceedings of ACM ICER 2010, pp. 3-12. http://doi.acm.org/10.1145/1839594.1839597

    110. Pietinen, S., Bednarik, R. and Tukiainen, M.: Eye-tracking in Collaborative settings: Setup and Descriptive analysis. The 5th Scandinavian Workshop on Applied Eye-Tracking, SWAET 2010, Lund University, May 5-7 2010, p. 38.

    111. Pietinen, S., Bednarik, R., Tukiainen, M.: Shared Visual Attention in Collaborative Programming: A Descriptive Analysis. ACM/IEEE 32nd International Conference on Software Engineering, ICSE 2010, Cooperative and Human Aspects of Software Engineering, CHASE 2010, Workshop at the ICSE 2010, May 2nd 2010, Cape Town, South Africa.

    112. Kinnunen, T., Sedlak, F., Bednarik, R.: Towards Task-Independent Person Authentication Using Eye Movement Signals. In the Proceedings of the 2010 Symposium on Eye-Tracking Research & Applications, ETRA'10, ACM, pp. 187-190.

    113. Pietinen, S., Bednarik, R., Tukiainen, M.: An Exploration of Shared Visual Attention in Collaborative Programming. In Proceedings of the 21th Annual Workshop of the Psychology of Programming Interest Group (PPIG'09), Limerick, Ireland, pp. 134-135. Available online: http://www.ppig.org/papers/21st-pietinen.pdf

    114. Duveskog, M., Bednarik, R., Sutinen, R., Kemppainen, K.: Designing a Story-Based Platform for HIV/AIDS Counseling with Tanzanian Children. In Proceedings of the 8th ACM International Conference on Interaction Design and Children, pp. 27-35, 2009.

    115. Gowases, T., Bednarik, R., Tukiainen, M.: Gaze vs. Mouse in Games: The Effects on User Experience. In Proceedings of The 16th International Conference on Computers in Education, ICCE 2008, pp. 773 - 777.

    116. Nuutinen, J., Bednarik, R., Sutinen, E.: A Layered Approach to the Development Process of Social Mindtools. In Proceedings of ED-Media 2008, pp. 2109-2118.

    117. Bednarik, R., Tukiainen, M.: Temporal Eye-Tracking Data: Evolution of Debugging Strategies with Multiple Representations. In Proceedings of the 2008 Symposium on Eye Tracking Research & Applications (Savannah, Georgia, March 26 - 28, 2008). ETRA '08. ACM, New York, NY, pp. 99-102.

    118. Pietinen, S., Bednarik, R., Glotova, T., Tenhunen, V., Tukiainen M.: A Method to Study Visual Attention Aspects of Collaboration: Eye-Tracking Pair Programmers Simultaneously. In Proceedings of the 2008 Symposium on Eye Tracking Research & Applications (Savannah, Georgia, March 26 - 28, 2008). ETRA '08. ACM, New York, NY, pp. 39-42.

    119. Moreno, A., Sutinen, E., Bednarik, R. and Myller, N. (2007): Conflictive animations as engaging learning tools. In Proc. Seventh Baltic Sea Conference on Computing Education Research (Koli Calling 2007), Koli National Park, Finland. CRPIT, 88. Lister, R. and Simon, Eds., ACS. pp. 203-206.

    120. Bednarik, R., Tukiainen, M.: Analysing and Interpreting Quantitative Eye-Tracking Data in Studies of Programming: Phases of Debugging with Multiple Representations. In Proceedings of the 19th Annual Workshop of the Psychology of Programming Interest Group (PPIG'07), Joensuu, Finland, July 2-6, 2007, pp. 158-172.

    121. Myller, N., Bednarik, R., Moreno, A.: Integrating Dynamic Program Visualization into BlueJ: the Jeliot 3 extension. In proceedings of IEEE ICALT 2007, IEEE Computer Society, 2007, pp. 505-506.

    122. Moreno, A., Bednarik, R., Yudelson, M.: How to Adapt the Visualization of Programs? UM'2007 workshop 2, 11th International Conference on User Modeling: Personalisation in e-learning environments at individual and group level, PING'07. Corfu, Greece, June 25-29, 2007, pp. 65-70.

    123. Bednarik, R., Kamppuri, M., Tedre, M., Vesisenaho, M.: Alternative to Technology-Driven Development: An Approach Based on Authentic Needs. Presented at the Workshop on User Centred Design and International Development to be held on 28th April 2007, CHI2007.

    124. Kamppuri, M., Bednarik, R., Tukiainen, M.: The Expanding Focus of Design: Case Culture. In proceedings of NordiCHI 2006, The Fourth Nordic Conference on Human-Computer Interaction. Oslo, Norway, 2006, ACM Press, pp. 405-408.

    125. Bednarik, R., Myller, N., Sutinen, E., Tukiainen, M.: Program Visualisation: Comparing Eye-tracking Patterns with Comprehension Summaries and Performance. In proceedings of the 18th Annual Workshop of the Psychology of Programming Interest Group (PPIG'06), Brighton, UK, September 7-8, 2006, pp. 68-82.

    126. Myller, N., Bednarik, R.: Methodologies for Studies of Program Visualization. In proceedings of Methods, Materials and Tools for Programming Education (MMT2006), Tampere, Finland, May 4-5, 2006, pp. 37-42.

    127. Bednarik, R., Tukiainen, M.: An Eye-tracking Methodology for Characterizing Program Comprehension. In Proceedings the 2006 Symposium on Eye Tracking Research and Applications, ETRA 2006, March 27-29, San Diego, CA, USA, ACM Press, pp. 125 - 132.

    128. Randolph, J. J., Bednarik, R. and Myller, N.: A Methodological Review of the Articles Published in the Proceedings of Koli Calling 2001-2004. In Proceedings of Koli Calling 2005: 5th Annual Finnish / Baltic Sea Conference on Computer Science Education. November 17 - November 20, 2005, pp. 103-109.

    129. Moreno, A., Myller, N. and Bednarik, R.: Jeliot 3, an Extensible Tool for Program Visualization. In Proceedings of Koli Calling 2005: 5th Annual Finnish / Baltic Sea Conference on Computer Science Education. November 17 - November 20, 2005, pp. 183-184.

    130. Bednarik, R., Joy, M., Moreno, A., Myller, N., Sun, S., Sutinen, E.: Multi-Agent Educational System for Program Visualization. In proceedings of the International Conference on Intelligent Agents, Web Technology and Internet Commerce (IAWTIC'2005), 28 - 30 November 2005, Vienna, Austria, IEEE Computer Society, pp. 283 - 288.

    131. Bednarik, R., Myller, N., Sutinen, E., Tukiainen, M.: Applying Eye-Movement Tracking to Program Visualization. In proceedings of 2005 IEEE Symposium on Visual Languages and Human-Centric Computing (VL/HCC'05), Dallas, Texas, USA, September 21-24, 2005, IEEE Computer Society, pp. 302-304.

    132. Bednarik, R.: Potentials of Eye-Movement Tracking in Adaptive Systems. In the Proceedings of the Fourth Workshop on the Evaluation of Adaptive Systems, held in conjunction with the 10th International Conference on User Modeling (UM'05), Edinburgh, UK, July 24th to 30th, 2005, pp. 1-8.

    133. Bednarik, R., Myller, N., Sutinen, E., Tukiainen, M.: Effects of Experience on Gaze Behaviour during Program Animation. In proceedings of the 17th Annual Psychology of Programming Interest Group Workshop (PPIG'05), Brighton, UK, June 28 - July 1, 2005, pp. 49-61.

    134. Randolph, J. J., Bednarik, R., Silander, P., Gonzalez, J., Myller, N., and Sutinen, E.: A Critical Analysis of the Research Methodologies Reported in the Full Papers of the Proceedings of ICALT 2004. In proceedings of the 5th IEEE International Conference on Advanced Learning Technologies (ICALT 2005), Kaohsiung, Taiwan, July 5-8, 2005, IEEE Computer Society, pp. 10-14.

    135. Bednarik, R., Moreno, A., Myller, N., Sutinen, E.: Smart Program Visualization Technologies: Planning a Next Step. In proceedings of the 5th IEEE International Conference on Advanced Learning Technologies (ICALT 2005), Kaohsiung, Taiwan, July 5-8, 2005, IEEE Computer Society, pp. 717-721.

    136. Bednarik, R., Kinnunen, T., Mihaila, A., Fr‰nti, P.: Eye-Movements as a Biometric. In Proceedings of the 14th Scandinavian Conference on Image Analysis, SCIA 2005, Joensuu, Finland, June 19-22, 2005. Lecture Notes in Computer Science, Vol. 3540, Springer, 2005, pp. 780-789.

    137. Bednarik, R., Tukiainen, M.: Effects of Display Blurring on the Behavior of Novices and Experts during Program Debugging. In CHI '05 extended abstracts on Human factors in computing systems, CHI 2005, Portland, Oregon, USA, April 2-7, 2005, ACM Press, pp. 1204-1207.

    138. Bednarik, R., Tukiainen, M.: Visual Attention Tracking During Program Debugging. In Proceedings of NordiCHI 2004, The Third Nordic Conference on Human-Computer Interaction, October 23-27, 2004, Tampere, Finland, ACM Press, pp. 331-334.

    139. Bednarik, R. & Tukiainen, M.: Visual Attention and Representation Switching in Java Program Debugging: A Study Using Eye Movement Tracking. In Proceedings of 16th Annual Psychology of Programming Interest Group Workshop (PPIG'04), Institute of Technology Carlow, Ireland, April 5-7, 2004, pp. 159-169.

    140. Bednarik, R., Fr‰nti, P.: Survival of Students with Different Learning Preferences. The 4th Annual Finnish / Baltic Sea Conference on Computer Science Education, Koli, Finland, October 1-3, 2004, pp. 121-125.

    141. Bednarik, R., Gerdt, P., Miraftabi, R., Tukiainen, M.: Development of the TUP Model - Evaluating Educational Software. In Proceedings of the 4th IEEE International Conference on Advanced Learning Technologies (ICALT 2004), Joensuu, Finland, August 30 - September 1, 2004, IEEE Computer Society, pp. 699-701.

    142. Bednarik, R.: Problem-Based Learning in Teaching Theoretical Computer Science. In Proceedings of the International Conference on Engineering Education and Research Conference iCEER 2004, Olomouc, Czech Republic, June 27-30, 2004, pp. 801-807, CD-ROM.

      National Conferences with Referee Procedure
    143. Bednarik, R., Marjomaa E., La Russa, G.: Logical Variability in Tutors and Evaluators. In Proceedings of the ITK'04 Workshop on Educational Technology Research, April 20-22, H‰meenlinna, Finland, 2005. pp. 48-49.

      Tutorials and Technical Reports, Other Publications
    144. Tsukuda, M., Bednarik, R., Hauta-Kasari, M., Nakauchi, S.: Static cues for mirror-glass discrimination explored by gaze distribution. In European Conference on Visual Perception, ECVP 2016.

    145. Bednarik, R., Kinnunnen, T., Eivazi, S., Sedlak, F., & Vrzakova, H.: Beyond AOIs: Classification and prediction methods in gaze data analysis in biometrics, problem solving, and interaction.. ECEM 2011.

    146. Kamppuri, M., Bednarik, R. and Juntunen, A.: Haasteena k‰ytett‰vyys: Kotihoitoa tukevat et‰palvelut-hankkeen k‰ytett‰vyystutkimus. [in Finnish, Usability as a challenge. Usability study of eHealth Services Supporting Home Care - project]. Kajaani University of Applied Sciences reports B, Raportteja ja selvityksi‰ 11, 2008, ss. 39, ISBN 978-952-9853-6, ISSN 1458-915X.

    147. Bednarik, R., Jansen, A.: Eye-tracking and its applications in studies of programming. In Proceedings of the 19th Annual Workshop of the Psychology of Programming Interest Group (PPIG'07), Joensuu, Finland, July 2-6, 2007, pp. 255.

      Monographs
    148. Bednarik, R.: Methods to analyze visual attention strategies: Applications in the studies of programming. PhD thesis, Department of Computer Science and Statistics, University of Joensuu, 2007. Available for download from: ftp://cs.joensuu.fi/pub/Dissertations/bednarik.pdf

    149. Bednarik, R.: Towards an Eye-tracking Methodology for Studies of Programming. PhLic thesis, Department of Computer Science, University of Joensuu, 2006.