111
Views
0
CrossRef citations to date
0
Altmetric
Original article

Applying computer vision techniques to depression symptomatology through eye blink patterns in university students

ORCID Icon, , &
Pages 106-117 | Received 31 Jul 2021, Accepted 07 Jun 2023, Published online: 20 Jul 2023

References

  • Abel, L. A., Friedman, L., Jesberger, J., Malki, A., & Meltzer, H. Y. (1991). Quantitative assessment of smooth pursuit gain and catch-up saccades in schizophrenia and affective disorders. Biological Psychiatry, 29(11), 1063–1072. https://doi.org/10.1016/0006-3223(91)90248-K
  • Alamudun, F. T. (2016). Eye tracking methods for analysis of visuo-cognitive behavior in medical imaging [Doctoral dissertation]. Texas A & M University. https://hdl.handle.net/1969.1/157040
  • Al-gawwam, S., & Benaissa, M. (2018, December). Depression detection from eye blink features. In 2018 IEEE International Symposium on Signal Processing and Information Technology (ISSPIT) (pp. 388–392). IEEE. https://doi.org/10.1109/ISSPIT.2018.8642682
  • Alghowinem, S., Goecke, R., Wagner, M., Parker, G., & Breakspear, M. (2013a, September). Eye movement analysis for depression detection. In 2013 IEEE International Conference on Image Processing (pp. 4220–4224). IEEE. https://doi.org/10.1109/ICIP.2013.6738869
  • Alghowinem, S., Goecke, R., Wagner, M., Parkerx, G., & Breakspear, M. (2013b, September). Head pose and movement analysis as an indicator of depression. In 2013 Humaine Association Conference on Affective Computing and Intelligent Interaction (pp. 283–288). IEEE. https://doi.org/10.1109/ACII.2013.53
  • Alghowinem, S. M., Gedeon, T., Goecke, R., Cohn, J., & Parker, G. (2020). Interpretation of depression detection models via feature selection methods. In IEEE Transactions on Affective Computing. https://doi.org/10.1109/TAFFC.2020.3035535
  • Ben-Porath, Y. S. (2003). Assessing personality and psychopathology with self-report inventories. Handbook of Psychology: Assessment Psychology, 10, 553–577. https://doi.org/10.1002/0471264385
  • Benson, P. J., Beedie, S. A., Shephard, E., Giegling, I., Rujescu, D., & Clair, D. S. (2012). Simple viewing tests can detect eye movement abnormalities that distinguish schizophrenia cases from controls with exceptional accuracy. Biological Psychiatry, 72(9), 716–724. https://doi.org/10.1016/j.biopsych.2012.04.019
  • Brakemeier, S., Sprenger, A., Meyhöfer, I., McDowell, J. E., Rubin, L. H., Hill, S. K., Keshavan, M. S., Pearlson, G. D., Tamminga, C. A., Gershon, E. S., Keedy, S. S., Sweeney, J. A., Clementz, B. A., & Lencer, R. (2020). Smooth pursuit eye movement deficits as a biomarker for psychotic features in bipolar disorder—Findings from the PARDIP study. Bipolar Disorders, 22(6), 602–611. https://doi.org/10.1111/bdi.12865
  • Burdisso, S. G., Errecalde, M., & Montes-y-Gómez, M. (2019). A text classification framework for simple and effective early depression detection over social media streams. Expert Systems with Applications, 133, 182–197. https://doi.org/10.1016/j.eswa.2019.05.023
  • Cohn, J. F., Kruez, T. S., Matthews, I., Yang, Y., Nguyen, M. H., Padilla, M. T., Zhou, F., & De la Torre, F. (2009, September). Detecting depression from facial actions and vocal prosody. In 2009 3rd International Conference on Affective Computing and Intelligent Interaction and Workshops (pp. 1–7). IEEE. https://doi.org/10.1109/ACII.2009.5349358
  • Cortes, C., & Vapnik, V. (1995). Support-vector networks. Machine Learning, 20(3), 273–297. https://doi.org/10.1007/BF00994018
  • Crawford, T. J., Haeger, B., Kennard, C., Reveley, M. A., & Henderson, L. (1995). Saccadic abnormalities in psychotic patients. I. Neuroleptic-free psychotic patients. Psychological Medicine, 25(3), 461–471. https://doi.org/10.1017/S0033291700033389
  • Cummins, N., Scherer, S., Krajewski, J., Schnieder, S., Epps, J., & Quatieri, T. F. (2015). A review of depression and suicide risk assessment using speech analysis. Speech Communication, 71, 10–49. https://doi.org/10.1016/j.specom.2015.03.004
  • Cusin, C., Yang, H., Yeung, A., & Fava, M. (2009). Rating scales for depression. Handbook of Clinical Rating Scales and Assessment in Psychiatry and Mental Health, 7–35. https://doi.org/10.1007/978-1-59745-387-5_2
  • Dalal, N., Triggs, B., & Schmid, C. (2006, May). Human detection using oriented histograms of flow and appearance. In European Conference on Computer Vision (pp. 428–441). Springer. https://doi.org/10.1007/11744047_33
  • Dong, Y., & Yang, X. (2021). A hierarchical depression detection model based on vocal and emotional cues. Neurocomputing, 441, 279–290. https://doi.org/10.1016/j.neucom.2021.02.019
  • First, M. B., France, A., & Pincus, H. A. (2004). DSM-IV-TR guidebook. American Psychiatric Publishing, Inc.
  • Fu, C. H., Williams, S. C., Brammer, M. J., Suckling, J., Kim, J., Cleare, A. J., Walsh, N. D., Mitterschiffthaler, M. T., Andrew, C. M., Pich, E. M., & Bullmore, E. T. (2007). Neural responses to happy facial expressions in major depression following antidepressant treatment. American Journal of Psychiatry, 164(4), 599–607. https://doi.org/10.1176/ajp.2007.164.4.599
  • Giannakakis, G., Manousos, D., Chaniotakis, V., & Tsiknakis, M. (2018, March). Evaluation of head pose features for stress detection and classification. In 2018 IEEE EMBS International Conference on Biomedical & Health Informatics (BHI) (pp. 406–409). IEEE. https://doi.org/10.1109/BHI.2018.8333454
  • Gilboa, E., & Gotlib, I. H. (1997). Cognitive biases and affect persistence in previously dysphoric and never-dysphoric individuals. Cognition & Emotion, 11(5–6), 517–538. https://doi.org/10.1080/026999397379881a
  • Hedlund, S., & Rude, S. S. (1995). Evidence of latent depressive schemas in formerly depressed individuals. Journal of Abnormal Psychology, 104(3), 517. https://doi.org/10.1037/0021-843X.104.3.517
  • Hutton, S. B., & Ettinger, U. (2006). The antisaccade task as a research tool in psychopathology: A critical review. Psychophysiology, 43(3), 302–313. https://doi.org/10.1111/j.1469-8986.2006.00403.x
  • Joshi, J. (2013, September). An automated framework for depression analysis. In 2013 Humaine Association Conference on Affective Computing and Intelligent Interaction (pp. 630–635). IEEE. https://doi.org/10.1109/ACII.2013.110
  • Kazemi, V., & Sullivan, J. (2014). One millisecond face alignment with an ensemble of regression trees. In Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition (pp. 1867–1874). https://doi.org/10.1109/CVPR.2014.241
  • Kellough, J. L., Beevers, C. G., Ellis, A. J., & Wells, T. T. (2008). Time course of selective attention in clinically depressed young adults: An eye tracking study. Behaviour Research and Therapy, 46(11), 1238–1243. https://doi.org/10.1016/j.brat.2008.07.004
  • Kim, J. Y., Liu, N., Tan, H. X., & Chu, C. H. (2017). Unobtrusive monitoring to detect depression for elderly with chronic illnesses. IEEE Sensors Journal, 17(17), 5694–5704. https://doi.org/10.1109/JSEN.2017.2729594
  • King, D. E. (2009). Dlib-ml: A machine learning toolkit. The Journal of Machine Learning Research, 10, 1755–1758. http://jmlr.org/papers/v10/king09a.html
  • Li, X., Cao, T., Sun, S., Hu, B., & Ratcliffe, M. (2016, July). Classification study on eye movement data: Towards a new approach in depression detection. In 2016 IEEE Congress on Evolutionary Computation (CEC) (pp. 1227–1232). IEEE. https://doi.org/10.1109/CEC.2016.7743927
  • Lipton, R. B., Levin, S., & Holzman, P. S. (1980). Horizontal and vertical pursuit eye movements, the oculocephalic reflex, and the functional psychoses. Psychiatry Research, 3(2), 193–203. https://doi.org/10.1016/0165-1781(80)90036-0
  • Lovibond, S. H., & Lovibond, P. F. (1996). Manual for the depression anxiety stress scales. Psychology Foundation of Australia.
  • Masud, M. T., Mamun, M. A., Thapa, K., Lee, D. H., Griffiths, M. D., & Yang, S. H. (2020). Unobtrusive monitoring of behavior and movement patterns to detect clinical depression severity level via smartphone. Journal of Biomedical Informatics, 103, 103371. https://doi.org/10.1016/j.jbi.2019.103371
  • Mikhailova, E. S., Vladimirova, T. V., Iznak, A. F., Tsusulkovskaya, E. J., & Sushko, N. V. (1996). Abnormal recognition of facial expression of emotions in depressed patients with major depression disorder and schizotypal personality disorder. Biological Psychiatry, 40(8), 697–705. https://doi.org/10.1016/0006-3223(96)00032-7
  • Mohammadi, G., Shanbehzadeh, J., & Sarrafzadeh, H. (2015). A fast and adaptive video-based method for eye blink rate estimation. ACCENT Society (India). https://hdl.handle.net/10652/3409
  • Moharana, L., Das, N., Nayak, S., & Routray, A. (2021). Video based eye blink analysis for psychological state determination. Intelligent Decision Technologies, 15(3), 451–460. https://doi.org/10.3233/IDT-200198
  • Moharana, L., & Das, N. (2018). Automated depression detection: A short review. Indian Journal of Public Health Research & Development, 9(11), 2297. https://doi.org/10.5958/0976-5506.2018.01789.8
  • Morita, K., Miura, K., Fujimoto, M., Yamamori, H., Yasuda, Y., Iwase, M., Kasai, K., & Hashimoto, R. (2017). Eye movement as a biomarker of schizophrenia: Using an integrated eye movement score. Psychiatry and Clinical Neurosciences, 71(2), 104–114. https://doi.org/10.1111/pcn.12460
  • Pampouchidou, A., Simos, P. G., Marias, K., Meriaudeau, F., Yang, F., Pediaditis, M., & Tsiknakis, M. (2017). Automatic assessment of depression based on visual cues: A systematic review. IEEE Transactions on Affective Computing, 10(4), 445–470. https://doi.org/10.1109/TAFFC.2017.2724035
  • Rommelse, N. N., Van der Stigchel, S., & Sergeant, J. A. (2008). A review on eye movement studies in childhood and adolescent psychiatry. Brain and Cognition, 68(3), 391–414. https://doi.org/10.1016/j.bandc.2008.08.025
  • Sagonas, C., Tzimiropoulos, G., Zafeiriou, S., & Pantic, M. (2013). 300 faces in-the-wild challenge: The first facial landmark localization challenge. In Proceedings of the IEEE International Conference on Computer Vision Workshops (pp. 397–403). https://doi.org/10.1109/ICCVW.2013.59
  • Sheeber, L., Allen, N., Davis, B., & Sorensen, E. (2000). Regulation of negative affect during mother–child problem-solving interactions: Adolescent depressive status and family processes. Journal of Abnormal Child Psychology, 28(5), 467–479. https://doi.org/10.1023/A:1005135706799
  • Siegle, G. J., Steinhauer, S. R., Friedman, E. S., Thompson, W. S., & Thase, M. E. (2011). Remission prognosis for cognitive therapy for recurrent depression using the pupil: Utility and neural correlates. Biological Psychiatry, 69(8), 726–733. https://doi.org/10.1016/j.biopsych.2010.12.041
  • Siegle, G. J., Steinhauer, S. R., & Thase, M. E. (2004). Pupillary assessment and computational modeling of the stroop task in depression. International Journal of Psychophysiology, 52(1), 63–76. https://doi.org/10.1016/j.ijpsycho.2003.12.010
  • Soukupova, T., & Cech, J. (2016, February). Eye blink detection using facial landmarks. In 21st Computer Vision Winter Workshop (p. 2). Rimske Toplice, Slovenia.
  • Venkataraman, D., & Parameswaran, N. S. (2018). Extraction of facial features for depression detection among students. International Journal of Pure and Applied Mathematics, 118(7), 455–463.
  • Wang, K. (2019). Robust and accurate eye-gaze tracking and its applications. Rensselaer Polytechnic Institute.
  • World Health Organization. (2017). Depression and other common mental disorders: Global health estimates (No. WHO/MSD/MER/2017.2).
  • Yiend, J. (2010). The effects of emotion on attention: A review of attentional processing of emotional information. Cognition and Emotion, 24(1), 3–47. https://doi.org/10.1080/02699930903205698

Reprints and Corporate Permissions

Please note: Selecting permissions does not provide access to the full text of the article, please see our help page How do I view content?

To request a reprint or corporate permissions for this article, please click on the relevant link below:

Academic Permissions

Please note: Selecting permissions does not provide access to the full text of the article, please see our help page How do I view content?

Obtain permissions instantly via Rightslink by clicking on the button below:

If you are unable to obtain permissions via Rightslink, please complete and submit this Permissions form. For more information, please visit our Permissions help page.