Travis Research Institute
Clinical Data Science Lab
Office
Psychology Building 330
Fuller Theological Seminary
180 N. Oakland Ave.
Pasadena, CA 91101-1714
shkim@fuller.edu
Phone
626.584.5554
Mission
Our lab does empirical studies to understand abnormal psychological aspects (e.g., PTSD, mild traumatic brain injury) of humans using (neuro-) psychological assessment tools (e.g., MMPI) as well as brain imaging (e.g., PET scans of Iraq/Afghanistan veterans). We apply conventional methods popular in social sciences as well as more recent developments in artificial intelligence such as machine learning and deep neural networks to examine the complexity among psychological constructs.
Some popular research agenda items in our lab are:
Artificial Intelligence (Machine Learning and Deep Learning)
- Unsupervised/supervised learning on text data and assessment data (classification; Latent Dirichlet Allocation; structural topic model)
- Brain imaging (PET images among veterans with PTSD and/or mild traumatic brain injury)
Research on or with psychological assessment
- Personality (MMPI, Big Five, sentence completion tests, etc.)
- Intelligence (WAIS-IV)
- Neuropsychology (D-KEFS, BVMT, HVLT, or Rey-O)
PROJECT
How Can We Deploy Artificial Intelligence to Analyze the Data from Psychological Assessment Measures Such as the MMPI?
The authors applied machine learning (ML) to the item responses of 44,846 MMPI-2 (Butcher et al., 1989) profiles to identify important predictors of gender identity, utilizing ML algorithms’ capacity to learn and recognize structural relationships in the data without being explicitly programmed or hypothesized (Samuel, 1959). Several ML algorithms, including XGBoost and deep neural networks, were trained on a train set using a 5-fold cross-validation to predict each profile’s gender from the item responses. Their predictions were then compared with each profile’s reported gender, a proxy variable for gender identity. Their prediction accuracy on the test set ranged from 96.09% to 97.06%. The majority of the 20 most important item responses for gender prediction identified by ML belonged to the seven-item Feminine Gender Identity scale in Martin and Finn (2010), who studied it using factor analysis and expert judgment, thereby demonstrating the validity and usefulness of ML for psychological research.
PROJECT
Neuropsychological Presentations of Mild Traumatic Brain Injury and Posttraumatic Stress Disorder Among Veterans
Objective: To explore the neuropsychological sequelae of blast-induced mild traumatic brain injury (mTBI) and posttraumatic stress disorder (PTSD), several neuropsychological tests and self-reported measures of cognitive and emotional functioning were administered to 138 Operation Iraqi Freedom (OIF)/Operation Enduring Freedom (OEF) veterans. We hypothesized that veterans affected by mTBI and PTSD would manifest differences in neuropsychological testing and self-report measures compared to a group of healthy veteran controls and to veterans with only PTSD. Results suggest that among OIF/OEF veterans with blast-induced mTBI, PTSD with its accompanying emotional distress may be a significant determinant of subjective sense of well-being both cognitively and emotionally. The objective discrepancy in PS between the comorbid group and the healthy controls also appears largely due to PTSD more so than the remote blast-induced mTBI, as the group mean difference in PS became negligible after controlling for PTSD levels.
PROJECT
Dimensions of Religion and Spirituality: A Topic Modeling Approach (Structural Topic Model)
In lieu of the traditional text data analysis methods, structural topic modeling was utilized to analyze the text contents of 255 self-report inventories of religion and spirituality (R/S) published from 1929 to 2017. The study had two objectives: (a) to clarify and identify the latent dimensions of R/S inherent in the items of the measures; and (b) to examine and demonstrate the usefulness of a longitudinal topic modeling in the study of R/S. We identified 5,617 unique text terms from the measures and fitted topic models on those terms to extract latent dimensions called topics. We also simultaneously analyzed the longitudinal effect of publication decade (i.e., 1950s–2010s) on the topics. A topic model with three topics was chosen to best support the data: Experience of Transcendence (Topic 1), Engagement in Transcendence (Topic 2), and Essence of Transcendence (Topic 3). In addition, the longitudinal analysis revealed that Topic 1 showed a continual increase over the decades, while Topics 2 and 3 both demonstrated a gradual decrease, in effect matching the general trend of Topic 1’s increasing popularity in society and academia.
PROJECT
Religion, Cognition, and Emotion: What Can Machine Coding Tell Us About Culture?
As cultural conflicts are intensifying locally and internationally in the aftermath of COVID-19 pandemic, fine-tuned investigation of culture/religion, especially that of the marginalized populations, holds the potential to reduce disparity and suffering in the global village. This study used 3 textual analysis programs—Topic Modeling, C-LIWC, and SSWC-Chinese—to shed light on the differences in cognition and emotion between two communities with radically different religious beliefs (Bimo and Christianity) among the Yi ethnic minority in Southwest China. Findings from these programs replicated the manual coding results of the previous study, and confirmed the prediction that cultural differences in cognition and emotion between the Yi-Bimo and the Yi-Christian fall along the divide between strong-ties and weak-ties rationality (Sundararajan, 2020a). Demonstrating an edge of advantage over manual coding, this machine-assisted analysis lends convergent validity to the previous study, and presents a more nuanced picture of diversity in emotion and cognition among the Chinese, with practical implications for future research and intervention for the marginalized populations.
PROJECT
Quantitative Textual Analysis of the Rotter Incomplete Sentence Blank (RISB-2) Responses
Despite its popularity as an assessment within counseling settings, the RISB-2 sentence completion test is often used in a subjective manner and interpreted independent of its official scoring manual. This project seeks to examine the validity of the RISB-2 via quantitative textual analysis of an existing dataset of scored RISB-2 assessments. As a part of this process, an AI-based scoring system will be developed which can score responses and match them to one of three possible categories.
PROJECT
Research Collaboration with Huntington Medical Research Institute (HMRI)
The collaboration with HMRI involves administering, scoring, and interpreting neuropsychological batteries in pursuit of discovering deteriorating cognitive functioning over the course of a participant's lifetime. This is done in order to better understand what loss of functioning is more predictive of early signs of Alzheimer's Disease. The current projects being done in this lab involve comparing biomarkers such as amyloid levels and urine DCA levels to relevant neuropsychological domains.
RECENT PUBLICATIONS:
Patel, S., Kim, S.-H., Johansen, C., Meier, A., Nolty, A. T., Delgado, N., Fernandez, N., Dekel, N., Folbrecht, J., Mullins, W., & Behrendt, C. (2021). Threshold Score for the Self-Report Pediatric Distress Thermometer Rating Scale in Childhood Cancer Patients. Psycho-Oncology, 1-9. http://doi.org/10.1002/pon.5583
Kim, S.-H., Rising, S., Green, R., & Sin, C. (2020). Machine learning analysis of the MMPI-2 items for gender identity. Journal of Asia Pacific Counseling, 10(2), 79-88. http://doi.org/10.18401/2020.10.2.10
Sundararajan, L., Ting, R. S., Hsieh, S.-L., & Kim, S.-H. (2020). Religion, Cognition, and Emotion: What can automated text analysis tell us about Culture? The Humanistic Psychologist. https://doi.org/10.1037/hum0000201
Kim, S.-H., Martin, B. J., Lee, N., Suh, J., Walters, D., Silverman, D. H., & Berenji, G. R. (2020). Examining Post-traumatic Stress Disorder as a Key Post Injury Risk Factor in OIF/OEF Veterans with Blast-Induced Mild Traumatic Brain Injury. Neuropsychology. Advance online publication. https://doi.org/10.1037/neu0000678
Kim, S.-H., Lee, N., & King, P. E. (2020). Dimensions of religion and spirituality: A longitudinal topic modeling approach. Journal for the Scientific Study of Religion, 59, 62-83. doi:10.1111/jssr.12639
Lim, E.-M., & Kim, S.-H. (2020). A validation of a multicultural competency measure amongst South Korean counselors. Journal of Multicultural Counseling and Development, 48, 15-29. doi:10.1002/jmcd.12161
Abernethy, A. D., & Kim, S.-H. (2018). The Spiritual Transcendence Index: An Item Response Theory Analysis. International Journal for the Psychology of Religion, 28(4), 240-256. https://doi.org/10.1080/10508619.2018.1507800
Lim, E.-M., Kang, H. J., Kim, S.-H., & Koo, J. K. (2018). The development and validation of a multi-cultural counseling competence scale for Korean counselors. Korean Journal of Counseling, 19(1), 421-442.
Lim, E.-M., Kang, H. J., Kim, S.-H., & Koo, J. K. (2018). The development and validation of a multi-cultural counseling competence scale for Korean counselors. Korean Journal of Counseling, 19(1), 421-442.
Kim, S.-H., McNeill, T. M., Strenger, N. R., & Lee, C. (2016). An Actor-Partner Interdependence analysis of the ABC-X stress model among clergy couples. Psychology of Religion and Spirituality, 8(1), 65-76. https://doi.org/10.1037/rel0000031
People
Faculty and Principal investigator
Sung Kim
Associate Professor of Psychology
BA, SEOUL NATIONAL UNIVERSITY, KOREA
MA, SEOUL NATIONAL UNIVERSITY, KOREA
PHD, UNIVERSITY OF TEXAS AT AUSTIN
Students
Bethany Ling is a fifth year Psy.D. student. Her research focused on Asian adoptees within the U.S., and how narrative therapy may aid Asian adoptees in processing their experiences. She is also a registered psychological associate at a local private practice providing individual psychotherapy and pediatric neuropsychological assessments.
Connor Stephenson is a second-year PhD student in Fuller's Clinical Psychology program. He is working with children through the Los Angeles County Department of Mental Health as a practicum trainee. Connor received a BA in Theology with an emphasis in Leadership and Pastoral Ministry from Vanguard University. Prior to entering the psychology program, Connor spent the last seven years working with adults experiencing homelessness. He currently serves on the board of directors of the National Human Services Data Consortium and is performing research on spirituality and political polarization in the United States.
Shant Rising is a clinical psychology PhD student with primary interests in traumatic brain injury and neurodegeneration. His dissertation is focused on linking volumetric brain analysis with neurocognitive assessment to help identify early patterns of cognitive decline in individuals predisposed to Alzheimer's disease. He is currently completing his internship at Mount Sinai Hospital in New York City.
Elise Chan is a fourth-year PsyD student in Clinical Psychology. Her dissertation will focus on the impact and effectiveness of faith-based parenting interventions across various transnational cultural contexts. Her experiences as an international student grounded her interest in working with international students and Asian/Asian American populations, in addition to working with clients with a diverse intersection of identities and experiences. Her clinical interests include identity exploration, mindfulness, multiculturalism, and acculturation/cultural hybridity. Elise earned her BA in Psychology at Scripps College and her MA in Clinical Psychology from Fuller Graduate School of Psychology.
Sean Noe is a fifth-year Ph.D. student in Fuller's Clinical Psychology program. He completed his undergraduate program at Point Loma Nazarene University and has a background working with children and teens in educational environments. His clinical training has been in university counseling centers, private practice, and community mental health settings, and he enjoys intersections of spirituality and clinical work. His research interests include examining aspects of spirituality that relate to promoting positive development and experiences of gratitude.
Caleb Sin is a candidate for PhD in Clinical Psychology. His dissertation examines the effects of urine DCA levels as an indicator for early indicators of neuropsychological deficits in potential prediction of Alzheimer’s Disease. He earned his BA in Psychology from Biola University, and his MA in Clinical Psychology from Fuller Graduate School of Psychology.
Zach Wong is a PsyD student in Clinical Psychology. He has previous clinical experience working in community mental health settings, social service agencies, and hospital outpatient programs with BIPOC and individuals from diverse socioeconomic backgrounds. His research interests include psychological assessment, the treatment and interventions for patients with serious mental illness (SMI), as well as mental health within the Asian American community and other minority populations. His current research project focuses on examining the validity of a semi-projective assessment measuring psychological maladjustment.
Rachel Woo is a third-year PhD student in Clinical Psychology studying cognitive impairments associated with early Alzheimer's disease. Her current research involves identifying neuropsychological deficits and their associations with changes in the brain characteristic of Alzheimer's disease in its early stages. Her focus includes neuropsychological assessments and clinical work across the lifespan with a particular interest in the geriatric population. Rachel earned her BA in Neuroscience from Wellesley College and her MA in Clinical Psychology from Fuller Graduate School of Psychology.
Samuel Salamanca
Lab Alumni:
Paul Domigan is a clinical psychology PhD alumni. Paul’s first career was in the field of MRI and PET/CT system development and holds several related patents. Paul earned engineering degrees from the University of Massachusetts/Amherst and the Massachusetts Institute of Technology. Paul also earned an MA in Marriage and Family Therapy and Mental Health Counseling from Gordon-Conwell Theological Seminary and an MA in Psychology from Fuller Theological Seminary.
Darrell Walters is a clinical psychology PhD alumni who completed his APA-accredited internship at Kaiser Permanente in San Diego. He has continued with post-graduate work in pediatric and adolescent neuropsychology under a board-certified neuropsychologist in private practice as he works toward board certification in clinical neuropsychology. Darrell is also a licensed Marriage and Family Therapist and continues to do work with Daniel J. Siegel, MD, and the team at the Mindsight Institute. His dissertation was on the iatrogenic effects of cancer and its treatments; more specifically, he analyzed neuropsychological data through confirmatory factor analysis and structural equation modeling to determine the source of memory complaints in a cohort of clinically referred female cancer survivors. Findings revealed encoding (i.e., attention span, processing speed, and learning efficiency) difficulties rather than true memory (i.e., recall) deficits.
Joy Suh is a recent graduate from the Clinical Psychology PhD program. She completed her internship at the Colorado Mental Health Institute Fort Logan in Denver, Colorado and is currently finishing a postdoctoral fellowship at Fuller Psychological and Family Services. In the fall of 2020, she will begin a neuropsychology postdoctoral fellowship at Cedar Sinai Medical Center to pursue specialization in neuropsychological assessment.
Rachel Green, PsyD. in Clinical Psychology.
Bess Martin
Narae Lee
Contact Us
t. 626.584.5544
email: tri@fuller.edu
Staff
Jim Cummings, MDiv, MA
Research Administrator
jamescummings2@fuller.edu
Office Hours
Monday–Friday
8 am–5 pm
Address
Room 326
180 N. Oakland Ave
Pasadena, CA 91182