Latent logistic interaction modeling of skewed ordinal item scores

skeword

In this new study published in the journal Structural Equation Modeling we focused on three popular methods to model interactions between two constructs containing measurement error in predicting an observed binary outcome: logistic regression using (1) observed scores, (2) factor scores, and (3) Structural Equation Modeling (SEM). It is still unclear how they compare with respect to bias and precision in the estimated interaction when item scores underlying the interaction constructs are skewed and ordinal. In this article, we investigated this issue using both a Monte Carlo simulation and an empirical illustration of the effect of Type D personality on cardiac events. Our results indicated that the logistic regression using SEM performed best in terms of bias and confidence interval coverage, especially at sample sizes of 500 or larger. Although for most methods bias increased when item scores were skewed and ordinal, SEM produced relatively unbiased interaction effect estimates when items were modeled as ordered categorical.

You can download the article here.

How to assess a Type D personality effect (part 2)

 

effect

A new study I published in the journal Personality and Individual Differences is a sequel to my study published in the Journal of Psychosomatic Research, earlier this year. Type D personality has been associated with various medical and psychosocial outcomes. Type D’s underlying personality traits negative affectivity (NA) and social inhibition (SI) are hypothesized to either additively (NA + SI) or synergistically (NA ∗ SI) affect an outcome. As some of the methods used to assess a Type D effect have been criticized in the past, this study aimed to investigate for all commonly used methods their tendency of producing false positive Type D effect. 324,000 datasets were generated using a Monte Carlo Simulation. Each dataset was analyzed using various methods to assess a Type D effect. Each method’s performance was assessed in terms of absolute bias and the percentage of false-positive findings. An online application was developed where readers can easily experiment with this simulation. Our simulation showed that all commonly used methods risk producing false-positive Type D effects. The only method with adequate false-positive rates included the continuous NA and SI main effects, as well as their quadratic effects and their interaction. All commonly used methods to assess a Type D personality effect showed inflated false-positive rates in realistic simulation scenarios. All earlier research based only on these methods should be reconsidered.

 

Young Investigator Award

I am truly honored to have been awarded the Elsevier & EAPM Young Investigator Award for my recently published article in the Journal of Psychosomatic Research. I would like to thank EAPM and Elsevier for making this award possible. Also many thanks to my supervisors Prof. Dr. Jelte Wicherts and Dr. Nina Kupper for their support and inspiration. Lastly, special thanks to the late Prof. Dr. Johan Denollet, without whom this study would never have taken place. I dedicate this award to him.

Screen Shot 2020-06-25 at 17.01.35

How to assess a Type D personality effect

Below is a short summary of a new study I published in the Journal of Psychosomatic Research. In this study, I investigated several methods used to assess a Type D personality effect and showed that the commonly used methods based on personality subgroups may result in false positive Type D effects.

Screenshot 2022-05-13 at 11.43.20

In research on Type D personality, its subcomponents negative affectivity (NA) and social inhibition (SI) are hypothesised to have a synergistic effect on various medical and psychosocial outcomes. As some methods to analyse Type D personality have been criticised, this study investigated whether these methods adequately detect a Type D effect. We used a simulation and two empirical illustrations to investigate each method’s performance (bias, power and false positives) in detecting the Type D effect. Our simulation showed that the two most commonly used methods to assess the Type D effect (subgroup methods) were primarily picking up the presence of NA or SI main effects, indicating that these methods might falsely suggest synergistic Type D effects. Moreover, these methods failed to detect the combined presence of the NA and SI main effects, resulting in significant Type D effects when only one of the NA/SI main effects was present. The method that best detected Type D effects modeled the continuous NA/SI main effects and their statistical interaction in a regression analysis. Reanalysis of two empirical Type D personality datasets confirmed the patterns found in our simulation. This study showed that Type D effects should be modeled with a continuous interaction approach. Other approaches showed either more bias, more false positive findings or lower power. We recommend against using subgroup approaches to operationalise Type D personality, as these methods are biased, regardless of whether the Type D effect is synergistic or additive in nature.

Click here to download the published article

 

How to model interactions between latent variables?

Below is a short summary of a new study I published with my collaborators in the Journal Multivariate Behavioral Research. The study reports a simulation study investigating the performance of various approaches to model interaction effects in structural equation models. It also includes an empirical investigation of how the two personality traits negative affectivity and social inhibition interact in influencing depressive and anxiety symptoms.

Modeling Interactions Between Latent Variables in Research on Type D Personality: A Monte Carlo Simulation and Clinical Study of Depression and Anxiety

Screen Shot 2020-03-14 at 10.44.32

Several approaches exist to model interactions between latent variables. However, it is unclear how these perform when item scores are skewed and ordinal. Research on Type D personality serves as a good case study for that matter. In Study 1, we fitted a multivariate interaction model to predict depression and anxiety with Type D personality, operationalized as an interaction between its two subcomponents negative affectivity (NA) and social inhibition (SI). We constructed this interaction according to four approaches: (1) sum score product; (2) single product indicator; (3) matched product indicators; and (4) latent moderated structural equations (LMS). In Study 2, we compared these interaction models in a simulation study by assessing for each method the bias and precision of the estimated interaction effect under varying conditions. In Study 1, all methods showed a significant Type D effect on both depression and anxiety, although this effect diminished after including the NA and SI quadratic effects. Study 2 showed that the LMS approach performed best with respect to minimizing bias and maximizing power, even when item scores were ordinal and skewed. However, when latent traits were skewed LMS resulted in more false-positive conclusions, while the Matched PI approach adequately controlled the false-positive rate.

Lodder, P., Denollet, J., Emons, W. H., Nefs, G., Pouwer, F., Speight, J., & Wicherts, J. M. (2019). Modeling Interactions Between Latent Variables in Research on Type D Personality: A Monte Carlo Simulation and Clinical Study of Depression and Anxiety. Multivariate behavioral research, 1-29.

Click here to download the published article

Does money affect our thoughts and behavior?

Below is a short summary of a new study I published with my collaborators in the Journal of Experimental Psychology: General. In this study we combined the results of dozens of studies investigating how money may affect our thoughts, emotions and behaviors, including the results of 100 unpublished experiments. Overall, this influence of money appeared to be important. However, these results should be interpreted carefully because published studies showed much larger effects than unpublished studies, a phenomenon called publication bias.

A Comprehensive Meta-analysis of Money Priming

Screen Shot 2020-03-14 at 10.45.30

Research on money priming typically investigates whether exposure to money-related stimuli
can affect people’s thoughts, feelings, motivations and behaviors. Our study answers the call for a comprehensive meta-analysis examining the available evidence on money priming. By conducting a systematic search of published and unpublished literature on money priming, we sought to achieve three key goals. First, we aimed to assess the presence of biases in the available published literature (e.g., publication bias). Second, in the case of such biases, we sought to derive a more accurate estimate of the effect size after correcting for these biases. Third, we aimed to investigate whether design factors such as prime type and study setting moderated the money priming effects. Our overall meta-analysis included 246 suitable experiments and showed a significant overall effect size estimate (Hedges’ g = .31, 95%CI = [0.26, 0.36]). However, publication bias and related biases are likely given the asymmetric funnel plots, Egger’s test and two other tests for publication bias. Moderator analyses offered insight into the variation of the money priming effect, suggesting for various types of study designs whether the effect was present, absent, or biased. We found the largest money priming effect in lab studies investigating a behavioral dependent measure using a priming technique in which participants actively handled money. Future research should use sufficiently powerful pre-registered studies to replicate these findings.

Lodder, P., Ong, H. H., Grasman, R. P., & Wicherts, J. (2019). A comprehensive meta-analysis of money priming. Journal of Experimental Psychology: General.

Click here to download the preprint