Publications & Presentations

Keep It Up! Publications

  • Li, D. H., Macapagal, K., Mongrella, M., Saber, R., & Mustanski, B. (2024). “Your Package Could Not Be Delivered”: The State of Digital HIV Intervention Implementation in the US. Current HIV/AIDS reports, 10.1007/s11904-024-00693-1. Advance online publication. https://doi.org/10.1007/s11904-024-00693-1

  • Mustanski, B., & Macapagal, K. (2023). Clinical psychological science must move beyond documenting disparities in LGBTQ health toward eliminating them. Journal of consulting and clinical psychology, 91(2), 57–59. https://doi.org/10.1037/ccp0000800

  • Mustanski, B., Saber, R., Jones, J. P., Macapagal, K., Benbow, N., Li, D. H., Brown, C. H., Janulis, P., Smith, J. D., Marsh, E., Schackman, B. R., Linas, B. P., Madkins, K., Swann, G., Dean, A., Bettin, E., & Savinkina (2023). Keep It Up! 3.0: Study protocol for a type III hybrid implementation-effectiveness cluster-randomized trial.
    Contemporary clinical trials, 127, 107134.
    https://doi.org/10.1016/j.cct.2023.107134
In this paper, we describe the approach used to achieve the following aims of KIU! 3.0. KIU! 3.0 is a Type III Hybrid Effectiveness-Implementation cluster randomized trial designed to 1) compare two strategies for implementing KIU!: community-based organizations (CBO) versus centralized direct-to-consumer (DTC) recruitment; 2) examine the effect of strategies and determinants on variability in implementation success; and 3) develop materials for sustainment of KIU! after the trial concludes.

 

 

 

 

  • Macapagal, K., Li, D. H., Clifford, A., Madkins, K., & Mustanski, B. (2020). The CAN–DO–IT Model: A Process for Developing and Refining Online Recruitment in HIV/AIDS and Sexual Health Research. Current HIV/AIDS Reports, 17(3), 190–202. https://doi.org/10.1007/s11904-020-00491-5

This paper presents a practical model to guide researchers through online recruitment irrespective of platform. The CAN-DO-IT model reflects 7 iterative steps based on work by the authors and other investigators on Keep It Up and other online interventions: conceptualize scope of recruitment campaign, acquire necessary expertise, navigate online platforms, develop advertisements, optimize recruitment-to-enrollment workflow, implement advertising campaign, and track performance of campaigns and respond accordingly. The CAN-DO-IT model presents one approach to demystify online recruitment and reduce enrollment barriers. 

  • Nelson, K. M., & Macapagal, K. (2020). The Opportunities and Pitfalls of Using Patient Portals to Address the HIV Prevention Needs of Adolescent and Young Adult Sexual Minority Men. The Journal of adolescent health : official publication of the Society for Adolescent Medicine, 67(2), 149–150. https://doi.org/10.1016/j.jadohealth.2020.05.018
An editorial on the need for developmentally appropriate and targeted health intervention delivery methods for Young Sexual and Minority Males (YSMM), and how patient portals and other technologies can address this need.

 

 

 

 

    • Li, D. H., Brown, C. H., Gallo, C., Morgan, E., Sullivan, P. S., Young, S. D., & Mustanski, B. (2019). Design Considerations for Implementing eHealth Behavioral Interventions for HIV Prevention in Evolving Sociotechnical Landscapes. Current HIV/AIDS Reports, 16(4), 335–348. https://doi.org/10.1007/s11904-019-00455-4

    In this paper, we aimed to provide researchers and developers with an implementation-focused approach and set of design considerations as they develop new eHealth programs. Using the Accelerated Creation-to-Sustainment model as a lens, we examined challenges and successes experienced during the development and evaluation of four diverse eHealth HIV prevention programs for young men who have sex with men: Keep It Up!, Harnessing Online Peer Education, Guy2Guy, and HealthMindr. We present a checklist of critical implementation questions to address during intervention development. The design considerations presented can be used by developers, evaluators, reviewers, and funders to prioritize the pragmatic scalability of eHealth interventions in research.

      • Madkins, K., Moskowitz, D., Moran, K., Dellucci, T., Mustanski, B. (2019). Measuring Acceptability and Engagement of the Keep It Up! Internet–based HIV Prevention Randomized Controlled Trial for Young Men who have Sex with MenAIDS Education and Prevention, 31(4), 287–305. https://doi.org/10.1521/aeap.2019.31.4.287

       

       

      This paper examines acceptability and engagement of Keep It Up. Outcomes of interests were qualitative and quantitative acceptability and engagement measures, content ratings, and paradata. On average, participants rated content (4 out of 5 stars) and acceptability (3.5 out of 4) highly. Compared to White participants, Black participants found KIU! more useful, engaging, and acceptable; Latino participants found KIU! more engaging; and other non-White participants found KIU! more engaging and acceptable. Participants with high school or less education found KIU! more useful, engaging, acceptable, and deserving of five stars than college graduates and graduate degree holders. KIU! is a promising prevention tool for highest risk populations.

        • Feinstein, B.A., Dellucci, T.V.,Graham, S., Parsons, J.T., & Mustanski, B. (2018). Sexually transmitted infections among young men who have sex with men: Experiences with diagnosis, treatment, and reinfection. Sexuality Research and Social Policy, 15:172-182.

        This paper describes young men who have sex with men (YMSM) experiences with sexually transmitted infections (STIs) diagnosis, treatment, disclosure to partners, and changes in thinking and behavior. Reactions were diverse, the most common being surprise and concern. Most participants sought treatment, although the type of provider varied. Providers tended to retest participants, but some did so at the incorrect anatomical site. Participants who felt comfortable talking to providers about STIs tended to use their regular provider or one who specialized in gay/bisexual men’s health. Most participants described changes in their thinking and behavior (e.g., increased condom use, fewer sex partners, questioning whether or not they could trust their partners). Most participants disclosed to at least one partner, but some did not remember or were not in contact with partners. Implications for public policy and STI prevention are discussed.

         

        • Feinstein, B.A., Dellucci, T.V., Sullivan, P.S., Mustanski, B. (2018). Characterizing Sexual Agreements With One’s Most Recent Sexual Partner Among Young Men Who Have Sex With Men. AIDS Education and Prevention, 30(4): 335-349.

        This paper examines agreements with one’s most recent partner, individual differences across types of partnerships and agreements, and predictors of condomless anal sex (CAS). Two-thirds of participants did not have agreements. Monogamous agreements were most common among those who were seriously dating their partner, but also present among those who were casually dating their partner and those who were not dating their partner. Participants who were seriously dating their partner reported the most frequent sexual health communication. Participants without agreements reported the lowest frequency of and comfort with sexual health communication. Participants who were seriously dating their partner and those with monogamous agreements were most likely to report CAS. HIV prevention should address communication with serious and casual partners.

         

        • Madkins, K., Greene, G.J., Hall, E. et al. (2018). Attrition and HIV Risk Behaviors: A Comparison of Young Men Who Have Sex with Men Recruited from Online and Offline Venues for an Online HIV Prevention Program. Arch Sex Behav, 47(7): 2135. https://doi.org/10.1007/s10508-018-1253-0

        In this paper, we examine the impact of recruitment venue on participant demographics, behavioral HIV risks, and enrollment. Keep It Up participants were screened for eligibility from community-based organizations, Facebook, dating apps, and outreach events. There were significant differences by venue in age, race/ethnicity, sexual orientation, relationship status, and region of recruitment. There were no significant differences by venue in attrition during the enrollment process. The only difference in attrition was by race/ethnicity. Compared to White participants, eligible Black and Latino participants were significantly less likely to enroll in the intervention. There were also no significant differences by recruitment venue in sexual risk behaviors among enrolled participants. These findings suggest that recruitment into online HIV interventions from a variety of venues is feasible for diverse YMSM who are at similar risk for HIV infection.

         

        • Feinstein, B., Johnson, B., Parsons, J., &Mustanski, B. (2017). Reactions to Testing HIV Negative: Measurement and Associations with Sexual Risk Behaviour Among Young MSM Who Recently Tested HIV Negative. AIDS and Behavior. doi:10.1007/s10461-016-1525-4.

        In this paper, we validate the Inventory of Reactions to Testing HIV Negative measure in the Keep It Up study and to examine its associations with condomless anal sex (CAS). Factor analysis identified four factors, three of which were the same as the original factors (Reinforced Safety, Luck, and Invulnerability) and one that was novel (Reinforced Risk). Construct validity was demonstrated with associations between subscales and constructs from the IMB model of HIV prevention. Lower Reinforced Safety and higher Luck and Reinforced Risk were associated with more CAS. Associations between Reinforced Safety and Luck with CAS were stronger for those who reported more lifetime HIV tests. Findings highlight the importance of reactions to testing HIV-negative and suggest that they become more important with repeated testing.

         

        • Feinstein, B., Moody, R.L., John, S.A., Parsons, J.T., & Mustanski, B. (2017). A three-city comparison of drug use and drug use before sex among young men who have sex with men in the United States. Journal of Gay & Lesbian Social Services, 30:1. https://doi.org/10.1080/10538720.2018.1408519

        This paper examines demographic differences in drug use and drug use before sex. Marijuana was the most commonly used drug, but alkyl nitrites (“poppers”), cocaine, and Ecstasy were also commonly used. Drug use was more prevalent among older and White young men who have sex with men, and it was similar across cities, although use of poppers and polydrug use were more common in New York City. Our data generally support national prevention efforts. 

         

        • Motley, D.N., Hammond, S., Mustanski. B. (2017). Strategies Chosen by YMSM During Goal Setting to Reduce Risk for HIV and Other Sexually Transmitted Infections: Results From the Keep It Up! 2.0 Prevention Trial. AIDS Education and Prevention, 29(1): 1-13. https://doi.org/10.1521/aeap.2017.29.1.

        This paper utilizes qualitative data from Keep It Up to examine young men who have sex with men goals for sexual risk reduction. Goals tended to focus on strategies used to prepare for safer sex or strategies to be used during sex. In both areas, five categories of strategies were identified: skill-related, intrapersonal, social, contextual, and instrumental. Findings suggest opportunities for more tailored eHealth intervention by focusing on strategies in domains of most use to the individual. Future research should include longitudinal assessment of barriers and facilitators to goal adherence, utility of goals in increasing safer sex behaviors, and changes to goals over time.

         

        • Mustanski, B., Feinstein, B. A., Madkins, K., Sullivan, P., Swann, G. (2017). Prevalence and risk factors for rectal and urethral sexually transmitted infections from self-collected samples among young men who have sex with men participating in the Keep It Up! 2.0 randomized controlled trial. Sexually Transmitted Diseases. doi: 10.1097/OLQ.0000000000000636.

        This paper examines the prevalence and risk factors for rectal and urethral chlamydia and gonorrhea. Viability of self-collected samples was examined as a potential method to increase STI screening for young men who have sex with men (YMSM) without access to STI testing clinics. Results indicated that 15.1% of participants tested positive for an STI, 13.0% for a rectal STI, 3.4% for a urethral STI, and 1.2% for both

         

        • Mustanski B, Madkins K, Greene GJ, Parsons JT, Johnson BA, Sullivan P, Bass M, Abel R. (2017). Internet-Based HIV Prevention with At-Home Sexually Transmitted Infection Testing for Young Men Having Sex With Men: Study Protocol of a Randomized Controlled Trial of Keep It Up! 2.0. JMIR Res Protoc. doi: 10.2196/resprot.5740.

        This paper describes the protocol for the Keep It Up 2.0 intervention. Baseline enrollment for the RCT was completed on December 30, 2015, and assessment of intervention outcomes occurred at 3-, 6-, and 12-month time points. Our approach is innovative in linking an eHealth solution to HIV and STI home testing, as well as serving as a model for integrating scalable behavioral prevention into other biomedical prevention strategies. 

         

        • Strauss, B.B., Phillips, G., Bhatia, R., Madkins, K., Parsons, J.T., & Mustanski, B. (2016). Exploring Patterns of Awareness and Use of HIV Pre-exposure Prophylaxis among Young Men who Have Sex with Men. AIDS and Behavior, 1 –11. http://dx.doi.org/10.1007/s10461-016-1480-0

        In this paper, we examined differences in pre-exposure prophylaxis (PrEP) awareness and use. While 67.5 % of participants reported awareness of PrEP, 8.7 % indicated using the medication. Awareness, but not use, varied by demographic variables. PrEP-users had twice as many condomless anal sex partners and more condomless anal sex acts than non-users. Future research should aim to improve PrEP awareness and uptake among YMSM and address condom use.

        • Greene, G. J., Madkins, K., Andrews, K., Dispenza, J., & Mustanski, B. (2016). Implementation and evaluation of the keep it up! online HIV prevention intervention in a community-based setting. AIDS Education and Prevention, 28(3), 231-245. https://doi.org/10.1521/aeap.2016.28.3.231

        This paper discusses the implementation and evaluation of Keep It Up in a community-based setting. Topics covered include the use of the U.S. Centers for Disease Control’s (CDC) Map of Adaptation Process as a guideline to adapt KIU! for delivery in a community-based setting and a summary of the adaptations and the themes and axial codes for the intervention acceptability

         

        • Mustanski, B., Garofalo, R., Monahan, C., Gratzer, B., & Andrews, R. (2013). Feasibility, acceptability, and preliminary efficacy of an online HIV prevention program for diverse young men who have sex with men: The keep it up! intervention. AIDS and Behavior, 17(9), 2999. https://doi.org/10.1007/s10461-013-0507-z

        This paper evaluated the feasibility, acceptability, and preliminary efficacy of Keep It Up. The intervention was designed to be delivered to diverse young men who have sex with men (YMSM) upon receiving an HIV negative text result, with the goal for them to “Keep It Up” and stay negative. In a randomized clinical trial, the intervention was compared to an online didactic HIV knowledge condition. The study sample included 102 sexually active YMSM. Participants reported completing online modules in settings that were private and not distracting. Mixed methods data showed intervention participants felt the program was valuable and acceptable. Compared to the control condition, participants in the intervention arm had a 44 % lower rate of unprotected anal sex acts at the 12-week follow-up.

        Keep it Up! Presentations

        Adapting the KIU! Digital HIV Prevention Program

         

        Community-Based Organizations' Readiness for Implementing KIU

        Recruiting & Retaining Diverse Sexual Minority Men

        Keep it Up! Admin Dashboard Demo