Presentations & Publications
KIU! Presentations
Adapting the KIU! Digital HIV Prevention Program
Community-Based Organizations' Readiness for Implementing KIU!
Recruiting & Retaining Diverse Sexual Minority Men
KIU! Publications
- Li, D. H., Macapagal, K., Mongrella, M., Saber, R., & Mustanski, B. (2024). “Your Package Could Not Be Delivered”: The State of Digital HIV Intervention Implementation in the US. Current HIV/AIDS reports, 10.1007/s11904-024-00693-1. Advance online publication. https://doi.org/10.1007/s11904-024-00693-1
- Mustanski, B., & Macapagal, K. (2023). Clinical psychological science must move beyond documenting disparities in LGBTQ health toward eliminating them. Journal of consulting and clinical psychology, 91
(2), 57–59 https://doi.org/10.1037/ccp0000800
- Mustanski, B., Saber, R., Jones, J. P., Macapagal, K., Benbow, N., Li, D. H., Brown, C. H., Janulis, P., Smith, J. D., Marsh, E., Schackman, B. R., Linas, B. P., Madkins, K., Swann, G., Dean, A., Bettin, E., & Savinkina (2023). Keep It Up! 3.0: Study protocol for a type III hybrid implementation-effectiveness cluster-randomized trial.
Contemporary clinical trials, 127, 107134.
https://doi.org/10.1016/j.cct.2023.107134

- Macapagal, K., Li, D. H., Clifford, A., Madkins, K., & Mustanski, B. (2020). The CAN–DO–IT Model: A Process for Developing and Refining Online Recruitment in HIV/AIDS and Sexual Health Research. Current HIV/AIDS Reports, 17(3), 190–202. https://doi.org/10.1007/s11904-020-00491-5
This paper presents a practical model to guide researchers through online recruitment irrespective of platform. The CAN-DO-IT model reflects 7 iterative steps based on work by the authors and other investigators on Keep It Up and other online interventions: conceptualize scope of recruitment campaign, acquire necessary expertise, navigate online platforms, develop advertisements, optimize recruitment-to-enrollment workflow, implement advertising campaign, and track performance of campaigns and respond accordingly. The CAN-DO-IT model presents one approach to demystify online recruitment and reduce enrollment barriers.
- Nelson, K. M., & Macapagal, K. (2020). The Opportunities and Pitfalls of Using Patient Portals to Address the HIV Prevention Needs of Adolescent and Young Adult Sexual Minority Men. The Journal of adolescent health: official publication of the Society for Adolescent Medicine, 67(2), 149–150. https://doi.org/10.1016/j.jadohealth.2020.05.018

- Li, D. H., Brown, C. H., Gallo, C., Morgan, E., Sullivan, P. S., Young, S. D., & Mustanski, B. (2019). Design Considerations for Implementing eHealth Behavioral Interventions for HIV Prevention in Evolving Sociotechnical Landscapes. Current HIV/AIDS Reports, 16(4), 335–348. https://doi.org/10.1007/s11904-019-00455-4
In this paper, we aimed to provide researchers and developers with an implementation-focused approach and set of design considerations as they develop new eHealth programs. Using the Accelerated Creation-to-Sustainment model as a lens, we examined challenges and successes experienced during the development and evaluation of four diverse eHealth HIV prevention programs for young men who have sex with men: Keep It Up!, Harnessing Online Peer Education, Guy2Guy, and HealthMindr. We present a checklist of critical implementation questions to address during intervention development. The design considerations presented can be used by developers, evaluators, reviewers, and funders to prioritize the pragmatic scalability of eHealth interventions in research.
- Madkins, K., Moskowitz, D., Moran, K., Dellucci, T., Mustanski, B. (2019). Measuring Acceptability and Engagement of the Keep It Up! Internet–based HIV Prevention Randomized Controlled Trial for Young Men who have Sex with Men. AIDS Education and Prevention, 31(4), 287–305. https://doi.org/10.1521/aeap.2019.31.4.287
This paper examines acceptability and engagement of Keep It Up. Outcomes of interests were qualitative and quantitative acceptability and engagement measures, content ratings, and paradata. On average, participants rated content (4 out of 5 stars) and acceptability (3.5 out of 4) highly. Compared to White participants, Black participants found KIU! more useful, engaging, and acceptable; Latino participants found KIU! more engaging; and other non-White participants found KIU! more engaging and acceptable. Participants with high school or less education found KIU! more useful, engaging, acceptable, and deserving of five stars than college graduates and graduate degree holders. KIU! is a promising prevention tool for highest risk populations.
- Feinstein, B.A., Dellucci, T.V.,Graham, S., Parsons, J.T., & Mustanski, B. (2018). Sexually transmitted infections among young men who have sex with men: Experiences with diagnosis, treatment, and reinfection. Sexuality Research and Social Policy, 15:172-182. https://doi.org/10.1007/s13178-017-0312-y
This paper describes young men who have sex with men (YMSM) experiences with sexually transmitted infections (STIs) diagnosis, treatment, disclosure to partners, and changes in thinking and behavior. Reactions were diverse, the most common being surprise and concern. Most participants sought treatment, although the type of provider varied. Providers tended to retest participants, but some did so at the incorrect anatomical site. Participants who felt comfortable talking to providers about STIs tended to use their regular provider or one who specialized in gay/bisexual men’s health. Most participants described changes in their thinking and behavior (e.g., increased condom use, fewer sex partners, questioning whether or not they could trust their partners). Most participants disclosed to at least one partner, but some did not remember or were not in contact with partners. Implications for public policy and STI prevention are discussed.
- Feinstein, B.A., Dellucci, T.V., Sullivan, P.S., Mustanski, B. (2018). Characterizing Sexual Agreements With One’s Most Recent Sexual Partner Among Young Men Who Have Sex With Men. AIDS Education and Prevention, 30(4): 335-349. https://doi.org/10.1521/aeap.2018.30.4.335
This paper examines agreements with one’s most recent partner, individual differences across types of partnerships and agreements, and predictors of condomless anal sex (CAS). Two-thirds of participants did not have agreements. Monogamous agreements were most common among those who were seriously dating their partner, but also present among those who were casually dating their partner and those who were not dating their partner. Participants who were seriously dating their partner reported the most frequent sexual health communication. Participants without agreements reported the lowest frequency of and comfort with sexual health communication. Participants who were seriously dating their partner and those with monogamous agreements were most likely to report CAS. HIV prevention should address communication with serious and casual partners.
- Madkins, K., Greene, G.J., Hall, E. et al. (2018). Attrition and HIV Risk Behaviors: A Comparison of Young Men Who Have Sex with Men Recruited from Online and Offline Venues for an Online HIV Prevention Program. Arch Sex Behav, 47(7): 2135. https://doi.org/10.1007/s10508-018-1253-0
In this paper, we examine the impact of recruitment venue on participant demographics, behavioral HIV risks, and enrollment. Keep It Up participants were screened for eligibility from community-based organizations, Facebook, dating apps, and outreach events. There were significant differences by venue in age, race/ethnicity, sexual orientation, relationship status, and region of recruitment. There were no significant differences by venue in attrition during the enrollment process. The only difference in attrition was by race/ethnicity. Compared to White participants, eligible Black and Latino participants were significantly less likely to enroll in the intervention. There were also no significant differences by recruitment venue in sexual risk behaviors among enrolled participants. These findings suggest that recruitment into online HIV interventions from a variety of venues is feasible for diverse YMSM who are at similar risk for HIV infection.
-
Mustanski, B., Parsons, J. T., Sullivan, P. S., Madkins, K., Rosenberg, E., & Swann, G. (2018). Biomedical and Behavioral Outcomes of Keep It Up!: An eHealth HIV Prevention Program RCT. American journal of preventive medicine, 55(2), 151–158. https://doi.org/10.1016/j.amepre.2018.04.026
A total of 901 participants were enrolled in a double-blinded RCT of Keep It Up! with 1-year follow-up. After completing baseline surveys and sexually transmitted infection testing, participants were randomized by an eHealth platform to the intervention or control condition. The Keep It Up! intervention resulted in significantly lower sexually transmitted infection incidence and a small but significant decrease in condomless anal sex 12 months post-intervention relative to an online HIV knowledge condition. In addition, this study demonstrated the feasibility and acceptability of at-home sexually transmitted infection testing as part of an eHealth intervention.
- Feinstein, B., Johnson, B., Parsons, J., &Mustanski, B. (2017). Reactions to Testing HIV Negative: Measurement and Associations with Sexual Risk Behaviour Among Young MSM Who Recently Tested HIV Negative. AIDS and Behavior. doi:10.1007/s10461-016-1525-4.

In this paper, we validate the Inventory of Reactions to Testing HIV Negative measure in the Keep It Up study and to examine its associations with condomless anal sex (CAS). Factor analysis identified four factors, three of which were the same as the original factors (Reinforced Safety, Luck, and Invulnerability) and one that was novel (Reinforced Risk). Construct validity was demonstrated with associations between subscales and constructs from the IMB model of HIV prevention. Lower Reinforced Safety and higher Luck and Reinforced Risk were associated with more CAS. Associations between Reinforced Safety and Luck with CAS were stronger for those who reported more lifetime HIV tests. Findings highlight the importance of reactions to testing HIV-negative and suggest that they become more important with repeated testing.
- Feinstein, B., Moody, R.L., John, S.A., Parsons, J.T., & Mustanski, B. (2017). A three-city comparison of drug use and drug use before sex among young men who have sex with men in the United States. Journal of Gay & Lesbian Social Services, 30:1. https://doi.org/10.1080/10538720.2018.1408519
This paper examines demographic differences in drug use and drug use before sex. Marijuana was the most commonly used drug, but alkyl nitrites (“poppers”), cocaine, and Ecstasy were also commonly used. Drug use was more prevalent among older and White young men who have sex with men, and it was similar across cities, although use of poppers and polydrug use were more common in New York City. Our data generally support national prevention efforts.
- Motley, D.N., Hammond, S., Mustanski. B. (2017). Strategies Chosen by YMSM During Goal Setting to Reduce Risk for HIV and Other Sexually Transmitted Infections: Results From the Keep It Up! 2.0 Prevention Trial. AIDS Education and Prevention, 29(1): 1-13. doi: 10.1521/aeap.2017.29.1.1.
This paper utilizes qualitative data from Keep It Up to examine young men who have sex with men goals for sexual risk reduction. Goals tended to focus on strategies used to prepare for safer sex or strategies to be used during sex. In both areas, five categories of strategies were identified: skill-related, intrapersonal, social, contextual, and instrumental. Findings suggest opportunities for more tailored eHealth intervention by focusing on strategies in domains of most use to the individual. Future research should include longitudinal assessment of barriers and facilitators to goal adherence, utility of goals in increasing safer sex behaviors, and changes to goals over time.
- Mustanski, B., Feinstein, B. A., Madkins, K., Sullivan, P., Swann, G. (2017). Prevalence and risk factors for rectal and urethral sexually transmitted infections from self-collected samples among young men who have sex with men participating in the Keep It Up! 2.0 randomized controlled trial. Sexually Transmitted Diseases. doi: 10.1097/OLQ.0000000000000636.
This paper examines the prevalence and risk factors for rectal and urethral chlamydia and gonorrhea. Viability of self-collected samples was examined as a potential method to increase STI screening for young men who have sex with men (YMSM) without access to STI testing clinics. Results indicated that 15.1% of participants tested positive for an STI, 13.0% for a rectal STI, 3.4% for a urethral STI, and 1.2% for both
- Mustanski B, Madkins K, Greene GJ, Parsons JT, Johnson BA, Sullivan P, Bass M, Abel R. (2017). Internet-Based HIV Prevention with At-Home Sexually Transmitted Infection Testing for Young Men Having Sex With Men: Study Protocol of a Randomized Controlled Trial of Keep It Up! 2.0. JMIR Res Protoc. doi: 10.2196/resprot.5740.
This paper describes the protocol for the Keep It Up 2.0 intervention. Baseline enrollment for the RCT was completed on December 30, 2015, and assessment of intervention outcomes occurred at 3-, 6-, and 12-month time points. Our approach is innovative in linking an eHealth solution to HIV and STI home testing, as well as serving as a model for integrating scalable behavioral prevention into other biomedical prevention strategies.
- Strauss, B.B., Phillips, G., Bhatia, R., Madkins, K., Parsons, J.T., & Mustanski, B. (2016). Exploring Patterns of Awareness and Use of HIV Pre-exposure Prophylaxis among Young Men who Have Sex with Men. AIDS and Behavior, 1 –11. http://dx.doi.org/10.1007/s10461-016-1480-0
In this paper, we examined differences in pre-exposure prophylaxis (PrEP) awareness and use. While 67.5 % of participants reported awareness of PrEP, 8.7 % indicated using the medication. Awareness, but not use, varied by demographic variables. PrEP-users had twice as many condomless anal sex partners and more condomless anal sex acts than non-users. Future research should aim to improve PrEP awareness and uptake among YMSM and address condom use.
- Greene, G. J., Madkins, K., Andrews, K., Dispenza, J., & Mustanski, B. (2016). Implementation and evaluation of the keep it up! online HIV prevention intervention in a community-based setting. AIDS Education and Prevention, 28(3), 231-245. https://doi.org/10.1521/aeap.2016.28.3.231
This paper discusses the implementation and evaluation of Keep It Up in a community-based setting. Topics covered include the use of the U.S. Centers for Disease Control’s (CDC) Map of Adaptation Process as a guideline to adapt KIU! for delivery in a community-based setting and a summary of the adaptations and the themes and axial codes for the intervention acceptability
- Mustanski, B., Garofalo, R., Monahan, C., Gratzer, B., & Andrews, R. (2013). Feasibility, acceptability, and preliminary efficacy of an online HIV prevention program for diverse young men who have sex with men: The Keep It Up! intervention. AIDS and Behavior, 17(9), 2999. https://doi.org/10.1007/s10461-013-0507-z
This paper evaluated the feasibility, acceptability, and preliminary efficacy of Keep It Up!. The intervention was designed to be delivered to diverse young men who have sex with men (YMSM) upon receiving an HIV negative text result, with the goal for them to “Keep It Up” and stay negative. In a randomized clinical trial, the intervention was compared to an online didactic HIV knowledge condition. The study sample included 102 sexually active YMSM. Participants reported completing online modules in settings that were private and not distracting. Mixed methods data showed intervention participants felt the program was valuable and acceptable. Compared to the control condition, participants in the intervention arm had a 44 % lower rate of unprotected anal sex acts at the 12-week follow-up.