Carroll was born in Cincinnati, Ohio. His acting career is rooted in the theatre. In 1981, Carroll graduated from the famed School for the Creative and Performing Arts. Determined to further his knowledge of acting, he attended Webster University’s Conservatory of Theatre Arts in St. Louis, where he graduated with a B.F.A. degree. After graduating, Carroll decided to test the waters by moving to New York City, the heart of the theater community. There, he introduced many young children of color to the works of William Shakespeare by participating in Joe Papp’s “Shakespeare on Broadway” series.

As part of Joe Papp’s acclaimed New York Shakespeare Festival, Carroll helped to open doors for actors of color, by taking on non-traditional roles that were rarely portrayed by black actors in Shakespeare dramas. In 1987, Carroll was introduced to the works of August Wilson. The up and coming and talented young actor was allowed to recreate his role for the Broadway production of Wilson's critically acclaimed story The Piano Lesson. The play not only earned a Pulitzer Prize for Drama, but Carroll earned a Tony and Drama Desk nomination.

He is known for playing the part of Joey on the television series Roc. He also had a starring role as Dr. Keith Wilkes in the TV series Chicago Hope. Carroll has guest starred in several other TV programs including The Agency, Boston Legal, Family Law, The West Wing, and Law & Order. Carroll has had roles in many hollywood films such as Born on the Fourth of July, The Ladies Man,Crimson Tide, The Great White Hype, A Prelude to a Kiss, The Chase, Best Laid Plans, and others.