Does anyone know how to remove glass chalk from rubber black trim around windows?

My friends used glass chalk on my car and there is some residue on the rubber trim around the window. Is there a way to get it off of that trim?