How to get broken glass off a picture?

One of my 8×10 picture frames broke the other day and there is still a small piece of the glass stuck to the picture, when I tried to pull it off, the picture began to rip, so I just left it alone. Do you know a way to get the glass off without harming the photo?