I have some sea glass that I want to drill small holes in to to use for jewlery.?

I have a dremel but the bit won’t even phase the glass. I thought I was using a diamond bit but now I’m not for sure. Are there any idea what I should do.