Glass Windows and Vaccuums?

I am learning about pressure in science class and I have a question about pressure on windows. In normal life, air pressure doesn’t collapse a window because it is pushing on it from all sides. However, I once saw a demonstration at a museum of a very small vaccuum in which a science experiment was performed. The sides were all made out of glass. Since the inside was a vaccuum, there was no air pressure inside it. Why didn’t the air crush the vaccuum canister? Is it possible to simply manafacture glass strong enough to resist that pressure? A good, scientifically backed answer will be appreciated.