Is it safe to use a cover on a light bulb?

Yes, it's fine. The cover is thick gl and can handle the (relatively) low levels of heat given off by the light bulb.