I don't think that acrylic glazing would be a good idea, but different companies make a water-soluble glazing medium that would work better, so you might want to research that.
I usually just add a very small amount of walnut oil to make the glaze and that way I maintain the "Fat over Lean Rule." I prefer walnut oil, but any of the water-soluble oils such as WS Linseed Oil, made by the manufacturers of your WS Oil paints would also work.
I'm going to move this question into the Water Soluble Oils question forum where it would fit more appropriately.
Judy