So you want IR illumination with out the IR?
If you place something directly in front of the IR illuminator, there’s a good chance all that light will be directed back at the camera, and you’ll just see a big wash out.
You could try placing your own IR floods, and place them far away or up high - but know that some people are sensitive enough to see some IR waves (you seem to be one, since you’re noticing the dim red glow).
As far as this being an “issue”, please note, most of the cameras on the market use this exact same technology. There’s nothing to fix.