TL;DR, If you want virtual environment light gradually replacing your real-world shaded objects, use Virtual Environment Probe.
Achieving visual realism for virtual elements involves many parts, but lighting stands out as particularly challenging, especially in real-time rendering for platforms like visionOS and RealityKit.
Material surface behavior in response to