Illusion

"As with many so-called illusions, this effect really demonstrates the success rather than the failure of the visual system. The visual system is not very good at being a physical light meter, but that is not its purpose. The important task is to break the image information down into meaningful components, and thereby perceive the nature of the objects in view."
Edward H. Adelson

3D from 2D image - II

I am curious, what will be the result of the system below if the input is one photo of a street art piece photographed from the right angle (like the one on the left) or paintings of Andrea Pozzo?

ps: Some notes about Anamorphic Perspective.