JavaScript is unavailable, so some features (menu/search) are unavailable. Check browser or extension settings.
Relight
What is Relighting?
Relighting is the task of adjusting the lighting of an image.
It falls into two broad types:
Relighting for compositing: when you combine a foreground with a background, it adjusts the foreground's lighting to blend in with the background.
Virtual-light relighting: you place virtual light sources, and the lighting is changed using depth maps and normal maps as a guide.
Relighting for Compositing
When you paste a cut-out person or object onto a different background, things like the light direction, color temperature, and contrast don't match the background, so it looks obviously pasted in.
Before AI, you could painstakingly fix this in Photoshop and the like, but let's just knock it out quickly with generative AI!
Diffusion model-based relighting like IC-Light / LBM
By training on huge numbers of images, diffusion models pick up more than just the ability to "generate images." They also learn statistical knowledge like "this looks more natural" or "if the light comes from here, the shadow falls like this."
Methods like IC-Light and LBM use this to relight just the foreground so it matches the background.
The idea is close to refining rough collages: you have the model "edit" whatever you placed in the foreground so it blends naturally into the background.
Of course, it can also relight in the simpler sense of changing the scene (making it night, evening, and so on) rather than compositing.
The other type of relighting places virtual light sources in the scene.
ClipDrop Relight
It estimates depth and normal maps, lets you place virtual lights like "a spotlight here" or "sunlight from over there," and recalculates shading and highlights to match those lights.
It's closer to a CG or image processing task. Tools like ClipDrop Relight and LightLab fall into this group.
There's plenty of research, but unfortunately not much of it is practical to use in ComfyUI yet.
