Structure Reference
With the growth of Adobe Firefly, I have been busy working on multiple related technologies. One key ingredient for text-to-image applications is controllability, and we have recently announced Structure Reference as another form of user control. Simply put, it estimates the depth of a reference image and then performs the text-to-image synthesis conditioned on this depth estimate. I have provided the underlying depth estimator, which is something that started with our 3D Ken Burns paper that I have been continuously improving throughout the last few years.