Procedural Fish Modeling
A great number of fish with various species are commonly involved in animations and games that take place in underwater worlds.
However, it is time- and man-power intensive to craft them with 3D software. Therefore, we propose Procedural Fish Generation, which guides the automatic generation with one lateral image.
The core lies in parameterizing the ray-finned fish with controlling curves and optimizing them with textures to the input using differentiable rendering.
Our method presents advantages over multi-image reconstruction in only requiring single image while outputting a polygon mesh, the most common format for games and animations.
Furthermore, we fine tune the text prompt for Stable Diffusion while users can easily type a name to ease the difficulty of finding high-quality lateral images.
We have done extensive ablation studies and comparisons on collected models against baselines, and ours is capable of semi-automatically producing high-quality fish using single lateral image.