Procedural Fish Modeling

   A great number of fish with various species are commonly involved in animations and games that take place in underwater worlds. However, it is time- and man-power intensive to craft them with 3D software. Therefore, we propose Procedural Fish Generation, which guides the automatic generation with one lateral image. The core lies in parameterizing the ray-finned fish with controlling curves and optimizing them with textures to the input using differentiable rendering. Our method presents advantages over multi-image reconstruction in only requiring single image while outputting a polygon mesh, the most common format for games and animations. Furthermore, we fine tune the text prompt for Stable Diffusion while users can easily type a name to ease the difficulty of finding high-quality lateral images. We have done extensive ablation studies and comparisons on collected models against baselines, and ours is capable of semi-automatically producing high-quality fish using single lateral image.