Procedural Fish Modeling

Homepage

Videos

Ablation Study

Evaluation

Practicality Evaluation

Text-to-3D

We show the generated fish models with the species name as text token by using different text-to-3D methods.

Clown Fish

Goldfish

Koi

Tuna

We also conducted a user study that asks users to pick their prefered model in a pairwise-comparison manner, and the votes are summarized as below. The number in bold indicates the highest vote among three methods.

Species	Ours	DreamFusion	DreamGaussian	\(u\)	\(\chi^2\)
Clown Fish	28	14	0	1.00	42.00
Goldfish	24	17	1	0.61	26.86
Koi	24	18	0	0.71	30.57
Tuna	28	12	2	0.82	35.14

Image-to-3D

We show the generated fish models with the ground-truth image as input by using different image-to-3D methods.

We evaluate the method by computing the PSNR and SSIM between the captured appearance of the ground truth and generated models. The number in bold indicates the best method.

	American Flag Fish		Angular Butterfly		Bicolor Blenny		Blue Tang		Boesemani Rainbow		Clown Fish		Coryphaena Hippurus		Long FIn White Cloud		Mackerel		Seattle Aquarium
	PSNR	SSIM	PSNR	SSIM	PSNR	SSIM	PSNR	SSIM	PSNR	SSIM	PSNR	SSIM	PSNR	SSIM	PSNR	SSIM	PSNR	SSIM	PSNR	SSIM
Ours	23.00	0.88	22.88	0.92	24.63	0.90	20.78	0.86	24.47	0.90	21.64	0.89	24.87	0.93	21.59	0.87	23.15	0.93	18.63	0.82
SfM	15.50	0.74	13.90	0.82	15.35	0.84	16.15	0.84	17.61	0.81	15.88	0.82	15.20	0.84	15.37	0.82	15.18	0.84	14.03	0.74
LRM	14.62	0.72	15.79	0.83	17.46	0.82	16.20	0.79	18.01	0.79	14.27	0.79	17.20	0.84	16.39	0.82	17.11	0.87	14.19	0.76

Texturing

We show the textured fish models with the ground-truth image as input and the geometry generated by our PFG as the texturing base by using different texturing methods.

We evaluate the method by computing the PSNR and SSIM between the captured appearance of the ground truth and generated models. The number in bold indicates the best method.

	American Flag Fish		Angular Butterfly		Bicolor Blenny		Blue Tang		Boesemani Rainbow		Clown Fish		Coryphaena Hippurus		Long FIn White Cloud		Mackerel		Seattle Aquarium
	PSNR	SSIM	PSNR	SSIM	PSNR	SSIM	PSNR	SSIM	PSNR	SSIM	PSNR	SSIM	PSNR	SSIM	PSNR	SSIM	PSNR	SSIM	PSNR	SSIM
Ours	23.00	0.88	22.88	0.92	24.63	0.90	20.78	0.86	24.47	0.90	21.64	0.89	24.87	0.93	21.59	0.87	23.15	0.93	18.63	0.82
Latent-Paint	18.86	0.79	15.32	0.84	19.01	0.87	14.09	0.79	16.51	0.84	17.11	0.81	19.74	0.88	19.76	0.87	17.84	0.89	13.48	0.75
TEXTure	19.35	0.80	17.36	0.87	21.36	0.87	17.59	0.82	21.20	0.85	17.47	0.82	21.16	0.89	19.97	0.87	19.48	0.89	15.04	0.77