VLM-Aware Meta-Optic Front-End Design for Frozen Vision-Language Models

A new optical design framework called CODA improves frozen vision-language model accuracy by optimizing meta-optic front-ends directly for recognition loss rather than conventional image quality, according to a preprint posted to arXiv [1]. The framework, described in a paper submitted June 26, 2026, targets size- and cost-constrained applications where traditional high-quality optics are impractical [1]. Conventional machine-vision pipelines prioritize resolution, aberration correction, and pixel fidelity, but compact meta-optics operate under strict physical efficiency limits that make those criteria difficult to satisfy [2]. CODA instead uses differentiable image formation and adjoint-gradient updates of Maxwell-based simulations to co-design a continuous-density meta-optic front-end for a frozen zero-shot CLIP classifier [1]. The approach directly optimizes cross-entropy loss without learned reconstruction, image signal processing, or image-fidelity auxiliary objectives [2]. In a two-dimensional simulated imaging benchmark on ImageNet-100, CODA raised CLIP ViT-L/14 zero-shot accuracy from 53.75 ± 3.57% with a focal-concentration baseline to 65.41 ± 3.99% [1]. The optimized optics transferred without re-optimization across CLIP, SigLIP, and DINOv2 on ImageNet-100, CIFAR-100, and Food-101 [2]. Meta-optics have drawn interest for edge devices and embedded vision systems where bulky lens assemblies are infeasible. The CODA results suggest that aligning optical design with frozen vision-model objectives, rather than human-interpretable image formation, can yield measurable gains in downstream recognition under constrained imaging conditions [1]. The work builds on broader trends in end-to-end differentiable design, where optimization frameworks originally developed for convex objectives and first-order methods have been adapted to physical simulation pipelines [3]. The paper has not yet been peer-reviewed. The authors note that the current experiments are limited to two-dimensional simulated imaging, and physical fabrication and testing remain future steps [1].