Anomaly-Preference Image Generation

28d ago · Global · primary source: export.arxiv.org

A research team led by Fuyun Wang has introduced Anomaly Preference Optimization (APO), a method that reframes the generation of synthetic anomaly images as a preference learning problem, bypassing the need for human annotation while improving both realism and diversity from limited real samples [1]. The approach, detailed in a paper posted to arXiv, targets a persistent bottleneck in industrial inspection and medical imaging: training robust anomaly detectors requires large, varied datasets of defects, yet real anomalies are scarce and costly to collect [1][2]. Existing generative methods tend to overfit on the few available examples, sacrificing diversity, or produce samples that drift from the true defect distribution [2]. APO addresses this by using real anomaly images as positive references and deriving optimization signals from deviations in the diffusion model's denoising trajectory, a mechanism the authors call implicit preference alignment [2][3]. This stands in contrast to standard reinforcement learning from human feedback, which typically requires human annotators to rank outputs and train an explicit reward model [5]. By eliminating that annotation step, APO reduces the cost and potential bias associated with sourcing preference data [5]. The framework incorporates a Time-Aware Capacity Allocation module that distributes the model's adaptation capacity unevenly across the diffusion timeline. During high-noise phases, updates are limited to preserve structural diversity; in low-noise stages, capacity expands to capture fine-grained defect patterns [2][4]. A hierarchical sampling strategy then decouples semantic context from defect injection at inference time, giving practitioners precise control over the coherence-alignment trade-off in generated images [3][4]. The authors report that APO achieves state-of-the-art performance in both realism and diversity metrics and yields significant gains in downstream detection tasks when used to augment training data [2][3]. The work arrives as advances in deep learning and specialized hardware, such as the tensor cores in Nvidia's recently announced RTX 50 series GPUs, continue to accelerate computationally intensive generative modeling research [6][7].

research-papersafety-researchbenchmarkinfrastructure

Background sources we checked (6)
  • arxiv.org ↗ # Anomaly-Preference Image Generation [...] Synthesizing realistic and diverse anomalous samples from limited data is vital for robust model generalization. However, existing methods struggle to reconcile fidelity and diversity, often hampered by distribution misalignment and ove…
  • arxiv.org ↗ # Anomaly-Preference Image Generation [...] Synthesizing realistic and diverse anomalous samples from limited data is vital for robust model generalization. However, existing methods struggle to reconcile fidelity and diversity, often hampered by distribution misalignment and ove…
  • arxiv.org ↗ # Anomaly-Preference Image Generation [...] Synthesizing realistic and diverse anomalous samples from limited data is vital for robust model generalization. However, existing methods struggle to reconcile fidelity and diversity, often hampered by distribution misalignment and ove…
  • en.wikipedia.org ↗ In machine learning, reinforcement learning from human feedback (RLHF) is a technique to align an intelligent agent with human preferences. It involves training a reward model to represent preferences, which can then be used to train other models through reinforcement learning. I…
  • en.wikipedia.org ↗ Machine learning (ML) is a field of study in artificial intelligence concerned with the development and study of statistical algorithms that can learn from data and generalize to unseen data, and thus perform tasks without being explicitly programmed. Advances in the field of de…
  • en.wikipedia.org ↗ The GeForce RTX 50 series of consumer graphics cards is the successor of Nvidia's GeForce 40 series. Announced at CES 2025, it debuted with the release of the RTX 5070, RTX 5080 and RTX 5090 in January 2025. It is based on Nvidia's Blackwell architecture featuring Nvidia RTX's fo…

Sources

Spot something wrong? Report an issue