SAFformer:Improving Spiking Transformer via Active Predictive Filtering

23d ago · Global · primary source: export.arxiv.org

A new spiking neural network architecture called SAFformer has set performance records on multiple image classification benchmarks while operating with sharply reduced energy consumption, according to a paper posted on the arXiv preprint server [1]. The model, detailed in a submission last revised on June 12, 2026, is built around what its authors call an active predictive filtering paradigm [1]. Rather than passively processing all incoming visual data, SAFformer is designed to suppress predictable signals and concentrate computation on salient features, an approach inspired by the brain's predictive coding mechanism [1][2]. The work was led by Zequan Xie [1]. On the CIFAR-10, CIFAR-100, and CIFAR10-DVS datasets, the architecture established new state-of-the-art results [1][2]. On the larger ImageNet-1K benchmark, SAFformer reached 80.44% Top-1 accuracy using 26.58 million parameters and consuming 5.88 millijoules of energy [1][2]. The authors describe this as an exceptional balance between accuracy and efficiency [2]. Spiking Neural Networks, the broader family to which SAFformer belongs, have drawn research interest because their event-driven computation mimics biological neurons and can yield substantial energy savings compared to conventional artificial neural networks [2]. The paper argues that existing Spiking Transformers have been limited by a passive reactive paradigm that struggles to isolate task-relevant information and wastes computation on redundant visual data [1][2]. The preprint appeared on arXiv, an open-access repository that hosts electronic preprints across physics, mathematics, computer science, and related fields [6]. Founded in 1991, the repository now receives roughly 24,000 submissions per month and has surpassed two million total articles [6]. Papers on arXiv are moderated but not peer-reviewed before posting [6]. The SAFformer manuscript was submitted on May 8, 2026, and updated a month later [1]. The paper's abstract page also links to several community-developed tools through the arXivLabs framework, including the Bibliographic Explorer for navigating citation trees and the CORE Recommender for surfacing related open-access research [4][5]. arXivLabs, formalized in 2020, allows third-party collaborators to build experimental features on top of the repository while adhering to arXiv's values of openness, community, excellence, and user data privacy [4].

research-paperbenchmarkapplication

Background sources we checked (7)
  • arxiv.org ↗ Spiking Neural Networks (SNNs) offer notable advantages in biological plausibility and energy efficiency, making them promising candidates for building low-power Transformers. However, existing Spiking Transformers largely adhere to a passive reactive paradigm, which struggles to…
  • info.arxiv.org ↗ arXiv Labs - arXiv info | arXiv e-print repository Skip to content # arXiv Labs Attention arXiv Users: arXiv Labs is pausing new proposals ## What are arXiv Labs? arXiv Labs are a way for the community to contribute new, useful features to arXiv. These integrations are avail…
  • blog.arxiv.org ↗ arXivLabs: a space for community innovation – arXiv blog arXiv has launched a new, formalized framework enabling innovative collaborations with individuals and organizations. “Members of our community want to contribute tools that enhance the arXiv experience, and we val…
  • info.arxiv.org ↗ arXivLabs: Showcase - arXiv info | arXiv e-print repository ... # arXivLabs: Showcase ... arXiv is surrounded by a community of researchers and developers working at the cutting edge of information science and technology. ... While the arXiv team is focused on our core mission—pr…
  • en.wikipedia.org ↗ arXiv (pronounced as "archive"—the X represents the Greek letter chi ⟨χ⟩) is an open-access repository of electronic preprints and postprints (known as e-prints) approved for posting after moderation, but not peer reviewed. It consists of scientific papers in the fields of mathem…
  • en.wikipedia.org ↗ 14 (fourteen) is the natural number following 13 and preceding 15.…
  • en.wikipedia.org ↗ A large language model (LLM) is a type of machine learning model designed for natural language processing tasks such as language generation. LLMs are language models with many parameters, and are trained with self-supervised learning on a vast amount of text.…

Sources

Spot something wrong? Report an issue