Neuron Populations Exhibit Divergent Selectivity with Scale
This paper explores how neuron populations in neural networks evolve with scale, revealing a sublinear growth pattern and increased selectivity in Rosetta Neurons.
Archive, newest first. Filter by topic, impact and company →
This paper explores how neuron populations in neural networks evolve with scale, revealing a sublinear growth pattern and increased selectivity in Rosetta Neurons.
This paper introduces PixVOD, a pixel-distributed approach for visual odometry and depth estimation using Gaussian Belief Propagation for enhanced efficiency.
This paper introduces Imaginative Perception Tokens (IPT) to enhance spatial reasoning in vision-language models, addressing limitations in unobservable contexts.
This paper introduces NewtPhys, a dataset for evaluating foundation models' understanding of Newtonian physics through realistic visual scenarios.
This paper presents Humanoid-GPT, a generative Transformer model that achieves zero-shot motion tracking through extensive pre-training on a large motion corpus.
This paper investigates how language models compare quantities with measurement units, revealing systematic errors and heuristic-based decision-making.
Skill-RM introduces a unified framework for reward modeling in LLMs, enhancing evaluation consistency and performance across diverse tasks.
This paper introduces a "Sleep" paradigm for LLMs, enabling continual learning and memory consolidation through a novel distillation process.
This paper formalizes the binding problem in visual recognition, introducing a method to measure binding information in Vision Transformers.
AAD-1 introduces an Asymmetric Adversarial Distillation framework that enhances one-step autoregressive video generation by addressing motion collapse and training instability.
This paper introduces Video-Mirai, a method that enhances autoregressive video diffusion models by incorporating foresight to improve future frame consistency.
This paper introduces a framework for quantifying faithful confidence expression in large reasoning models, addressing a critical gap in uncertainty communication.
This paper introduces QUBRIC, a framework that co-designs queries and rubrics to enhance reinforcement learning beyond verifiable rewards.
This paper introduces AlignAtt4LLM, a novel approach for simultaneous speech translation using decoder-only LLMs, achieving significant performance improvements.
This paper introduces Agentic Chain-of-Thought Steering (ACTS), a method for efficient and controllable reasoning in large language models using reinforcement learning.
This paper introduces AgenticRL, a self-refining framework for enhancing UAV navigation through autonomous reward design and policy refinement.
This paper introduces a novel reinforcement learning framework that incorporates reward uncertainty to promote diverse agent behavior without sacrificing performance.
This paper presents a novel augmentation pipeline for generating synthetic conversational data to enhance ASR training in low-resource languages.
This paper presents VLESA, a framework for real-time safety monitoring of human activities using egocentric video and goal-conditioned safety assessments.
This paper presents Demo2Tutorial, a framework that converts human interaction data into structured multimodal software tutorials, enhancing learning for both humans and agents.
This paper presents a compact offline model for simultaneous speech translation, achieving high quality and low computational requirements across multiple languages.
This paper introduces MLSkip, a novel data skipping technique for ML filters using lightweight metadata, enhancing query efficiency in data management.
This paper presents SEAOTTER, a novel compression framework that integrates learned autoencoding with standard JPEG for efficient visual data reconstruction in robotics.
This paper introduces FlashbackCL, a method to mitigate temporal forgetting in Federated Learning, enhancing model performance under data distribution shifts.
This paper introduces hyper-epoch pretraining (q0), a novel approach that enhances model diversity and efficiency in multi-epoch training.
This paper introduces VEPO, a novel reinforcement learning framework that enhances visual reasoning by integrating visual sensitivity with token entropy.
This paper introduces FreqNO-DPS, a method that mitigates spectral bias in neural operator surrogates using diffusion posterior sampling with sparse observations.
This paper demonstrates that quadratic integrate-and-fire neurons provide smoother loss landscapes and superior performance over leaky integrate-and-fire neurons in spiking neural networks.
This paper introduces Value-aware Stochastic KV Cache Eviction (VaSE), enhancing reasoning model efficiency while maintaining accuracy through improved cache management.
This paper introduces FFR, a novel framework extending Forward-Forward learning to regression tasks, achieving competitive accuracy with reduced resource consumption.