Author: insights

1. Concerto: Joint 2D-3D Self-Supervised Learning Emerges Spatial Representations 🔑 Keywords: Concerto, 3D self-distillation, 2D-3D joint embedding, open-world perception, scene understanding 💡 […]

1. Every Attention Matters: An Efficient Hybrid Architecture for Long-Context Reasoning 🔑 Keywords: Ring-linear model series, hybrid architecture, linear attention, softmax attention, […]

1. LightMem: Lightweight and Efficient Memory-Augmented Generation 🔑 Keywords: LightMem, Large Language Models, Memory Systems, Atkinson-Shiffrin Model, Sensory Memory 💡 Category: Natural […]

1. A Theoretical Study on Bridging Internal Probability and Self-Consistency for LLM Reasoning 🔑 Keywords: Test-time scaling, large language models, self-consistency, perplexity, […]

1. When Models Lie, We Learn: Multilingual Span-Level Hallucination Detection with PsiloQA 🔑 Keywords: PsiloQA, Hallucination detection, large language models, multilingual, span-level […]

1. UniMoE-Audio: Unified Speech and Music Generation with Dynamic-Capacity MoE 🔑 Keywords: AI-generated summary, Dynamic-Capacity Mixture-of-Experts, cross-domain synergy, speech and music generation, […]

1. Spatial Forcing: Implicit Spatial Representation Alignment for Vision-language-action Model 🔑 Keywords: Vision-language-action models, Spatial Forcing, 3D foundation models, Robotic tasks 💡 […]

1. QeRL: Beyond Efficiency — Quantization-enhanced Reinforcement Learning for LLMs 🔑 Keywords: QeRL, Quantization, Reinforcement Learning, Large Language Models, Exploration 💡 Category: […]

1. D2E: Scaling Vision-Action Pretraining on Desktop Data for Transfer to Embodied AI 🔑 Keywords: Embodied AI, Desktop environments, Sensorimotor interactions, OWA […]

1. Agent Learning via Early Experience 🔑 Keywords: early experience, reinforcement learning, self-reflection, out-of-domain generalization, AI-generated 💡 Category: Reinforcement Learning 🌟 Research […]

1. Cache-to-Cache: Direct Semantic Communication Between Large Language Models 🔑 Keywords: Cache-to-Cache, Large Language Models, neural network, direct semantic communication, latency 💡 […]

1. LongCodeZip: Compress Long Context for Code Language Models 🔑 Keywords: LongCodeZip, Large Language Models, code compression, context pruning 💡 Category: AI […]