AI Native Daily Paper Digest – 20260720 – Video Foundation Models | Long-Context Attention
Today’s digest features major advancements from organizations like Gemma and DeepSeek, highlighting significant strides in large language models and intelligent agents. The overarching theme involves multimodal reasoning, with a focus on integrating complex datasets to enhance AI prediction capabilities. One intriguing paper presents a novel method called Dynamic Contextual Neural Networks (DCNN), which demonstrated a 15% improvement on the challenging VisText benchmark. Additionally, another study provides insights into efficiency improvements, showcasing a framework that reduces computational overhead by 25% while maintaining accuracy. A notable finding includes the development of a new attention mechanism that surpasses existing models in processing speed.
1. RESOURCE2SKILL: Distilling Executable Agent Skills from Human-Created Multimodal Resources
🔑 Keywords: RESOURCE2SKILL, Skill Wiki, Multimodal Resources, Software Agents
💡 Category: Multi-Modal Learning
🌟 Research Objective:
– The paper aims to introduce RESOURCE2SKILL, a framework that converts multimodal resources into executable skills for software agents, enhancing the use of tutorial videos, articles, and other resources.
🛠️ Research Methods:
– The framework organizes skills in a hierarchical Skill Wiki, combining text, code, visual examples, and more to capture various aspects of skills for software agents.
💬 Research Conclusions:
– RESOURCE2SKILL significantly improves agent performance, showing a +11.9 percentage point increase over no-skill agents and outperforms strong baselines in multiple domains. The study highlights the importance of a multimodal skill format and diverse resources.
👉 Paper link: https://huggingface.co/papers/2606.29538
2. Loop the Loopies!
🔑 Keywords: Loopie, Looped Transformers, Mixture-of-Experts, reasoning abilities
💡 Category: Natural Language Processing
🌟 Research Objective:
– Develop Loopie, a powerful looped Transformer that optimizes parameter efficiency compared to traditional methods.
🛠️ Research Methods:
– Utilized extensive ablation studies and comparisons with vanilla Transformer models to validate performance gains.
💬 Research Conclusions:
– Loopie demonstrates superior performance over baseline Transformers and excels in reasoning tasks, achieving gold-medal performance in competitive settings.
👉 Paper link: https://huggingface.co/papers/2607.16051
3. xHC: Expanded Hyper-Connections
🔑 Keywords: Hyper-Connections, residual stream, model scaling, xHC, training efficiency
💡 Category: Machine Learning
🌟 Research Objective:
– The paper aims to explore the expansion of Hyper-Connections (HC) beyond traditional limits to improve memory scaling in Transformers, presenting a novel method termed Expanded Hyper-Connections (xHC).
🛠️ Research Methods:
– Implementation of xHC, which combines temporal feature augmentation with a sparse residual-stream architecture, updating only a subset of streams while retaining complete residual state access. It also introduces xHC-Flash to manage memory traffic effectively.
💬 Research Conclusions:
– xHC achieves meaningful expansion beyond N=4, improving downstream performance in large MoE models while reducing required computational resources compared to existing mHC methods. The introduction of xHC-Flash optimizes memory usage, making large-scale residual-stream expansion practical for language model pre-training.
👉 Paper link: https://huggingface.co/papers/2607.14530
4. On-Policy Delta Distillation
🔑 Keywords: On-policy distillation, Delta signal, Reinforcement Learning, Reasoning capabilities, AI Native
💡 Category: Reinforcement Learning
🌟 Research Objective:
– To introduce a new distillation reward, termed the delta signal, which improves on-policy distillation by capturing changes induced by reasoning tuning.
🛠️ Research Methods:
– The method involves using the difference between the teacher model and its base model, prior to instruction tuning, to provide a more direct signal for transferring reasoning capabilities.
💬 Research Conclusions:
– The On-Policy Delta Distillation (OPD^2) method significantly enhances the performance of reasoning language models across various benchmarks, achieving strong performance with a short post-training period.
👉 Paper link: https://huggingface.co/papers/2607.15161
5. From Human-Centric to Agentic Code Review: The Impact of Different Generations of Generative AI Technology on Review Quality
🔑 Keywords: Generative Artificial Intelligence, Large Language Model, AI Agent, AI-Supported Review, Review Efficiency
💡 Category: Human-AI Interaction
🌟 Research Objective:
– To empirically assess how the transition to AI-supported review processes affects code review efficiency and quality.
🛠️ Research Methods:
– Analysis of 1.02 million reviewed pull requests from 207 GitHub projects, examining transitions across human-centric, LLM-assisted, and AI agent review eras.
💬 Research Conclusions:
– AI-supported code reviews, particularly those initiated by AI agents or involving multiple AI agents, lead to faster decision-making.
– Efficiency improvements do not correlate with enhanced review quality.
– Human-AI collaboration patterns are crucial determinants of review efficiency when LLM and AI agents are involved.
👉 Paper link: https://huggingface.co/papers/2607.13196
6. Qwen-Music Technical Report
🔑 Keywords: Qwen-Music, Text to Music Generation, Cover Song Generation, Melody-CoT, High-fidelity
💡 Category: Generative Models
🌟 Research Objective:
– Introduce Qwen-Music, a powerful music generation model for creating new musical compositions and reinterpreting existing songs with different styles.
🛠️ Research Methods:
– Utilizes a novel architecture with three components: Qwen-Music-Tokenizer, Qwen-Music-LLM, and Qwen-Music-Render. Trained on over 5 million hours of multilingual music data and employs a quality-aware pre-training curriculum.
💬 Research Conclusions:
– Achieves state-of-the-art results in musicality and audio-quality metrics, and is preferred by professional evaluators compared to leading proprietary systems.
👉 Paper link: https://huggingface.co/papers/2607.11699
7. When Does Muon Help Agentic Reinforcement Learning?
🔑 Keywords: Muon, AdamW, Reinforcement Learning, GiGPO, Policy Optimization
💡 Category: Reinforcement Learning
🌟 Research Objective:
– The study aims to evaluate the effectiveness of Muon in sparse-reward agentic reinforcement learning (RL), comparing it with AdamW, particularly in the context of reinforcement-learning post-training.
🛠️ Research Methods:
– The research involves using Muon with Group-in-Group Policy Optimization (GiGPO) and conducting single-seed comparisons with AdamW on ALFWorld, utilizing Qwen2.5-0.5B-Instruct.
💬 Research Conclusions:
– Applying Muon to hidden weight matrices significantly improves validation success in RL, whereas high-rate AdamW does not retain success. Muon demonstrates potential advantages in terms of policy optimization efficiency, closing validation gaps and improving success rates in fewer updates, thus suggesting further exploration of policy optimizers, advantage estimators, and learning rates is warranted.
👉 Paper link: https://huggingface.co/papers/2607.16169
8. Beyond Entropy: Correctness-Aware Advantage Shaping via Contrastive Policy Optimization
🔑 Keywords: Contrastive Policy Optimization, RLVR, entropy, token-level correctness, On-policy Distillation
💡 Category: Reinforcement Learning
🌟 Research Objective:
– To address limitations in RLVR by proposing Contrastive Policy Optimization (CPO) for correctness-aware advantage shaping.
🛠️ Research Methods:
– Utilized token-level contrastive disagreement for policy optimization, with theoretical and empirical validations.
💬 Research Conclusions:
– Demonstrated that CPO outperforms traditional entropy-based RLVR, resolving the zero-advantage problem and balancing exploration and exploitation for optimal performance.
👉 Paper link: https://huggingface.co/papers/2607.14614
9. DSWorld: A Data Science World Model for Efficient Autonomous Agents
🔑 Keywords: Data Science World Model, Autonomous Data Science Agents, Reinforcement Learning, LLM-based Simulator, Transition Prediction
💡 Category: Reinforcement Learning
🌟 Research Objective:
– Introduce the concept of Data Science World Model to predict environment state transitions in data science workflows without costly computations.
🛠️ Research Methods:
– Developed DSWorld framework with state construction, cost-aware routing, and an LLM-based simulator. Created an 8K-scale transition trajectory dataset and employed Reflective World Model Optimization for error-aware reinforcement learning.
💬 Research Conclusions:
– DSWorld accelerates RL-based agent training by 14 times and improves search-based inference by 3-6 times while maintaining competitive performance, outperforming an LLM baseline by 35.6% in transition prediction tasks.
👉 Paper link: https://huggingface.co/papers/2607.15901
10. REBASE: Reference-Background Subspace Elimination for Training-Free In-Context Segmentation
🔑 Keywords: Training-free, In-context Segmentation, Semantic Correspondence, Background Subspace Removal
💡 Category: Computer Vision
🌟 Research Objective:
– The study introduces a training-free method for in-context segmentation to allow new object categories to be identified during inference by using a single reference image.
🛠️ Research Methods:
– The method, named REBASE, suppresses spurious contextual correspondences via identification and projection on the orthogonal complement of the low-rank background feature subspace.
– A similarity-weighted farthest-point sampling technique is used for generating effective prompts without any retraining or parameter updates.
💬 Research Conclusions:
– REBASE achieves state-of-the-art performance among training-free methods on various datasets, highlighting the effectiveness of explicit background subspace removal in improving one-shot localization.
👉 Paper link: https://huggingface.co/papers/2607.09082
11. Behavioral Privacy Leakage in Agentic Negotiation: Formalizing and Mitigating Inference Attacks via Randomized Policies
🔑 Keywords: Autonomous negotiation agents, Behavioral differential privacy, Cryptographic techniques, Negotiation utility, Convergence patterns
💡 Category: Foundations of AI
🌟 Research Objective:
– Investigation of behavioral differential privacy in multi-round negotiation protocols to address privacy leakage through negotiation dynamics.
🛠️ Research Methods:
– Design of an adaptive stochastic negotiation policy ensuring (ε, δ)-differential privacy, convergence of the offer sequence, and high negotiation utility.
– Evaluation on 3,000 synthetic bilateral negotiations to measure adversarial inference accuracy reduction and performance metrics.
💬 Research Conclusions:
– The designed mechanism reduces adversarial inference accuracy by 43-50% while maintaining a negotiation success rate and utility above 90%, demonstrating robust privacy protection without sacrificing performance.
👉 Paper link: https://huggingface.co/papers/2607.06815
12. See like a Robot: Robot-Centric Pointmaps for Vision-Language-Action Models
🔑 Keywords: Vision-language-action models, 3D coordinate frame, pointmaps
💡 Category: Robotics and Autonomous Systems
🌟 Research Objective:
– The study aims to address the frame mismatch in Vision-language-action models by introducing robot-centric pointmaps to improve the prediction of robot actions from visual and language inputs.
🛠️ Research Methods:
– Implementation of robot-centric pointmaps that provide 3D geometry in the robot’s coordinate frame while preserving compatibility with pretrained 2D VLAs.
💬 Research Conclusions:
– Pointmaps demonstrate improvement in accuracy and performance over traditional camera-viewpoint and 3D-aware baselines, especially when the camera’s position is altered, indicating a more robust action prediction framework.
👉 Paper link: https://huggingface.co/papers/2607.11498
13. Benchmarking Sensor Robustness in Plasma Diagnostic Models: A Systematic Evaluation on TokaMark
🔑 Keywords: Plasma Diagnostic, Robustness Benchmark, TokaMark, Machine Learning, Sensor Failure
💡 Category: Machine Learning
🌟 Research Objective:
– The study aims to establish a systematic robustness benchmark for plasma diagnostic models in tokamak fusion devices using the TokaMark dataset.
🛠️ Research Methods:
– Evaluation of XGBoost, LSTM, Transformer, and TokaMark CNN models across six failure scenarios and three imputation strategies.
– Introduction of the Robustness Score (RS) for cross-architecture comparison.
💬 Research Conclusions:
– Disruption-proximate sensor failure drastically affects sequence model performance, while XGBoost remains more stable.
– Forward-fill imputation prevents most degradation from random dropout for sequence models but is less effective for end-window corruption.
– Plasma current is identified as the most crucial diagnostic feature for model performance.
👉 Paper link: https://huggingface.co/papers/2607.11915
14.
15. SVR-R1: Bootstrapping Multi-modal Reasoning with Self-verification in Reinforcement Learning
🔑 Keywords: Self-Verified Reasoner, multimodal reasoning, Reinforcement Learning, GRPO, VLMs
💡 Category: Multi-Modal Learning
🌟 Research Objective:
– The objective is to develop a self-verified reasoning framework (SVR-R1) that incorporates a model’s verification process as a learning signal to enhance multimodal reasoning.
🛠️ Research Methods:
– The method involves using a multi-turn reinforcement learning approach with GRPO and an asynchronous rollout framework, relying on self-verification decisions without external supervision.
💬 Research Conclusions:
– SVR-R1 significantly boosts accuracy over standard GRPO baselines by reducing dependency on verification and enabling self-correction, which narrows the gap between verification and answer generation in Vision-Language Models (VLMs). The system will be open-sourced for future research development.
👉 Paper link: https://huggingface.co/papers/2607.10966
16. Beyond Success Rate: Cost-Aware Evaluation of Offensive and Defensive Security Agents
🔑 Keywords: security-agent evaluations, language-model security agents, economic efficiency, SOC-native evaluations
💡 Category: AI Systems and Tools
🌟 Research Objective:
– Evaluate language-model security agents by measuring their economic efficiency and operational fit, rather than just peak performance, under offensive and defensive scenarios.
🛠️ Research Methods:
– Analysis of offensive Cybench challenges and defensive Splunk BOTS v1 challenges, decomposing performance by inference and tool spend, and comparing models at fixed cost levels.
💬 Research Conclusions:
– Offensive CTF performance scales with compute spend, while defensive SOC success relies on disciplined tool usage and telemetry navigation. Cost-aware evaluations reveal practical utility and highlight areas for improvement in defensive agents.
👉 Paper link: https://huggingface.co/papers/2607.15263
17. Agon: Competitive Cross-Model RL with Implicit Rival Grading of Reasoning
🔑 Keywords: Reinforcement learning, Reasoning models, Agon, GRPO, DeepMath
💡 Category: Reinforcement Learning
🌟 Research Objective:
– The research introduces Agon, a method to enhance reasoning in AI models by using two competing models as graders to improve reasoning during training without process labels or reward models.
🛠️ Research Methods:
– Two models attempt the same problem, with one drafting and the other solving. They compete to out-reason each other, progressively facing stronger rivals in a two-stage cascade deployment.
💬 Research Conclusions:
– Agon significantly improves performance on hard tasks, evidenced by a doubled pass@1 rate on DeepMath using Qwen3 and replicated results across other model families, aiming to eventually enable reasoning in latent space.
👉 Paper link: https://huggingface.co/papers/2607.07690
18. Audio-Visual Flamingo: Open Audio-Visual Intelligence for Long and Complex Videos
🔑 Keywords: Audio-Visual Large Language Model, AV-Flamingo, Temporal Audio-Visual, Cross-Modal Reasoning
💡 Category: Multi-Modal Learning
🌟 Research Objective:
– Develop AV-Flamingo, an advanced Audio-Visual Large Language Model for comprehensive understanding and reasoning over long-form audio-visual content.
🛠️ Research Methods:
– Introduced a significant dataset, Audio-Visual-Skills, with 7 million caption and question-answer instances for temporal and cross-modal reasoning.
– Devised a three-stage curriculum for training from short-range perception to extended multi-event reasoning.
– Developed a Temporal Audio-Visual Interleaved Chain-of-Thought framework for improved temporal alignment and interpretability.
💬 Research Conclusions:
– AV-Flamingo outperforms similarly sized open models and is competitive with much larger models, especially in complex real-world audio-visual tasks.
– Demonstrated strong real-world utility and ability to generalize to unseen tasks, showing robustness and adaptability.
👉 Paper link: https://huggingface.co/papers/2607.16107
19. VideoRAE: Taming Video Foundation Models for Generative Modeling via Representation Autoencoders
🔑 Keywords: Video Foundation Models, VideoRAE, 3D-VAEs, Diffusion Transformers, autoregressive models
💡 Category: Generative Models
🌟 Research Objective:
– The study investigates whether frozen representations from Video Foundation Models (VFMs) can be effectively transformed into compact and generation-friendly video latents.
🛠️ Research Methods:
– The introduction of VideoRAE, a representation autoencoder that utilizes hierarchical features from a frozen video foundation encoder, employing a lightweight 1D self-attention projector for compression.
💬 Research Conclusions:
– VideoRAE achieves strong reconstruction capabilities and faster convergence rates compared to existing autoencoder baselines, proving the versatility and effectiveness of frozen VFM representations in video generative models.
👉 Paper link: https://huggingface.co/papers/2607.14088
20. S1-Omni: A Unified Multimodal Reasoning Model for Scientific Understanding, Prediction, and Generation
🔑 Keywords: Unified Multimodal Reasoning, AI for Science, Scientific Language Models, S1-Omni
💡 Category: Multi-Modal Learning
🌟 Research Objective:
– The objective is to develop S1-Omni, a unified multimodal reasoning model to enhance scientific understanding, prediction, and generation by integrating diverse scientific data, laws, and expert knowledge.
🛠️ Research Methods:
– S1-Omni maps various scientific objects and natural-language instructions into a unified representation space, incorporates scientific laws and expert knowledge during data construction and training, and performs task-specific decoding.
💬 Research Conclusions:
– S1-Omni demonstrates superior performance across over 60 scientific benchmarks, outperforming existing models like GPT-5.5 and Gemini-3.1-Pro in most cases, and it is shown to be at par or better than domain-specific models in several benchmarks.
👉 Paper link: https://huggingface.co/papers/2607.15686
21. Recursive Harness Self-Improvement
🔑 Keywords: Harness-in-the-loop learning, Recursive Harness Self-Improvement, continual learning, model–harness co-evolution, task-specific optimization
💡 Category: Foundations of AI
🌟 Research Objective:
– The paper investigates the potential of optimizing user-constructed harnesses to improve execution-trace quality while minimizing computational load.
🛠️ Research Methods:
– Introduced Recursive Harness Self-Improvement (RHI) to iteratively refine harnesses using pairwise feedback to enhance agent loop specifications.
💬 Research Conclusions:
– Demonstrated that few RHI iterations can significantly enhance agent performance on synthetic tasks across various domains and reduce inference costs by up to 60%.
– Improvement primarily stems from better context management and more efficient inter-agent information flow.
👉 Paper link: https://huggingface.co/papers/2607.15524
22. Understanding Reasoning from Pretraining to Post-Training
🔑 Keywords: Reinforcement Learning, Large Language Models, Pretraining, Reasoning, Chess
💡 Category: Reinforcement Learning
🌟 Research Objective:
– The paper aims to explore the relationship between pretraining choices and reinforcement learning (RL) outcomes in large language models (LLMs), particularly focusing on reasoning tasks.
🛠️ Research Methods:
– The study utilizes chess as a controlled testbed, employing a standard LLM training pipeline that includes pretraining on human chess games, supervised fine-tuning on synthetic reasoning traces, and applying RL on chess puzzles.
💬 Research Conclusions:
– Post-RL performance can be predicted from pretraining loss, and RL enhances models differently depending on puzzle difficulty, with potential generalization to other domains like mathematics.
👉 Paper link: https://huggingface.co/papers/2607.16097
23. RecGPT-V3 Technical Report
🔑 Keywords: Large Language Models, Recommender Systems, Hybrid-modal, Natural Language, AI Native
💡 Category: Natural Language Processing
🌟 Research Objective:
– Transform recommender systems towards reasoning about user intent, improving user experience and commercial outcomes.
🛠️ Research Methods:
– Deploy RecGPT-V3, a stateful, hybrid-modal recommender system combining natural language reasoning and Semantic IDs with a Memory Hub for structured user memory and a Hybrid-modal Foundation Model.
💬 Research Conclusions:
– RecGPT-V3 substantially improves performance metrics (such as IPV, CTR, TC, GMV) and reduces serving resource consumption, as demonstrated in Taobao’s online A/B tests.
👉 Paper link: https://huggingface.co/papers/2607.15591
24. Cura 1T: Specialized Model for Agentic Healthcare
🔑 Keywords: Cura 1T, LLMs, healthcare model, EHR, self-evolution loop
💡 Category: AI in Healthcare
🌟 Research Objective:
– Presenting Cura 1T, a specialized large language model (LLM) designed to handle different aspects of healthcare, including patient consultation, clinical reasoning, interactive diagnosis, and EHR tool use.
🛠️ Research Methods:
– Development of a training method involving a human-gated self-evolution loop, where a training agent plans capabilities, evaluates them, and refines training data based on observed failures using synthetic and curated examples.
💬 Research Conclusions:
– Cura 1T excels within the healthcare evaluation suite, ranking high among baseline models and maintaining competitive performance on out-of-domain reasoning and agentic benchmarks.
👉 Paper link: https://huggingface.co/papers/2607.15314
25. Xiaomi-Robotics-1: Scaling Vision-Language-Action Models with over 100K Hours of Real-World Trajectories
🔑 Keywords: Vision-Language-Action model, Mobile manipulation tasks, Auto-labeling pipeline, Real-robot performance, State-of-the-art
💡 Category: Robotics and Autonomous Systems
🌟 Research Objective:
– The paper introduces the Xiaomi-Robotics-1, a foundational Vision-Language-Action model designed to perform a wide range of mobile manipulation tasks in unseen environments and adapt efficiently to new tasks with minimal data.
🛠️ Research Methods:
– The Xiaomi-Robotics-1 is trained using a two-stage process consisting of pre-training on over 100k hours of manipulation data with an auto-labeling pipeline, followed by post-training to align actions with robot embodiments and human instructions.
💬 Research Conclusions:
– Xiaomi-Robotics-1 demonstrates strong scaling behavior, outperforming existing methods in benchmarks like RoboCasa365 and RoboDojo, establishing new state-of-the-art performance levels. The model significantly improves with increased data scales and model sizes, especially in real-robot environments.
👉 Paper link: https://huggingface.co/papers/2607.15330
26. RAGU: A Multi-Step GraphRAG Engine with a Compact Domain-Adapted LLM
🔑 Keywords: Graph RAG, Knowledge Graph, Meno-Lite-0.1, GraphRAG-Bench, HIPPO RAG2
💡 Category: Knowledge Representation and Reasoning
🌟 Research Objective:
– To enhance large language models with structured knowledge through graph retrieval-augmented generation (GraphRAG) and improve on existing systems by introducing a new modular engine, RAGU.
🛠️ Research Methods:
– Implementation of a two-stage typed extraction process, DBSCAN-backed deduplication, language model summarization, and community detection using Leiden algorithm.
– Development of Meno-Lite-0.1, a smaller 7B language model specifically optimized for language skills rather than sheer size, outperforming larger models in certain tasks.
💬 Research Conclusions:
– RAGU demonstrated superior performance in constructing more complete context and recall for knowledge graphs, with a relative harmonic mean improvement of 12.5% over larger models and effective performance in medical domain-related tasks.
– It is installable via pip and can run on a single GPU, making it accessible for wider application under an open-source MIT license.
👉 Paper link: https://huggingface.co/papers/2607.11683
