3 Ways to Boost MoE Inference on NVIDIA DGX Spark
Generating tokens faster starts with identifying what limits inference performance. In the batch-size-1 evaluation of Ling-3.0-flash from Inclusion AI on NVIDIA...
Search headlines, summaries and articles to connect the dots.
Generating tokens faster starts with identifying what limits inference performance. In the batch-size-1 evaluation of Ling-3.0-flash from Inclusion AI on NVIDIA...
After the release of K3.1 Pro, due to numerous users reporting that their quotas were being depleted too quickly, Moonshot AI urgently issued an announcement stating, “The issue lies with us, and we should have fixed it sooner.” Alongside compensating affected users, Moonshot AI also indicated that it would “reduce unnecessary sub-agent calls and output lengths.” Just two days before the model went live, Anthropic published an article titled “Building agents: When to fold subagents into your main agent loop,” which addressed precisely the topic of sub-agents. Anthropic concluded that, by comparing Claude deployments across multiple companies, they found that a single agent equipped with specific skills actually outperformed “a group of...”
Mirendil released Fern 0.1, its first model, pretrained from scratch with a 10M-token context window. It targets agentic AI R&D work, scores 100% on RULER single needle at 10M, but trails frontier models on agentic coding. The post Mirendil Launches Fern 0.1, Its First Model, With 10M-Token Context appeared first on MarkTechPost.
1. GPT-6.1 Terra, better suited for workers, has launched, with API prices cut in half and faster computer operations On October 26, OpenAI released GPT-6.1 Terra, focusing on enhancing visual comprehension, computer operations, factual accuracy, and programming capabilities, ....
Old benchmarks approach perfect scores, yet new benchmarks consistently fall short in real-world performance. As large-model evaluation itself has become a business, companies are shifting their selection criteria from ranking-based assessments to cost‑benefit analyses.
The old “horse racing + short-cycle evaluation” approach can no longer be sustained.
Yan Deli, a senior expert at Tencent: LLMs are probabilistic models. They do not truly understand language; rather, they predict the next token (Next Token Prediction). Essentially, they are monotonous “word-chain” machines—moving forward one step at a time without retracing their path. At their core, LLMs are probabilistic models that learn, from statistical co-occurrence patterns, “what often appears alongside what,” and output “this is usually the case,” without grasping “why it is so.”...
The champion on the AI rankings may change, but the products users rely on every day don’t necessarily. The next round of competition in large models will hinge not just on whose model is stronger, but on turning a single use into a habit.
On October 19, 2026, MiniMax released its low-cost large model, M3.1Flash, which scored 42 points in comprehensive evaluations and boasts a 70% reduction in cost compared to the previous generation. However, it immediately faced accusations of “cheating on exam questions”: on AA’s publicly available past papers, it nearly achieved a perfect score, yet continued to produce the original answers even after the question stems were rewritten. Reviewers such as Cat Boss and Binkg pointed out that its performance on old and new questions is sharply divided, token consumption is abnormal, and its hallucination rate in knowledge tests reaches as high as 92.8%. On October 23, MiniMax open-sourced the model weights for independent verification, but the mechanisms behind its question-identification capabilities and the reasons for discrepancies in Chinese–English responses remain unresolved.
Why it matters:This report is based on multi‑party empirical testing (including Binkg’s re‑title experiment, the author’s replication, and a dual evaluation comparison between AA and Plotly‑Mila), verifiable data (token counts, prices, accuracy/hallucination rates), and contradictions in model behavior (English errors vs. Chinese correctness, stable performance on old tasks vs. collapse on new ones). It systematically lays out the core symptoms of the current credibility crisis in large‑model evaluations: high scores do not necessarily equate to strong generalization, and low‑price advantages create tension with the reality of model capabilities. The information source is a deep investigation authorized for publication by Titanium Media, complete with original test procedures, screenshot evidence, and timestamps, offering both timeliness and rich detail.
Author | Cynthia Editor | Zheng Xuan In 2026, the AI 3D landscape stands at a delicate crossroads. Momentum in the primary market continues to surge, with new models and startups emerging one after another, and single-image-to-3D generation now delivers photorealistic results that are almost indistinguishable from real-world objects. Yet beneath the dazzling demo façade, most generated outputs remain stuck at the “turntable showcase” stage: a meticulously crafted character or mechanical model slowly rotates under lighting, its scales, fabric folds, and metallic engravings rendered with lifelike detail. But as soon as these details enter real‑world production workflows—such as game engine rigging, industrial simulation, or 3D printing—their limitations quickly surface: structural fractures, backside collapses, fused details, and uneditable meshes begin to erupt, swallowing up the efficiency gains brought by AI through costly manual post‑processing. Fidelity in frontal views no longer equates to overall 3D quality—a consensus that’s taking hold across the industry. The race for AI‑driven 3D has shifted from the first half—“Can we generate?”—to the second half—“Can we deliver in real‑world applications?” It is precisely at this juncture that leading player Hi3D has made two strategic moves: officially open‑sourcing its production‑proven Hi3D V1.0 platform, while simultaneously launching the creator‑centric Hi3D Agent, which bridges the industry’s foundational layers and deeply embeds itself within the full creative workflow. Prior to this, the company—founded less than three years ago—had already delivered a solid track record: securing two consecutive rounds of funding within six months, totaling nearly $50 million, with top-tier investors like Sequoia China, IDG Capital, and Meituan Longzhu all participating; its Hi3D platform now serves over 120 countries and regions, supporting more than 2 million creators, and enjoys deep integrations with leading hardware manufacturers such as Tuzhu Technology and xTool. From academic breakthroughs in sparse geometry to open‑source, production‑ready models, and end‑to‑end connectivity via its Agent creation system, Hi3D has secured its ticket to the next phase of 3D generation. 01 3D Generation: Overhyped Demos, Underestimated Production Gaps The underlying logic of single‑image‑to‑3D generation inherently carries a perspective bias. As metrics like ULIP and Uni3D have repeatedly set new benchmarks, the industry’s past few years have been marked by an emphasis on front-facing views at the expense of holistic understanding, and on outward appearance rather than internal structure. However, the essence of a 3D asset lies in its ability to be rotated, edited, and manufactured as a three‑dimensional object. In a single character image, the vertical…
Baidu has released Unlimited OCR 2, an MIT-licensed 3B OCR model that parses hundred-page documents in one request. Its SR-SWA attention keeps per-step decoding cost nearly flat, scoring 77.1 on MarathonDocBench The post Baidu Open-Sources Unlimited OCR 2 for Hundred-Page Document Parsing appeared first on MarkTechPost.
OpenAI has once again raised the bar for the cost-effectiveness of large models. #Follow iFanr’s official WeChat account: iFanr (WeChat ID: ifanr) for more exciting content delivered to you第一时间.
arXiv:2610.33015v1 Announce Type: new Abstract: Long-term memory enables large language model (LLM) agents to maintain personalized and temporally coherent interactions, but repeated LLM inference for memory admission, extraction, and organization introduces substantial cost and latency. We present SLICE-Mem, a lightweight memory framework that combines salience-guided admission and predicate-centered information extraction. A compact classifier identifies user turns worth retaining, and a semantic-dependency-based extractor converts admitted turns into concise memory entries. This online pipeline requires no generative LLM calls, while cross-entry reconciliation is deferred to an offline consolidation stage. We evaluate SLICE-Mem on the weekly subset of Memora and LongMemEval-S using 8B a
arXiv:2610.33017v1 Announce Type: new Abstract: Multilingual tokenizers trained on English-dominated corpora often over-segment Indic languages, resulting in longer token sequences and increased tokenization disparity across scripts. We present AdaptTok-Indic, an Indic-specialized extension of adaptive tokenization that combines Unicode-normalized preprocessing with explicit Indic conjunct handling, script-aware routing, and learned byte-level boundary prediction jointly trained with a small Transformer language model. Evaluated on Bengali and Hindi, with additional evaluation on Gujarati, Tamil, and Telugu, AdaptTok-Indic achieves lower token fertility than SentencePiece BPE, an Indic-oriented tokenizer baseline, and an independently implemented MAGNET-style baseline. Across five recorded
arXiv:2610.32429v1 Announce Type: new Abstract: Large language model (LLM) agents increasingly execute tasks asynchronously: a main agent continues working while its subagents run, and the task state may change before their results arrive. The main agent must decide which work to update or preserve and which checks to repeat, while avoiding prohibited changes. Final task success alone does not reveal whether these results were handled correctly, and natural asynchronous arrivals are hard to reproduce. We introduce Async-RBench, a benchmark for asynchronous task execution in LLM agents, with 200 executable tasks covering eight scenarios. A scenario controller regulates result delivery using predefined task-state conditions, while an Event Response Contract (ERC) specifies what each response
arXiv:2610.33012v1 Announce Type: new Abstract: Large Language Model (LLM) agents with tool use exhibit inconsistent behavior across independent runs from identical states, calling different tools, producing contradictory outputs, or pursuing divergent strategies. This variability compounds over time and undermines deployment reliability. Existing evaluation metrics primarily measure task correctness via completion-based scores and do not capture consistency in agent behavior across executions. Separately, agent behavior is analyzed either at the token level using probability distributions or at the single-response level using semantic clustering, but neither captures how inconsistency propagates across future turns of a trajectory. We introduce Recursive Semantic Divergence (RSD), an unsu
arXiv:2610.33007v1 Announce Type: new Abstract: Natural-language service intents in integrated terrestrial and non-terrestrial (TN/NTN) 6G networks can be incomplete, ambiguous, or inconsistent, making unconstrained LLM generation challenging for reliable network-facing orchestration. This paper proposes a knowledge-guided LLM framework that combines grammar-constrained semantic parsing with a knowledge-graph (KG)-driven clarification loop to produce validated, orchestration-ready service profiles across four representative service classes. On a 200-sample intent dataset, the framework achieves 89% classification accuracy and 95% policy validity with an average of 0.66 clarification turns per request. Compared with a Pure-LLM baseline, the proposed framework improves policy validity and co
arXiv:2610.33039v1 Announce Type: new Abstract: We introduce Nemotron 3.5 Bolt 74B-A9B 24GB, a hybrid Mamba-Transformer vision-language model that optimizes speed and intelligence per GB of memory used for local agentic workloads. Derived from the Nemotron 3.5 Super VL 120B-A12B model family, Nemotron 3.5 Bolt 74B-A9B 24GB combines Star Elastic compression with 2-bit Quantization-Aware Distillation for memory-constrained deployment. The model is optimized for reasoning, agentic tool use, and web & terminal interactions. We also trained a LiLiCorr speculative drafter that is released alongside the model to reach our target inference speed. The resulting model achieves a higher accuracy than leading models with similar memory footprints and speed across many benchmarks for general agentic ca
arXiv:2610.33014v1 Announce Type: new Abstract: A negotiation assistant can reach a good deal without accurately predicting the other person's response. We ask whether evaluations of social world models test that prediction directly. We audit 113 works published from 1999 to 2026. 9 primary evaluations measure a real person's response to an action selected by the system or experimenter. Only 2 also compare an explicit response forecast with that response. Their predictors use information available when the action is chosen, and the evaluated responses were excluded from fitting; both randomize the intervention. A separate full-text check of 25 language-model works finds no experiment meeting these conditions. The other evaluations test current-state inference, task success, or prediction f
arXiv:2610.32322v1 Announce Type: new Abstract: LLM agents retrieve skills from public hubs that hold up to about 100,000 entries and serve many models. As models improve, a hub must find the skills a given model has internalized, meaning it can do without them, and retire them for that model, yet internalization has not been measured with known reliability. Published rules that compare runs with and without a skill retire on the gain alone. The gain is near zero both for an internalized skill and when neither the model nor the skill delivers the capability, a state we call uncovered. We instead withhold the skill, score the model on a task synthesized from it, and trust a high unaided score only when another model gains from the skill, since nearly half of high scores come from tasks no m