我的收藏提交工具
FOXAI SEARCH

全站搜索

新闻报道 832

Idle, then spiking: Why AI agents are breaking Kubernetes resource planning

AI agents are changing the economics of cloud infrastructure, and autonomous orchestration is becoming the way platform teams keep up. Agentic workloads sit idle and then spike without warning. That pattern leaves static resource settings either wasteful or likely to fail. Container orchestration for AI is fast becoming the backbone of production AI, and agents […] The post Idle, then spiking: Why AI agents are breaking Kubernetes resource planning appeared first on SiliconANGLE.

翻译服务暂未运行,当前显示原文。
SiliconANGLE AI

Introducing Vercel X

Vercel is launching Vercel X, a six-week accelerator in San Francisco for AI founders at the idea and pre-seed stages. The program offers no equity take, access to over $9 million in credits from partners like AWS, Anthropic, and OpenAI, technical mentorship, founder community events, investor access, and funding opportunities. Applications are open until November 29, 2026, with the cohort running from January 19 to March 2, 2027. Eligible applicants must be Vercel customers, not have raised institutional seed funding or participated in traditional VC accelerators, and commit to full-time in-person attendance in San Francisco.

翻译服务暂未运行,当前显示原文。
Vercel

RAW: Refusal Aversion in the Wild, A Causal Measurement Method for Deployed LLMs

arXiv:2611.21641v1 Announce Type: new Abstract: Deployed LLMs field hundreds of millions of conversations a day and refuse a non-trivial fraction of user requests, yet the user-side cost of refusal, whether users disengage and by how much, is unmeasured on any production model: a blind spot for the consumer-facing platforms built on them. A/B-testing refusal is ethically and operationally constrained on frontier-lab products and unavailable to third-party platforms deploying these models through a fixed API. We introduce RAW, a method that uses LLM stochasticity as a natural experiment: at near-identical prompts in any existing log, the same model sometimes refuses and sometimes does not, and that variation identifies the causal user-side effect of refusal. Applying the method to 15 deployed LLMs in LMSYS-Chat-1M and WildChat, with user-clustered inference, we find that for about half of the models we can measure precisely, a refusal costs 3 to 17 pp of subsequent re-engagement; the rest show no distinguishable effect, among them one deployment whose positive point estimate we trace to persistent users retrying the refused request. Our contribution is the measurement method, which runs on any deployed model from logs alone for about \$0.30 per 1,000 conversations. We release labels, moderation scores, prompt embeddings, and pipeline code.

翻译服务暂未运行,当前显示原文。
arXiv cs.CL

Reducing token costs and latency in Amazon Bedrock AgentCore JSON workloads

As production agents on Amazon Bedrock AgentCore process multi-megabyte JSON payloads, token costs and latency climb. This post shares three composable strategies: offloading heavy artifacts to Amazon S3, on-demand result paging, and dictionary compaction. Together they cut per-turn token use by up to 71% and latency by up to 80%.

翻译服务暂未运行,当前显示原文。
AWS Machine Learning Blog