Show HN: We tested our prompt injection filter in public
Article URL: https://hodor.gatebolt.com/blog/secret-leak-test Comments URL: https://news.ycombinator.com/item?id=50401639 Points: 1 # Comments: 0
AI NEWS JOURNAL
Search AI news
Search headlines, summaries and articles to connect the dots.
Use decision models with Amazon Bedrock AgentCore Evaluations
Some agent-evaluation questions are narrow and repeatable, and decision models answer exactly that kind of question. This post shows how to connect two decision models, Jev and Strands Decider, to Amazon Bedrock AgentCore Evaluations through code-based evaluators, and how to validate a decision-model check before you gate a release on it.
Scoring Explanations Without Reading Them: Structural Shortcuts in Automated-Interpretability Evaluation Data
arXiv:2610.37676v1 Announce Type: new Abstract: Automated interpretability scores an explanation of a sparse-autoencoder (SAE) feature by asking a model to predict, token by token, where the feature fires on evaluation examples or to judge whether marked tokens fit it. We find that the evaluation data standard pipelines build can be scored without reading the explanation. On Neuronpedia's stored fuzzing runs for 500 random GPT-2 small features, 91.3% of activating examples are cropped with the peak on the centre token, and a rule that says "yes" when the centre token is marked reaches balanced accuracy 0.979, against 0.838 for the stored LLM scorers (recomputed from the stored per-item verdicts, on marks rebuilt from the pipeline's code); a rule reading only the mark count reaches 0.969. T
MedJev: Evaluating Zero-Shot System-One Decision Making in Medicine
arXiv:2610.36006v1 Announce Type: new Abstract: System One decision models such as Jev answer structured questions in a single forward pass without generating text, offering fast and computationally efficient clinical decision support. We evaluate MedJev, an open System One model that runs locally on a laptop, across ten medical benchmarks spanning medical knowledge, diagnosis, and patient level prediction using MIMIC IV and MIMIC IV ED. We compare MedJev against zero shot LLM baselines, published GPT results, and supervised models. MedJev achieves accuracies of 72.5 percent on MedQA, 75.4 percent on USMLE, and 80.1 percent on NEJM, approaching published GPT 4 performance while maintaining well calibrated confidence estimates (ECE 0.028 to 0.063). On patient level tasks, MedJev achieves an
The Agentic Analytics Benchmark: ranking tables and labeling failures with Jev
Jev ranks warehouse tables and labels agent failures in under a second, but adding retrieval hints leaves accuracy flat across 20 models on the Agentic Analytics Benchmark.
b11928
model: Add MiniCPM-OCR-Jev (#30980) * model : add MiniCPM-OCR-Jev support The model is a Qwen3.5-VL trunk with a value head read at the last token: it scores an OCR text against an image rendered from it, it does not generate. Add the openbmb-minicpm-ocr-jev decision type, served by POST /v1/systemone. The class scores are the pooled output of the sequence, read with last pooling, so the conversion turns score.weight into cls.output and sets embedding_length_out. The checkpoint has no LM head, so text generation is rejected instead of using the output weights duplicated from the token embeddings. The task is fixed, so its prompt is entirely in the systemone template, the same way h2o-lightning keeps its default there. The processor of the checkpoint allows up to 16384 merged tokens per ima
vLLM Semantic Router Releases d3-ultra: A 27B Open Multimodal Decision Model
vLLM Semantic Router released d3-ultra, a 27B open-weight multimodal decision model. It reads text, images and video once, then returns probabilities for every answer, scoring 87.2 on the team’s SR-Text test. The post vLLM Semantic Router Releases d3-ultra: A 27B Open Multimodal Decision Model appeared first on MarkTechPost.
Build specialized multimodal models with LFM3
Build specialized multimodal models with LFM3
RetiJev: Fast and Source-Grounded Ophthalmic Decision Models
arXiv:2610.30947v1 Announce Type: new Abstract: Ophthalmic clinical decision support requires fast, accurate, and privacy-preserving inference, yet autoregressive large language models (LLMs) incur substantial latency and computational overhead for decisions among predefined actions. We therefore investigate a decision-oriented alternative to generative reasoning. Specifically, we first introduce RetiJev-Data, a source-grounded ophthalmology corpus comprising 78,158 clinical-decision and diagnosis questions derived from articles in PubMed Central and a MeSH vocabulary covering 531 eye diseases, and 50,074 guideline-grading questions spanning 11 grading systems, along with a 24,662-question evaluation benchmark. Based on this, we develop RetiJev, a family of 0.8B-9B decision models that dir
OpenAI officially launches the Decisions API decision-making model, directly competing with TypeSafe Jev.
OpenAI will make the Decisions API available to all customers around October 22, 2026. This model is rebuilt on top of ChatGPT Luna and emphasizes millisecond-level low latency and cost-effective inference, with advantages in multimodal tasks such as image understanding. Currently, it lags behind competitors like the latest Jev and D1 Ultra in mainstream decision-making model benchmarks, but has already been adopted in real-world testing by companies including Box, Datadog, and Speak.