Search AI news

Show HN: We tested our prompt injection filter in public

Article URL: https://hodor.gatebolt.com/blog/secret-leak-test Comments URL: https://news.ycombinator.com/item?id=50401639 Points: 1 # Comments: 0

Research reveals the local geometric structure of semantic meaning in large language models

A paper published on October 24, 2026, on arXiv (ID 2610.30715v1) characterizes the local geometric properties of semantic meaning in embedding space across four decoder-only large language models—Gemma 4, Llama 3.2, Qwen 2.5, and Pythia—using cross-lingual probes and fine-grained probes.

Why it matters：This study is the first to systematically characterize the invariance, variability, and refinement mechanisms within “the same semantic factor” in LLMs, proposing the “local anisotropic neighborhood” model. The approach has been validated through blind human evaluations, demonstrating rigorous methodology, broad model coverage, and cross-architecture consistency in its findings.

Self-Hosted Large Models vs. Cloud APIs: How to Route Requests Intelligently

This article compares the trade-offs between self-hosted large language models and cloud APIs in terms of data privacy, cost, latency, and capabilities. It outlines the hardware requirements (such as VRAM and quantization) for open-source deployable models, discusses typical technology stacks, and uses n8n as an example to demonstrate how to build hybrid routing workflows that dynamically distribute requests between on-premises and cloud-based models based on task sensitivity, complexity, or compliance requirements.

IBM Granite 3.0 models

Ollama partners with IBM to bring Granite 3.0 models to Ollama.

Llama 3.2 goes small and multimodal

Ollama partners with Meta to bring Llama 3.2 to Ollama.

Tool support

Ollama now supports tool calling with popular models such as Llama 3.1. This enables a model to answer a given prompt using tool(s) it knows about, making it possible for models to perform more complex tasks or interact with the outside world.

An entirely open-source AI code assistant inside your editor

Continue enables you to easily create your own coding assistant directly inside Visual Studio Code and JetBrains with open-source LLMs.

Llama 3 is not very censored

Compared to Llama 2, Llama 3 feels much less censored. Meta has substantially lowered false refusal rates. Llama 3 will refuse less than 1/3 of the prompts previously refused by Llama 2.