Serving GLM-5.3 at 607.8 tok/s across two Nvidia DGX stations with vLLM
Serving GLM-5.3 at 607.8 tok/s across two Nvidia DGX stations with vLLM — from Hacker News front page
toolmodelinfraproduct
LLM Releases
New large language models ship every week — frontier models, open-weight releases, fine-tuned variants, and benchmark improvements. Keeping up requires more than a headline feed; builders need context on capability shifts, pricing changes, and API availability.
This cluster covers new model announcements, open-weight releases, benchmark claims, and model update signals from frontier labs and open-source communities. Each signal carries a link to the primary source for hands-on evaluation.
Use this page to maintain a model watchlist: identify capability jumps, track open-weight availability, and decide which models deserve a test run against your current workloads.
15 signalsSorted by date, newest first
AI agent startup LangChain hits $3B valuation
LangChain now claims 7,000 customers of its model and platform agnostic agent management tool LangSmith.
modelagentproduct
Export-banned Nvidia chips are behind China’s most powerful AI models — uh-oh, Jensen!
New research shows the most advanced AI models from China were trained on banned Nvidia chips.
modelinfraresearch
llm-gemini 0.37
Release: llm-gemini 0.37 Google launched Gemini 4 Hydrogen today - the lowest cost member of the Gemini 4 family. It's actually not too far off the price of its much bigger siblin…
toolmodelproduct
Google’s new Gemini model is better at understanding complicated questions
Google says its new Gemini 4 Hydrogen model can give more helpful answers to complex questions, including "questions with multiple parts, hard-to-understand typos, or highly speci…
toolmodelproduct
Nebius tests the neocloud playbook with $40 billion in planned spending
Nebius plans to fund its $40 billion AI infrastructure expansion through customer prepayments and loans, even as delays at a Microsoft data center raise questions about its financ…
modelinfra
Sketching Language Models for Context Attribution
Context attribution asks how removing parts of a prompt changes a language model's output. We study leave-one-out (LOO) attribution for a prompt of $n$ tokens and a fixed measurem…
toolmodelinfraresearch
Goal Encoding in LLMs
We investigate whether and how LLMs encode goals: internal neural representations that precede and guide action, and that are flexible enough to be realized through many different…
toolmodel
Synthesis Smuggling: Maliciously Hiding Inferred Personal Attributes in LLM Outputs
We propose Synthesis Smuggling, a novel threat model in which an adversarial LLM infers sensitive information about a user from routine assistance-seeking interactions and stegano…
toolmodelinfrasecurity
LiveGeo: Benchmarking Geographic Agents in Continuously Evolving Worlds
We introduce GeoWorld, a controllable and continuously evolving geographic environment platform for LLM agents, and LiveGeo, a benchmark for evaluating reliable decision-making in…
toolmodelagent
Jensen Huang’s exit puts Nvidia’s support for open source in question
Jensen Huang’s resignation raises questions about Nvidia’s commitment to open source AI, including its Hugging Face acquisition, open-weight models, and advocacy against restricti…
modelinfraproduct
Ballad: Bandit-Based LLM Routing for Automated Heuristic Discovery
Modern automated heuristic discovery (AHD) systems increasingly rival hand-crafted heuristics by leveraging Large Language Models (LLMs) to iteratively mutate and refine solutions…
toolmodelinfra
When Both Sides Adapt: The Challenges of Evaluating Interactive LLM Systems
In interactive systems where users engage with LLMs, users are adaptive and, after observing LLM responses, can change their prompting strategy, as well as the type and difficulty…
toolmodel
Al-Ghasali: A Computational Framework for Simulating Islamic Jurisprudential Rulings via Finite State Automata and Large Language Models
This paper presents Al Ghasali, a computational framework designed to formalize and simulate Islamic jurisprudential (Fiqh) rulings. Building upon recent set theoretic formalizati…
toolmodelresearch
Scalable Conversational Assessment: Chat-Based Exams with a Two-Agent LLM Pipeline
Oral exams are compelling because (1) students can be asked to provide their reasoning for an answer and (2) their interactive nature permits follow-up questions to resolve ambigu…
toolmodelagentinfraresearch