nvidia
8 stories tagged nvidia, most recent first
Also today
Hugging Face and NVIDIA Release Open Data for Agents
NVIDIA and Hugging Face have jointly published an open dataset specifically designed for training and evaluating AI agents, hosted on the Hugging Face hub. Agent-specific training data has been a significant bottleneck — most open datasets are instruction-following or QA-focused, not optimized for multi-step tool use, planning, and environment interaction. This release directly addresses that gap and should accelerate open-source agent development outside of closed lab environments. The dataset's availability on Hugging Face means it integrates cleanly into existing fine-tuning and evaluation pipelines. Developers building or fine-tuning agent models should incorporate this dataset into their training runs and evaluation benchmarks.
Hugging Face
NVIDIA Nemotron Achieves Benchmark-Leading Performance with LangChain Deep Agents Harness
NVIDIA's Nemotron model has demonstrated benchmark-leading results when paired with LangChain's deep agents evaluation harness, validating the open-stack approach to agent development. This is significant because the benchmark uses a real agentic harness — multi-step tool use, reasoning chains — rather than static Q&A, making the results more representative of production agent behavior. For developers building on LangChain, this provides evidence that Nemotron is worth evaluating as a backbone model for complex agent workflows. NVIDIA's push with open-stack integrations also means this isn't a closed ecosystem win — the components are composable. Engineers can pair this with the NVIDIA open data for agents release (also today) for a more complete agent training and evaluation pipeline.
NVIDIA
NVIDIA Vera CPU Gains Traction for Agentic Workloads Requiring High Single-Thread Performance
NVIDIA's Vera CPU is seeing adoption among AI infrastructure teams specifically because of its strong single-threaded performance at scale — a characteristic that matters more than many developers expect when running agentic workloads with complex orchestration logic, tool dispatching, and sequential decision-making code. Most AI infrastructure discourse focuses on GPU throughput, but the CPU bottleneck in agentic systems — where each step involves branching logic, memory lookups, and API calls — is becoming a real constraint at production scale. NVIDIA's blog highlights AI innovators who have chosen Vera specifically for this single-thread ceiling, suggesting this is an observed production pain point rather than a theoretical one. For infrastructure engineers designing systems for high-concurrency agentic deployments, this is a useful data point when evaluating CPU-GPU co-design tradeoffs. The Vera CPU is part of NVIDIA's broader push to own the full compute stack for AI, not just the GPU layer.
NVIDIA
NVIDIA Open-Sources Audex: A 30B Audio-Text LLM Built on Nemotron
NVIDIA has released Audex (Nemotron-Labs-Audex-30B-A3B), a unified audio-text large language model that integrates audio understanding directly into a text-capable backbone without degrading its language reasoning performance. The model is a 30B parameter mixture-of-experts architecture with only 3B active parameters per forward pass, making inference more practical than the parameter count suggests. A key design goal was preserving the text intelligence of the underlying Nemotron model while adding audio modality — a common failure mode in multimodal fine-tuning that NVIDIA explicitly claims to have addressed. For developers building voice assistants, transcription pipelines, or audio-grounded reasoning applications, Audex offers a production-weight open model worth benchmarking. Its release on Hugging Face makes it immediately accessible for experimentation.
NVIDIA
AI Inference Chip Market Forecast: $36.97 Billion by 2030 Signals Infrastructure Buildout
Multiple reports converge on a projection that the AI inference chip market will reach approximately $36.97 billion by 2030, reflecting the massive and accelerating investment in dedicated inference hardware. This matters to developers because it signals that the hardware ecosystem underpinning model deployment is expanding rapidly, which will drive down inference costs and increase availability of specialized accelerators beyond NVIDIA's current dominance. The buildout includes edge inference chips, custom ASICs from hyperscalers, and new entrants targeting specific workloads like vision or NLP. For developers making architecture decisions today, this trajectory supports bets on inference optimization, quantization, and hardware-aware model design as durable skills. It also suggests that cloud inference pricing will become increasingly competitive over the next few years.
GlobeNewswire
NVIDIA: Open Models Are Driving AI Research, Highlighted at ICML 2026
NVIDIA has published a blog post timed to ICML 2026 making the case that open models are now central drivers of cutting-edge AI research, not just convenient baselines. The piece highlights how open-weight models enable reproducibility, community-driven improvements, and rapid iteration that closed APIs cannot match. For developers, this signals that NVIDIA is institutionally invested in the open model ecosystem, which has implications for tooling, hardware optimization, and future model releases. The ICML context means this framing is being presented directly to the research community, likely influencing grant directions and academic-industry collaboration. Developers building research infrastructure or fine-tuning pipelines should note that the open model ecosystem is gaining serious institutional momentum.
NVIDIA
Hugging Face Kernels Gets Major Revamp: Custom GPU Kernels Now Easier to Share and Deploy
Hugging Face has announced a significant overhaul of its Kernels platform, which allows developers to write, share, and deploy custom GPU kernels directly integrated into the Hugging Face ecosystem. The updates appear to streamline the workflow from kernel authorship to production deployment, lowering the barrier for performance engineers who want to distribute optimized CUDA or Triton ops without standing up their own infrastructure. This matters for developers who are hitting throughput or latency ceilings with off-the-shelf operators and need custom attention variants, quantization kernels, or fused ops. It also signals Hugging Face's intent to become a hub not just for models and datasets but for the lower-level compute primitives that make inference fast. Teams building high-performance inference stacks should review what's newly available in the Kernels catalog.
Hugging Face
nvidia announces next generation H200 GPU for AI training
Nvidia unveiled the H200 GPU promising 2x performance over the H100 for large model training workloads.
Nvidia