Mistral Large 4 is a multimodal Mixture-of-Experts model from Mistral AI that accepts text and images and generates text for instruction following, reasoning, coding, and agentic workflows. It has ...
Mistral Large 4 from Mistral AI, a 1T-total / 52B-active granular MoE for text and image input with reasoning, function calling and structured outputs, served in NVFP4 with DSpark speculative decoding ...
NOTE Larger models can improve triple quality, but reasoning models need structured-output configuration for extraction. Choose a model that fits the memory available on your hardware platform, and ...
If you want to run a workload or a model that won't fit on a single DGX Spark, you can connect two or more Sparks into a cluster and distribute the workload or model across the devices. However, this ...
Cut memory ~3.5× vs FP16 while keeping accuracy close to FP8, then validate with an OpenAI-compatible endpoint NVFP4 is a 4-bit floating-point format for NVIDIA Blackwell GPUs. It reduces memory ...
Hermes Agent is a self-improving AI agent built by Nous Research. It runs as a terminal TUI on your machine and, through a built-in gateway, can also be reached from messaging platforms like Telegram, ...
A unified generative model for protein, enzyme, binder and antibody design. RFD4-Proteina is a unified generative model for protein design, produced through a collaboration between NVIDIA's Generative ...
vLLM is a high-performance inference engine for serving LLMs at datacenter scale. However, getting the desired performance requires significant background knowledge and configuration experience, ...
Choose a model and spin it up locally on your NVIDIA system for privacy, control, and unlimited free experimentation without any token anxiety. Most users will not require this playbook. Apps that use ...
The free tier runs on rate limits - up to 40 requests per minute (RPM) for most models, with no per-token billing. Your personal rate limit is shown in the top-right of the dashboard.
Step 5 Preview is a vision-language model developed by StepFun for agentic work that processes text and images to generate text. It supports software engineering, long-horizon tool use, and ...
LLaMA Factory is an open-source framework that simplifies training and fine-tuning large language models. It offers a unified interface for methods such as supervised fine-tuning (SFT), RLHF, and ...