llama-nemotron-rerank-1b-v2 API: Pricing & Specs
llama-nemotron-rerank-1b-v2 is an open-weight reranker that scores how relevant a passage is to a query.
What is llama-nemotron-rerank-1b-v2?
llama-nemotron-rerank-1b-v2 is an open-weight reranker that scores how relevant a passage is to a query, published by NVIDIA with open weights at nvidia/llama-nemotron-rerank-1b-v2. LLM API does not route this model today, so there is no endpoint or code sample for it here. What this page does give you is the self-hosting picture: published weight sizes, the VRAM each quantisation needs and the commands to serve it yourself. Every figure is read from the public repository and refreshed weekly. At import it had 938,909 downloads on Hugging Face in the previous 30 days, under the other licence.
Can you self-host llama-nemotron-rerank-1b-v2?
No. We found no public weights for llama-nemotron-rerank-1b-v2 on Hugging Face, so there is nothing to download, quantize or serve on your own GPUs: no VRAM budget, no vLLM or GGUF build to plan for. The only way to run it is over an API.
Not on LLM.API yet
We do not route this model through our API at the moment. Browse the models you can call today — most workloads have a close match already live.
Not available on LLM API yet
We do not route this model through our API at the moment, so there is no endpoint or code snippet for it yet. Browse the models you can call today — most workloads have a close match already live.
Browse available modelsWhen to Use — When NOT to Use
Use it if...
- You want to re-order search or RAG candidates by relevance before they reach the LLM (llama-nemotron-rerank-1b-v2)
- You want to keep documents inside your own network while indexing them
- The weights are published openly, so you can pin one checkpoint and keep vectors reproducible
- You are comparing self-hosting cost against a managed embedding endpoint
Avoid if...
- LLM API does not route this model today, so there is no endpoint here to call
- You want zero operations — serving, scaling and upgrades are yours to run
- You need text generation — this model returns vectors or scores, not answers
- You already have an index built with a different model: vectors are not interchangeable
Get one key to every model
Swap your API key. Keep your code.