++
DOCS
Run Neptune.
Neptune-1.0-27B-Agent is a standard open-weights release — pull it from Hugging Face and serve it with the stack you already run.
Quickstart
Weights are on Hugging Face under Apache 2.0. Any OpenAI-compatible server that loads safetensors will serve it; below is the plain transformers path.
# pull and load
pip install transformers accelerate
from transformers import AutoModelForCausalLM, AutoTokenizer
m = AutoModelForCausalLM.from_pretrained("ainfera/neptune-1.0-27b-agent")
t = AutoTokenizer.from_pretrained("ainfera/neptune-1.0-27b-agent")
pip install transformers accelerate
from transformers import AutoModelForCausalLM, AutoTokenizer
m = AutoModelForCausalLM.from_pretrained("ainfera/neptune-1.0-27b-agent")
t = AutoTokenizer.from_pretrained("ainfera/neptune-1.0-27b-agent")
Tool calling
Neptune emits Hermes-native tool calls — structured JSON in <tool_call> tags, no wrapper prompts. Declare tools in the system message; parse what comes back.
# model output
<tool_call>
{"name": "lookup_invoice", "arguments": {"id": "INV-2209"}}
</tool_call>
<tool_call>
{"name": "lookup_invoice", "arguments": {"id": "INV-2209"}}
</tool_call>