Licensed to be used in conjunction with basebox, only.
// start
Start with basebox Server
Applies to
Product: Server · Audience: Platform Operator · Administrator · Procurement
basebox Server is a dedicated physical server for one organisation. The hardware can be sourced through FAST LTA or procured by you; the server stands in your data center or in the basebox data center and is operated by you or – if commissioned – by basebox.
Before you install, you make four decisions. None of them changes the product; together they determine which pages of this documentation apply to you.
Decision 1: Hardware
| Option | What it means | Read more |
|---|---|---|
| Source through FAST LTA | Pre-configured systems that basebox lists as reference configurations (currently including 3 × RTX PRO 6000, 2 × H200, 2 × H200 + RTX PRO 6000; each with 128 GB or 512 GB RAM) | Hardware options |
| Procure yourself | Your own or existing hardware. If it matches a reference configuration, that configuration's status applies; otherwise it is Custom and is reviewed with basebox | Reference configurations |
Keep in mind: the GPUs serve the service models and inference, not the basebox platform itself. How much GPU you need depends on the chosen language model, context and concurrency – see Understand the architecture.
Decision 2: Location
- Your data center – you control physical access, network and environment. The server can run fully air-gapped.
- basebox data center (hosting) – the server stands at basebox; physical access and network connectivity are basebox's responsibility, the server remains dedicated to your organisation.
A server hosted at basebox is still Server, not Cloud. Details: Hosting options.
Decision 3: Operation
- Self-managed – after handover of the software you are responsible for the operating system, drivers, Kubernetes, basebox, service models, inference and network. basebox provides software, updates, documentation and support.
- Operated by basebox – if commissioned separately, basebox installs and/or operates the system via PAM/VPN or another agreed access path.
Buying the software is not an operations contract
A basebox Server licence is a software licence. Operation of the infrastructure by basebox is a separate engagement. What it includes is described under Operating models and Responsibilities.
Decision 4: Installation path
- From bare metal – you start with an empty server: operating system, NVIDIA drivers, Kubernetes, then basebox. The end-to-end path is the Bare-metal installation.
- Existing Kubernetes – you already have a cluster with GPU nodes, ingress and storage. Then you go straight to Install basebox.
Both paths converge at the Helm installation: Installation paths.
Checklist before you start
- Hardware decided and checked against a reference configuration
- Location and operating model settled contractually
- Network access to the basebox image registry (
gitea.basebox.health) or a plan for offline image transfer – see Air-gapped environments - Domain, DNS and TLS approach decided (cert-manager, your own certificate or local trust) – see Networking
- Language model chosen and sized against the GPU equipment – see Models & inference
- Identity integration planned (local users, LDAP/Active Directory, OIDC) – see Keycloak LDAP integration
- Person responsible for ongoing operations named – see Operations
After the installation
Once the installation is validated, things continue as in the Cloud: the first administrator signs in, sets up the organisation and invites users. The steps are under Administration – Getting started. The Platform Operator reads the first administrator's credentials from the Kubernetes secret basebox-admin-secret after the installation.
Frequently asked questions
Can inference run on a different server than basebox? Yes. The basebox platform can run on a CPU-only server and talk to a separate GPU system for inference. See Deployment topologies.
Does the server need internet access? For installation it needs access to the registry and package sources, or mirrored artefacts. In operation, fully air-gapped use is possible; web search and online model downloads are then unavailable.
Who creates the first administrator? The installation creates it automatically (bootstrap job). The Platform Operator reads e-mail and password from the secret and hands them to the administrator.
Next step: Developer → Installation & Operations → Plan the server