Home/Documentation/TUEO Private Deployment Manual

TUEO Private Deployment Manual (Xinchuang / domestic IT)

A deployment manual for delivery engineers and operations teams. TUEO private deployment is the main path: one independent, single-site, isolated installation per customer; Xinchuang-first, offline / air-gapped by default, one-click install; data stays inside the enterprise, fully auditable and rollback-capable.


1. Xinchuang and domestic IT adaptation

TUEO fully adapts to domestically produced software and hardware environments and supports deployment and operation on Xinchuang hardware, domestic CPU architectures, domestic GPU accelerator cards, and Xinchuang operating systems, meeting the security-and-controllability compliance requirements of key industries such as party and government, public security, government, energy, and finance:

The platform is also compatible with general-purpose x86 servers and standard Linux distributions, and the delivery form is configurable: a fully domestic stack (Xinchuang hardware + domestic GPU + Xinchuang OS) or a general-purpose stack can both be deployed with one click.

2. Deployment forms and architecture

2.1 Three delivery forms

FormSuitable forCharacteristics
Single-machine all-in-oneSmall and mid-size customersBuilt-in lightweight container base, the complete system on one machine, ready to use
Clustered high availability (k3s HA)Mid-to-large / key industriesN control planes + M compute nodes, etcd high availability, schedulable accelerator cards, the recommended production path
Manage existing clustersCustomers with existing K8sReuses a dedicated namespace in the customer’s existing cluster; the platform deploys via the k8s driver

2.2 Layered architecture

L3 Products and middleware    identity · cohort · studio · capabilities · executor
                              + PG / Redis / MinIO / knowledge base / IM / model gateway
L2 Operations platform        TUEO Console (configuration center · logs · status wall · deployment orchestration · backup · audit)
L1 Base                       Harbor intranet image registry · database high availability · certificates · gateway
L0 Cluster base               k3s HA · intranet cache layer · image proxy
Compute layer                 multi-model compute servers — independent compute nodes that uniformly deploy and manage models
L-1 OS baseline               domestic / general-purpose operating system · kernel baseline · software repository acceleration

Multi-model compute servers are independent compute nodes in the deployment architecture, dedicated to deploying models:

Key point: the base (database / cache / container base / object storage / model compute) is itself a managed object uniformly managed by the operations platform, not third-party infrastructure maintained by another team. The platform is even a managed object of itself (self-upgrade only swaps images; the genesis manifest remains the single source of truth forever).

3. Deployment phases (directory order)

Deployment uses replayable scripts + a site manifest, from bare metal to a production environment, without hand-typing SSH:

SeqPhaseContent
00 PreflightSite readiness acceptance gateComprehensive assertions on nodes / network / storage / resources; only proceed when all green
10 OS baselineSystem preparationSoftware repository acceleration (built-in cache / intranet proxy), kernel baseline, base packages
20 ClusterContainer baseParameterized installation of the high-availability cluster (control-plane / worker roles), etcd high availability
30 Compute nodesMulti-model compute serversAccelerator-card drivers + device plugins + persistence; domestic / general-purpose accelerator cards schedulable
35 Model deploymentModel servicesDeploy multi-model services (chat / embedding / vision / speech) on compute nodes, uniformly routed via the intranet model gateway
40 Cache layerIntranet accelerationImage proxy and software repository cache; on a slow public network, each artifact only crosses the slow link once
50 BaseInfrastructureCertificates, database high availability, intranet image registry, image pull permissions
60 Operations platformPlatform go-liveBuild images → load on site → bootstrap the operations platform (zero docker on nodes)
70 ProductsProduct deploymentidentity / cohort / studio / capabilities / executor etc. deployed via the platform, single-domain gateway access

After deployment, the 00 Preflight script doubles as an acceptance health check that can be re-run at any time.

4. Site manifest (declarative configuration)

Each customer site has one site/<name>.yaml, read parameterically by the scripts, zero hardcoding:

5. Offline and air-gapped deployment

Air-gapped (fully disconnected) is the default capability, not an option:

6. Operations manual

After deployment, all operations are completed in one interface: TUEO Console:

CapabilityDescription
Service catalogAll managed services declared declaratively; adding a product line = adding one configuration entry
Configuration centerOrdinary configuration declarative, secrets stored encrypted, version snapshots rollback-capable
Status wallHealth of all services and middleware visible on one screen
Deployment orchestrationThree drivers — local / single-machine / cluster — with health gates and rollback on deployment
Backup and recoveryFull-database backup, restore validation, rotation per retention policy
Upgrade and migrationBackup-first + rollback point; backup is required before upgrade
Diagnostic bundleOn air-gapped sites, package status + logs + desensitized configuration for remote support
AuditFull audit trail of deployment / configuration / approval operations, three RBAC tiers

Platform self-upgrade: pushing code auto-builds → images promote → swap image → liveness convergence; upgrades only change image tags and never re-render the genesis manifest (data volumes / master keys / gateway all preserved).

7. Security and compliance

8. Delivery checklist

DeliverableDescription
Deployment kitSite-manifest templates + phased scripts + shared libraries
Offline bundleContainer base / images / system packages, usable in air-gapped environments
LicenseSigned authorization file, soft node lock bound to the deployment
Operations platformAll operations capabilities available after deployment
DocumentationThis manual + per-product documentation + API reference

Questions about deployment, or need joint tuning for a Xinchuang environment, contact the TUEO delivery team.