Skip to content

Environment Overview

Cluster: edge-vmo

The edge-vmo cluster is a 3-node bare metal edge deployment running KubeVirt (VMO) on Spectro Cloud Palette. It serves as the evaluation environment for migrating VMware workloads to KubeVirt.

Node Inventory

Hostname Role Internal IP OS Kernel Container Runtime
txulspectropoc1 control-plane 10.0.12.14 Ubuntu 24.04.3 LTS 6.8.0-90-generic containerd 2.0.4
txulspectropoc2 control-plane 10.0.12.18 Ubuntu 24.04.3 LTS 6.8.0-90-generic containerd 2.0.4
txulspectropoc3 control-plane 10.0.12.19 Ubuntu 24.04.3 LTS 6.8.0-90-generic containerd 2.0.4

Hardware: Minisforum MS-01

Each node is a Minisforum MS-01 with:

  • NVMe SSD (500GB) for OS
  • Additional 1-2TB drive for Portworx storage pool
  • Dual NICs in LACP bond
  • Intel AMT for out-of-band management

Component Versions (RA 1.8.0 Profiles)

Infra Profile (VMO-RA-Infra-Agent-PXKE-Portworx-PureFA):

Pack Version Layer
edge-native-byoi 2.1.0 OS
edge-k8s (PXKE) 1.33.6 K8s
cni-cilium-oss 1.18.4 CNI
portworx-add-on 3.4.1 Add-on

Core Profile (VMO-RA-Core-PXKE-Agent):

Pack Version Layer
lb-metallb-helm 0.15.2 Add-on
nginx (Ingress) 1.14.1 Add-on
prometheus-operator 80.4.2 Add-on
virtual-machine-orchestrator 4.8.9 Add-on

Key Namespaces

Namespace Purpose
virtual-machines Production VMs
vmo-golden-images Golden image PVCs for VM provisioning
konveyor-forklift Forklift migration operator
kubevirt KubeVirt operator and virt-handler
cdi Containerized Data Importer
monitoring Prometheus/Grafana stack
metallb-system MetalLB load balancer
portworx Portworx storage cluster

Infrastructure Dependencies

Component Location Notes
Proxmox 172.18.0.4:8006 Hosts MaaS VM and PCG cluster
MaaS 172.18.0.2:5240 Provisions bare metal via PXE
PCG 3-node cluster on Proxmox Bridges Palette to MaaS
vCenter txvmvcsa01.mouser.lan Source for VM migrations
DNS 10.0.11.2, 10.0.11.5, 10.0.11.4 Domain: mouser.lan
Gateway 10.0.12.1 Default route for VLAN 13

Secrets Management

API keys and credentials are stored in 1Password (vault: k8s):

Item Type Use
Mouser Palette API Key PASSWORD Palette API calls
Spectro API Key PASSWORD General Palette auth
Github Token LOGIN GitHub API access
Proxmox API LOGIN Proxmox automation
MaaS API Key LOGIN MaaS API access

Access via CLI: op read "op://k8s/<item-name>/password"