constellation/bootstrapper
Daniel Weiße 2bcf001d52 Distribute k8s CA certificates and key over join-service
Signed-off-by: Daniel Weiße <dw@edgeless.systems>
2022-07-14 17:25:18 +02:00
..
cloudprovider Only upload kubeadm certs if key is rotated 2022-07-14 17:25:18 +02:00
cmd/bootstrapper Distribute k8s CA certificates and key over join-service 2022-07-14 17:25:18 +02:00
initproto Rename coordinator to bootstrapper and rename roles 2022-07-14 17:25:18 +02:00
internal Distribute k8s CA certificates and key over join-service 2022-07-14 17:25:18 +02:00
nodestate Rename coordinator to bootstrapper and rename roles 2022-07-14 17:25:18 +02:00
role Only upload kubeadm certs if key is rotated 2022-07-14 17:25:18 +02:00
util Rename coordinator to bootstrapper and rename roles 2022-07-14 17:25:18 +02:00
bootstrapping_arch.svg Bootstrapper 2022-07-14 17:25:18 +02:00
README.md Only upload kubeadm certs if key is rotated 2022-07-14 17:25:18 +02:00

Bootstrapper

The bootstrapper integrates the instance it is running on as node into the Kubernetes cluster. It is running on every new instance that is created.

bootstrapper architecture

The bootstrapper has two active components:

Init Flow

The InitServer is a gRPC server that is listining for initialization requests. The first instance needs to be initialized by the user, see the initproto for a description of the initialization protocol. The client that talks to this server is part of Constellation's CLI.

On an initialization request, the InitServer initializes a new Kubernetes cluster, essentially calling the InitCluster function of our Kubernetes library, which does a kubeadm init.

Join Flow

The JoinClient is a gRPC client that is trying to connect to an JoinService, which might be running in an already existing cluster as DaemonSet. The JoinService is validating the instance which wants to join the cluster using aTLS. For details on the used protocol and the verification of a joining instances measurements, see the joinservice package.

If the JoinService successfully verifies the instance, it issues a join ticket. The JoinClient then joins the cluster by calling the kubeadm join command, using the token and other needed information from the join ticket.

Synchronization, state machine, lifetime

The bootstrapper is automatically started on every new instance. Both InitServer and JoinClient are started and running in parallel. At some point during either the initialization or the join, a shared lock between the two components is acquired. This lock is used as point of no return. It is a state machine with two states (unlocked, locked) and a single transition from unlocked to locked. There is no way to unlock the node afterward (see nodelock package).

After the bootstrapping, the bootstrapper is stopped.