constellation/conformance
Fabian Kammel a931f6692f Fix/bootstrapper regressions (#274)
* remove wireguard from e2e tests, conformance docs & config
Signed-off-by: Fabian Kammel <fk@edgeless.systems>
2022-07-15 11:53:14 +02:00
..
.gitignore Feat/conformity test (#79) 2022-04-26 17:09:03 +02:00
PRODUCT.yaml conformance pipeline required yaml as file extension, instead of yml. (#96) 2022-04-29 12:22:19 +02:00
README.md Fix/bootstrapper regressions (#274) 2022-07-15 11:53:14 +02:00

Reproducing Conformance Test Results

Prerequisites

Install & configure gcloud CLI for access to GCP.

Install kubectl for working with Kubernetes

For more information follow our documentation.

Additionally, Sonobuoy CLI is required. These tests results were produced using Sonobuoy v0.56.4.

Provision Constellation Cluster

constellation create gcp 1 2 n2d-standard-2 -y
constellation init
export KUBECONFIG="$PWD/constellation-admin.conf"

Run Conformance Tests

# Runs for ~2 hours.
sonobuoy run --mode certified-conformance
# Once status shows tests have completed...
sonobuoy status
# ... download & display results.
outfile=$(sonobuoy retrieve)
sonobuoy results $outfile

Fetch Test Log & Report

The provided e2e.log & junit_01.xml were fetched like this:

tar -xvf $outfile
cat plugins/e2e/results/global/e2e.log
cat plugins/e2e/results/global/junit_01.xml

Cleanup

# Remove test deployments
sonobuoy delete --wait
# Or, shutdown cluster
./constellation terminate
rm constellation-mastersecret.base64

Run CIS Benchmark Tests

# Runs for <1 min.
sonobuoy run --plugin https://raw.githubusercontent.com/vmware-tanzu/sonobuoy-plugins/master/cis-benchmarks/kube-bench-plugin.yaml --plugin https://raw.githubusercontent.com/vmware-tanzu/sonobuoy-plugins/master/cis-benchmarks/kube-bench-master-plugin.yaml --wait
# ... download & display results.
outfile=$(sonobuoy retrieve)
sonobuoy results $outfiles