constellation/docs/versioned_docs/version-2.3/workflows/troubleshooting.md
2022-12-12 17:52:29 +01:00

2.6 KiB

Troubleshooting

This section aids you in finding problems when working with Constellation.

Cloud logging

To provide information during early stages of the node's boot process, Constellation logs messages into the cloud providers' log systems. Since these offerings aren't confidential, only generic information without any sensitive values are stored. This provides administrators with a high level understanding of the current state of a node.

You can view these information in the follow places:

  1. In your Azure subscription find the Constellation resource group.
  2. Inside the resource group find the Application Insights resource called constellation-insights-*.
  3. On the left-hand side go to Logs, which is located in the section Monitoring.
    • Close the Queries page if it pops up.
  4. In the query text field type in traces, and click Run.

To find the disk UUIDs use the following query: traces | where message contains "Disk UUID"

  1. Select the project that hosts Constellation.
  2. Go to the Compute Engine service.
  3. On the right-hand side of a VM entry select More Actions (a stacked ellipsis)
    • Select View logs

To find the disk UUIDs use the following query: resource.type="gce_instance" text_payload=~"Disk UUID:.*\n" logName=~".*/constellation-boot-log"

:::info

Constellation uses the default bucket to store logs. Its default retention period is 30 days.

:::

  1. Open AWS CloudWatch
  2. Select Log Groups
  3. Select the log group that matches the name of your cluster.
  4. Select the log stream for control or worker type nodes.

Connect to nodes

Debugging via a shell on a node is directly supported by Kubernetes.

  1. Figure out which node to connect to:

    kubectl get nodes
    # or to see more information, such as IPs:
    kubectl get nodes -o wide
    
  2. Connect to the node:

    kubectl debug node/constell-worker-xksa0-000000 -it --image=busybox
    

    You will be presented with a prompt.

    The nodes file system is mounted at /host.

  3. Once finished, clean up the debug pod:

    kubectl delete pod node-debugger-constell-worker-xksa0-000000-bjthj