Git-Mirrors/backend-and-orchestration-toolkit
1
0
Fork 0
mirror of https://github.com/autistic-symposium/backend-and-orchestration-toolkit.git synced 2025-06-29 08:57:12 -04:00
Code Issues Projects Releases Packages Wiki Activity
backend-and-orchestration-t.../kubernetes/python-cdk/ts/MSK_example
History
dependabot[bot] fde85d1d66
Bump ws from 5.2.2 to 5.2.3 in /kubernetes/python-cdk/ts/MSK_example 
Bumps [ws](https://github.com/websockets/ws) from 5.2.2 to 5.2.3.
- [Release notes](https://github.com/websockets/ws/releases)
- [Commits](https://github.com/websockets/ws/compare/5.2.2...5.2.3)

---
updated-dependencies:
- dependency-name: ws
  dependency-type: indirect
...

Signed-off-by: dependabot[bot] <support@github.com>
2022-03-23 11:29:20 +00:00
..
bin Clean up this repo 2022-03-23 14:59:51 +04:00
lib Clean up this repo 2022-03-23 14:59:51 +04:00
cdk.context.json Clean up this repo 2022-03-23 14:59:51 +04:00
cdk.json Clean up this repo 2022-03-23 14:59:51 +04:00
package-lock.json Bump ws from 5.2.2 to 5.2.3 in /kubernetes/python-cdk/ts/MSK_example 2022-03-23 11:29:20 +00:00
package.json Clean up this repo 2022-03-23 14:59:51 +04:00
README.md Clean up this repo 2022-03-23 14:59:51 +04:00
tsconfig.json Clean up this repo 2022-03-23 14:59:51 +04:00

README.md

CDK MSK Example

Deploy VPC

Amazon VPC lets you provision a logically isolated section of the AWS Cloud where you can all the resources as in a virtual network.

These are the default values in cdk.json:

"vpc.cidr": "10.0.0.0/16",
"vpc.maxAzs": 3,

Deploy with:

cdk deploy VPCStack

Deploy MSK

Amazon MSK is a managed service that makes it easy for you to build and run applications that use Apache Kafka to process streaming data.

These are the default values in cdk.json:

"msk.DevMskCluster": "MskCluster",
"msk.ClusterTag": "MSK cluster",
"msk.brokerNodeGroupBrokerAzDistribution": "DEFAULT",
"msk.enhancedMonitoring": "PER_BROKER",
"msk.brokerNodeGroupEBSVolumeSize": 100,
"msk.brokerNodeGroupInstanceType": "kafka.m5.large",
"msk.brokerPort": 9092,
"msk.kafkaVersion": "2.2.1",
"msk.numberOfBrokerNodes": 3

Deploy with:

cdk deploy MskClusterStack

Kafka CLI

Note that the CLI commands for MKS are given by the keyword kafka, for example:

aws kafka list-clusters

To retrieve BootstrapBrokerStringTls, run:

 aws kafka get-bootstrap-brokers --cluster-arn <cluster ARN>

However, access and development within the cluster (e.g. creating topics, accessing brokers) need to be done while connected to the VPN.