我在连接到 AWS MSK Kafka 时遇到问题(使用 with访问控制方式配置为None)从我的笔记本电脑,错误是:没有可用的经纪人
我在用纯文本通过端口连接9092:
from kafka import KafkaProducer
kafka_brokers = [ "xxx.kafka.ap-east-1.amazonaws.com:9092","xxx.kafka.ap-east-1.amazonaws.com:9092","xxx.kafka.ap-east-1.amazonaws.com:9092" ]
producer = KafkaProducer(bootstrap_servers=kafka_brokers)
Ref:AWS MSK - 纯文本代理端口9092, TLS 9094https://docs.aws.amazon.com/msk/latest/developerguide/client-access.html https://docs.aws.amazon.com/msk/latest/developerguide/client-access.html
我尝试了三件事(这没有帮助):
A。在我的 VPC 默认安全组下添加了超过 9092+9094 源/目标 0.0.0.0/0 的入站+出站源/目标
b.尝试按照以下说明在 AWS 客户端 VPN 上运行:
- https://docs.aws.amazon.com/vpn/latest/clientvpn-admin/cvpn-getting-started.html#cvpn-getting-started-certs https://docs.aws.amazon.com/vpn/latest/clientvpn-admin/cvpn-getting-started.html#cvpn-getting-started-certs
- 生成证书的说明:https://docs.aws.amazon.com/vpn/latest/clientvpn-admin/client-authentication.html#mutual https://docs.aws.amazon.com/vpn/latest/clientvpn-admin/client-authentication.html#mutual
- https://www.youtube.com/watch?v=Bv70DoHDDCY https://www.youtube.com/watch?v=Bv70DoHDDCY
C。关闭笔记本电脑上的防火墙
我看到其他人问类似的问题:如何将Python消费者连接到AWS MSK https://stackoverflow.com/questions/66375337/how-to-connect-python-consumer-to-aws-msk
有些人建议这只是不支持对于本地计算机/笔记本电脑上的客户端连接到 AWS MSK:如何从我的本地计算机和其他区域的 EC2 实例访问我的 AWS MSK 托管 kafka 队列 https://stackoverflow.com/questions/54401952/how-can-i-access-my-aws-msk-managed-kafka-queue-from-my-local-machine-and-ec2-in这是真的/官方的吗?
我在想创造EIP(弹性IP) https://repetitive.it/aws-msk-how-to-expose-the-cluster-on-the-public-network/?lang=en https://repetitive.it/aws-msk-how-to-expose-the-cluster-on-the-public-network/?lang=en然后以某种方式与代理域名 xxx.kafka.ap-east-1.amazonaws.com 关联(但不确定如何)并配置入站出站规则。
但我找不到任何有帮助的东西。
我已经束手无策了,这个问题已经消耗了一整天的时间。非常感谢任何帮助。
Thanks