加入位于不同 Docker 容器中的 serf 节点时出现问题

上下文：主机是 AWS-EC2 / Ubuntu 14.04.5，带有 Docker 版本 17.05.0-ce。容器是根据公开可用的存储库映像构建的cbhihe/serf-alpine-bash。所有容器都位于同一个 EC2 实例上，并与网络接口“docker0”共享相同的默认桥接网络。

尝试通过从主机的 shell 传递 cmd 来加入节点 serfDC1 (id d4fd90692e18) 和 serfDC2 (id 6353e7f6134d)：

$ docker exec serfDC1 serf agent -node=Node1 -bind=0.0.0.0:7946
==> Starting Serf agent…
==> Starting Serf agent RPC...
==> Serf agent running!
         Node name: 'd4fd90692e18'
         Bind addr: '0.0.0.0:7946'
          RPC addr: '127.0.0.1:7373'
         Encrypted: false
          Snapshot: false
           Profile: lan
==> Log data will now stream in as it occurs:
    2017/06/04 00:01:10 [INFO] agent: Serf agent starting
    2017/06/04 00:01:10 [INFO] serf: EventMemberJoin: d4fd90692e18 127.0.0.1
    2017/06/04 00:01:11 [INFO] agent: Received event: member-join
    ^C

发现 Node1 容器的 IP=172.17.0.4 后，我可以发出serf agent -joincmd 到节点2：

$ docker exec serfDC2 serf agent -node=Node2 -join=172.17.0.4
==> Starting Serf agent...
==> Starting Serf agent RPC...
==> Serf agent running!
         Node name: '6353e7f6134d'
         Bind addr: '0.0.0.0:7946'
          RPC addr: '127.0.0.1:7373'
         Encrypted: false
          Snapshot: false
           Profile: lan
==> Joining cluster...(replay: false)
    Join completed. Synced with 1 initial agents
==> Log data will now stream in as it occurs:
    2017/06/04 00:18:35 [INFO] agent: Serf agent starting
    2017/06/04 00:18:35 [INFO] serf: EventMemberJoin: 6353e7f6134d 127.0.0.1
    2017/06/04 00:18:35 [INFO] agent: joining: [172.17.0.4] replay: false
    2017/06/04 00:18:35 [INFO] serf: EventMemberJoin: d4fd90692e18 127.0.0.1
    2017/06/04 00:18:35 [INFO] agent: joined: 1 nodes
    2017/06/04 00:18:36 [WARN] memberlist: Got ping for unexpected node 'd4fd90692e18' from=127.0.0.1:7946
    2017/06/04 00:18:36 [INFO] agent: Received event: member-join
    2017/06/04 00:18:37 [WARN] memberlist: Got ping for unexpected node d4fd90692e18 from=127.0.0.1:34876
    2017/06/04 00:18:37 [ERR] memberlist: Failed TCP fallback ping: EOF
    2017/06/04 00:18:37 [INFO] memberlist: Suspect d4fd90692e18 has failed, no acks received
    2017/06/04 00:18:38 [WARN] memberlist: Got ping for unexpected node 'd4fd90692e18' from=127.0.0.1:7946
    2017/06/04 00:18:39 [WARN] memberlist: Got ping for unexpected node d4fd90692e18 from=127.0.0.1:34879
    2017/06/04 00:18:39 [ERR] memberlist: Failed TCP fallback ping: EOF
    2017/06/04 00:18:40 [INFO] memberlist: Suspect d4fd90692e18 has failed, no acks received
    2017/06/04 00:18:41 [WARN] memberlist: Got ping for unexpected node 'd4fd90692e18' from=127.0.0.1:7946
    2017/06/04 00:18:42 [WARN] memberlist: Got ping for unexpected node d4fd90692e18 from=127.0.0.1:34881
    2017/06/04 00:18:42 [ERR] memberlist: Failed TCP fallback ping: EOF
    2017/06/04 00:18:42 [INFO] memberlist: Marking d4fd90692e18 as failed, suspect timeout reached (0 peer confirmations)
    2017/06/04 00:18:42 [INFO] serf: EventMemberFailed: d4fd90692e18 127.0.0.1
    2017/06/04 00:18:43 [INFO] agent: Received event: member-failed
    2017/06/04 00:18:44 [INFO] memberlist: Suspect d4fd90692e18 has failed, no acks received
    2017/06/04 00:19:05 [INFO] serf: attempting reconnect to d4fd90692e18 127.0.0.1:7946
   ^C

导致加入失败，如下所示：

$ docker exec serfDC2 serf members
6353e7f6134d  127.0.0.1:7946  alive
d4fd90692e18  127.0.0.1:7946  failed  
$ docker exec serfDC1 serf members
d4fd90692e18  127.0.0.1:7946  alive 
6353e7f6134d  127.0.0.1:7946  failed

我已经在这方面已经有一段时间了，但对于我应该转向哪里却束手无策。 Hashicorp 和 Docker 的文档似乎没有涵盖不同容器中的两个农奴代理之间初始握手的这一方面。

有人可以告诉我哪里走错了吗？任何答案都会很棒，真的。德克萨斯州。

Serf 节点需要用可路由的地址“宣告”自己。在你的情况下，他们互相告诉对方：“嗨，我是本地主机：...”，所以每个人都试图回答本地主机，这是错误的，因为每个容器都有自己的本地主机。

有一个选项可以配置代理以使用eth0ip 向网络中的其他节点通告：-iface。然后你需要丢弃-bind选项。这些端口是默认的，因此无需自定义。

因此，对于节点1：

serf agent -node=Node1 -iface=eth0

对于节点2：

serf agent -node=Node2 -join=172.17.0.2 -iface=eth0

From docs https://www.serf.io/docs/agent/options.html:

-iface - 该标志可用于提供绑定接口。如果接口已知但不知道地址，则可以使用它来代替 -bind。

它对我来说工作正常：

Node1:

==> Log data will now stream in as it occurs:

    2017/06/04 01:56:40 [INFO] agent: Serf agent starting
    2017/06/04 01:56:40 [INFO] serf: EventMemberJoin: Node1 172.17.0.2
    2017/06/04 01:56:41 [INFO] agent: Received event: member-join
    2017/06/04 01:57:02 [INFO] serf: EventMemberJoin: Node2 172.17.0.3
    2017/06/04 01:57:03 [INFO] agent: Received event: member-join

Node2:

==> Log data will now stream in as it occurs:

    2017/06/04 01:57:02 [INFO] agent: Serf agent starting
    2017/06/04 01:57:02 [INFO] serf: EventMemberJoin: Node2 172.17.0.3
    2017/06/04 01:57:02 [INFO] agent: joining: [172.17.0.2] replay: false
    2017/06/04 01:57:02 [INFO] serf: EventMemberJoin: Node1 172.17.0.2
    2017/06/04 01:57:02 [INFO] agent: joined: 1 nodes
    2017/06/04 01:57:03 [INFO] agent: Received event: member-join

Edit:

如果每个容器都在自己的VM（EC2实例）中，则由于每个实例都有自己的docker网络并且不互连，因此您必须提供EC2实例IP并公开相应的端口。使用-advertise https://www.serf.io/docs/agent/options.html#advertise

-advertise - 广告标志用于更改我们向集群中其他节点广告的地址。

Node1:

serf agent -node=Node1 -iface=eth0 -advertise=INSTANCE_IP

Node2:

serf agent -node=Node2 -join=NODE1_INSTANCE_IP -iface=eth0

并记住expose农奴口在docker run

docker run -p 7946:7946 (...rest of the command...)