jargon

Platform & DevOps·topic 4 of 9

Traffic into and inside the cluster

The moment there is more than one instance of anything, addressing stops being a hostname and becomes infrastructure. These are the words for how a packet finds a workload, what is allowed to talk to what, and which of it appears on the bill.

Read in order · tick what you already know

  1. 01

    a plugin you never chose gives every pod a routable address the moment it starts, and swapping it re-plumbs the whole cluster.

    Container Network Interface

  2. 02

    pod traffic is wrapped inside another packet to cross the real network, and you lose a few percent of throughput to the wrapper.

    Overlay network

  3. 03

    you connect to a name rather than an address, and every workload in the cluster resolves it to whatever is currently healthy.

    Cluster DNS

  4. 04

    instances come and go constantly and callers never hold a stale address, because nobody is configured with one.

    Service discovery

  5. 05

    a controller keeps a live list of which instances are ready, and removing one from that list is what actually stops traffic.

    Service endpoint

  6. 06

    the address you connect to belongs to no machine at all; something on every node rewrites the packet to a real instance.

    Virtual IP

  7. 07

    the name resolves to every instance's own address instead of one virtual one, because the client wants to choose.

    Headless service

  8. 08

    the balancer picks a backend per TCP connection and never looks inside, so it cannot route on a path or retry a request.

    Layer 4 load balancing

  9. 09

    the proxy reads the request, routes on the path, retries the failed one on another backend and adds a trace header.

    Layer 7 load balancing

  10. 10

    the traffic crossing the boundary between the outside world and your platform, which is the part that has a certificate and a WAF.

    North-south traffic

  11. 11

    one internal service calling another, which is most of your packets and historically none of your authentication.

    East-west traffic

  12. 12

    traffic from outside arrives at one front door with the certificate on it, and is routed inwards by hostname and path.

    Ingress

  13. 13

    the routing rules you wrote in a manifest become a running proxy's configuration, reloaded a second or two after you apply them.

    Ingress controller

  14. 14

    your workload calling a payment provider goes out through something with a fixed address, because the provider allow-lists it.

    Egress

  15. 15

    everything leaving the cluster is funnelled through one hop, so there is one address to allow-list and one place to log it.

    Egress gateway

  16. 16

    the workload can reach only the three services it declared, and its attempt to open a connection anywhere else times out silently.

    Network policy

  17. 17

    the port is open in the application and the connection still hangs, because a rule two layers below never allowed it.

    Security group

  18. 18

    being inside the network gets a caller nothing; every call is authenticated and authorised on its own merits.

    Zero-trust networking

  19. 19

    every connection your service makes actually goes through a proxy in the same pod, which is where the retries and the TLS happen.

    Sidecar proxy

  20. 20

    five percent of requests go to the new version and the rest to the old, decided by the proxy rather than by your code.

    Traffic splitting

  21. 21

    the instance is taken out of rotation but its open connections are allowed to finish, instead of being cut mid-response.

    Connection draining

  22. 22

    private workloads reach the internet through a shared address, and you find the thing on your bill charging per gigabyte.

    NAT gateway

  23. 23

    two private networks can address each other directly without going near the internet, and neither one's address ranges may overlap.

    VPC peering