AWS re:Invent 2017: Another Day, Another Billion Flows (NET405)

In this session, we walk through the Amazon VPC network and describe the problems we were solving when we created it, and the features we’ve been adding as we scale it. We cover how these problems and features are traditionally solved, and why those solutions are not scalable, inexpensive, or secure enough for AWS. Finally, we provide an overview of the solution that we’ve implemented. We discuss some of the unique mechanisms that we use to ensure customer isolation, get packets into and out of the network, and support new features such as NAT and VPC endpoints.

[@catharsis222]

This might be the one reinvent presentations from years ago that is timeless to this day.

[@johnleeuw3022]

Truly excellent presentation. Super informative, even 5 years down the road. Thank you Colm!

[@catharsis222]

Making your own network protocol is a legit genius idea for disambiguating of the same routes & addresses, and scaling to the amounts of VPCs

[@martinfeineis3380]

Awesome talk, thank you so much.

[@deepankargoswami8636]

Great use of first principal thinking from AWS engineering team.

[@OlivierRossant]

Awesome Distributed SDN Controler !

[@fernandolichtschein4222]

I agree with you in the route thing, you can always cite George Maharis. I used to watch the TV series. Radia's book is awesome.

[@williammeng2217]

NFV is Another Day, Another Billion Flows，nice

[@paradisetravel347]

27:40 flow tracking

[@sergioerazo8991]

Cool

[@mmm763]

In regard with NLB, destination IP of return traffic from ec2 target group is client IP(not NLB IP). In route table, default route is internet gateway. So, does this mean, return traffic doesn't go via NLB?

[@abeefwellington]

I got hung up on this too. In traditional networking, it couldn't go back through the NLB due to client IP preservation. But because AWS routes by flow and not IP, traffic does go back through the NLB even though it is not proxying. See the slide at 27:00

[@jerryhargrove]

My visual notes on this session can be found at: www.awsgeek.com/posts/reinvent2017-net405-notes/

[@GuillaumeMarchandProfile]

www.awsgeek.com/posts/AWS-reInvent-2017-Another-Day-Another-Billion-Flows-NET405/

[@indigoskywalker]

this sounds like openflow or typical sdn

[@samjackgreen]

I don't if this is using AI or something, but TH-cam has called a chapter "S3 low bouncer" instead of load balancer 😂