• 

  How we designed Dropbox’s ATF - an async task framework

  

  dropbox.tech

  How we designed Dropbox’s ATF - an async task framework

          Almost any large scale system will need some kind of job queue or async task. Dropbox designed a system that can handle 10,000 async tasks per second from the start, and be architected for future growth. This system is used among 28 teams. They documented Dropbox ATF thoroughly, as a reference and guide for the engineering community seeking their own async solutions.
  

  Another article on this topic are from DoorDash on Eliminating Task Processing Outages by Replacing RabbitMQ with Apache Kafka Without Downtime

  • Add  

  2

Appears in lists (1)

• Issues #177 Nov 16, 2020

More like this (3)

• 

  My journey with AWS Serverless

  

  medium.com

  AWS Lambda and DynamoDB Tips Learnt in 2020 — A bundle of various things the author...

  AWS Lambda and DynamoDB Tips Learnt in 2020 — A bundle of various things the author has picked up including thoughts on using Lambda synchronously vs asynchronously, how to structure apps, triggers, cold starts, and the limitations of DynamoDB.

  • Read
  • Add  

  1
• 

  Planning on using AWS Step Functions? Think again

  

  bassemdy.com

  Planning on Using AWS Step Functions? Think Again — Step Functions provides a way to coordinate...

  Planning on Using AWS Step Functions? Think Again — Step Functions provides a way to coordinate multiple AWS services in serverless workflows and they’re great.. for some use cases. Bassem digs in.

  • Read
  • Add  

  1
• 

  7 ways to do async message processing in AWS

  

  winterwindsoftware.com

  Seven Ways to Do Async Message Processing in AWS — A walkthrough of different options for...

  Seven Ways to Do Async Message Processing in AWS — A walkthrough of different options for implementing asynchronous message flows in AWS, including SQS, EventBridge, and Kinesis Data Streams.

  • Read
  • Add  

  1