Don’t miss the next upload by paperswelove!

Join free & follow paperswelove to be the first to hear it.

Join & follow
Papers We Love - QCon NYC Edition | Gwen Shapira on Realtime Data Processing at Facebook

Papers We Love - QCon NYC Edition | Gwen Shapira on Realtime Data Processing at Facebook

About the show

Meetup: http://bit.ly/2uSFBlB
Slides: http://bit.ly/2w0VBSI
Video: https://youtu.be/Gm3IqXbf35g
------------------------------------------------------------------------------
Sponsored by Two Sigma (@twosigma) and QCon NYC
------------------------------------------------------------------------------
Description
------------------
Realtime data processing powers many use cases at Facebook, including realtime reporting of the aggregated, anonymized voice of Facebook users, analytics for mobile applications, and insights for Facebook page administrators. Many companies have developed their own systems; we have a realtime data processing ecosystem at Facebook that handles hundreds of Gigabytes per second across hundreds of data pipelines.

Many decisions must be made while designing a realtime stream processing system. In this paper, we identify five important design decisions that affect their ease of use, performance, fault tolerance, scalability, and...

Comments