IntroductionJW Player receives an average of 45,000 log entries per second (or "pings") into a lambda architecture data pipeline. This equates to a daily data set that contains between 3 and 4 billion rows. To improve query performance and save storage costs the Data team at JW Player has started an initiative to re-define the data domain where pings are stored as sessions in a columnar format.
Why use Data-Driven Recommendations?Launched in November 2015 to a select group of publishers, JW Platform Data-Driven Recommendations:
- Increase content plays and monetization opportunities where ads are present.
- Use existing content connections and viewer activity to simplify your publishing workflow and increase revenue.
- Provide your viewers with automatically-curated video suggestions that increase audience engagement and are continually updating based on interaction data and content traits.