Search results for: March 2015

Extending Play’s validation to work with Big Data tools like DynamoDB, S3, and Spark

// 03.18.2015 // Data

In this two-part blog series, we are looking at how MediaMath uses Play’s API to perform data validation on big data pipelines. In part one, we covered data validation with Play’s combinator-based API. In part two, we’ll extend that data validation to work with Amazon Web Services DynamoDB, AWS S3, and Spark. Extending validation to work with AWS DynamoDB MediaMath uses a variety of technologies in our analytics stack, including AWS DynamoDB. DynamoDB is a distributed, fault-tolerant key value store as a service that makes it easy to store/query massive datasets. We use it to power a few internal troubleshooting […]

On the road with MediaMath: O’Reilly Software Architecture, Fluent, & more!

// 03.13.2015 // Culture

We are taking our technology on the road this spring! MediaMath’s engineering team will be presenting at conferences and hosting events across the country – from Boston to San Francisco, and New York to Chicago. If you’re planning to attend any of the events below, please let us know. We’d love to meet you! Hit us up on twitter (@mediamath) or in the comments below. March 17-19, 2015 O’Reilly Software Architecture Conference  Boston, MA MediaMath’s VP of Engineering Edward Fagin will be presenting “Breaking the logjam: From batch to streaming,” a case study of how MediaMath, a digital marketing technology platform, was able to […]

Scaling data tools: How Play enables strongly typed big data pipelines

// 03.04.2015 // Data

The other day, I was talking with a colleague about data validation, and the Play web framework came up. Play has a nice API for validating HTML form and JSON submissions. This works great when you’re processing small amounts of data from the web-tier of your application. But could that same tech benefit a Big Data team working on a backend powered by Hadoop or Spark? We decided to find out, and the results were encouraging. The secret sauce? Play’s combinator-based approach to data validation. Whether your data is big or small, garbage in is garbage out MediaMath processes TBs […]