Lead Software Engineer

The our clients Identity team is looking for a savvy Lead Data Engineer to join the team and help build the next generation of Audience & Identity data platform that handles enormous scale (10+TB ingested per day and over datasets containing more than a trillion records) and uses state-of-the-art technologies to unlock the data’s business value. If you’re excited to work with a tightly-knit team of data engineers solving hard problems the right way using cutting-edge data collection, transformation, analysis, and monitoring tools in the cloud, this opportunity is for you.

Responsible for planning and designing new software and web applications. Analyzes, tests and assists with the integration of new applications. Oversees the documentation of all development activity. Trains non-technical personnel. Assists with tracking performance metrics. Provides guidance and support to other Engineers. Integrates knowledge of business and functional priorities. Acts as a key contributor in a complex and crucial environment. May lead teams or projects and shares expertise.

Core Responsibilities

• Collaborates with project stakeholders to identify product and technical requirements. Conducts analysis to determine integration needs.
• Designs and builds scalable, low-latency data processing pipeline using cutting edge AWS services, 3rd party open-source/commercial software, and internally developed software to ingest, process, and deliver data at scale.
• Continually acquires new data sources to develop an increasingly rich dataset that characterizes audiences.
• Collaborates with the serving team, report team, and Data engineers to translate complex product requirements into working high-quality cloud-native data solutions.
• Works with Principal Engineers and Architects to share and contribute to the broader technical vision.
• Continually works on improving the codebase and has active participation and oversight in all aspects of the team, including agile ceremonies.
• Displays in-depth knowledge of and ability to apply, process design, and redesign skills. Presents and defends architectural, design, and technical choices to internal audiences.
• Oversees the documentation of all development activities.
• Provides guidance and support to other Engineers.
• Seems like something you might be interested in? We want to meet you to discuss this exciting opportunity.

Required Background:

• Bachelor's or master’s degree in Computer Science or similar field of study
• 5+ years of hands-on work in the field of software development.
• 3+ years of experience with data applications (Spark, Presto, Hive, etc)
• 3+ years of experience in designing and building ETL pipelines to process data at scale
• 3+ years of experience with NoSQL implementation (AeroSpike, DynamoDB, etc)
• 3+ years of experience with a public cloud (AWS, Microsoft Azure, Google Cloud)
• 3+ years of experience with CI/CD tools such as Jenkins or AWS CodeBuild, Terraform, etc.
• Excellent coding skills with Python, Java/Scala
• Must be versatile and an inquisitive problem solver.
• Excellent communication and writing skills

Employees at all levels are expected to:

• Understand our Operating Principles; make them the guidelines for how you do your job.
• Own the customer experience - think and act in ways that put our customers first, give them seamless digital options at every touchpoint, and make them promoters of our products and services.
• Know your stuff - be enthusiastic learners, users and advocates of our game-changing technology, products and services, especially our digital tools and experiences.
• Win as a team - make big things happen by working together and being open to new ideas.
• Be an active part of the Net Promoter System - a way of working that brings more employee and customer feedback into the company - by joining huddles, making call backs and helping us elevate opportunities to do better for our customers.
• Drive results and growth.
• Respect and promote inclusion & diversity.
• Do what's right for each other, our customers, investors and our communities.