Senior Data Engineer

August 30

Apply Now

Receive Emails with Similar Jobs

Index Exchange

WebsiteLinkedInAll Job Openings

The most efficient ad marketplace for media owners to monetize content and marketers to deliver relevant ad experiences

501 - 1000

Description

• We’re looking for a Senior Data Engineer to join our team and help build the next generation of big data solutions at Index Exchange with real-time streaming and batch analytical capabilities. • Index’s advertising exchange handles billions of auctions and generates terabytes of auction-related information every day. • Our team builds tools and infrastructure to manage this vast amount of data and make it available to both internal and external customers and partners for their reporting and analytics as well as machine model training needs. • Working with exciting technologies, your team will experiment with new tools and engineer innovative approaches to solve interesting challenges. • Things shift very quickly in our industry, and we rely on our Engineering teams to keep Index and our clients ahead of the curve and moving in the right direction.

Requirements

• Bachelor/ Master’s Degree in Computer Science or Engineering related fields • 8+ years of experience as a Software Engineer in enterprise grade, large scale distributed software product development • 5+ years of work experience designing and building high performance data pipelines and applications using Hadoop, Spark, Hive, Presto, Kafka and Flink streaming, Druid, or other similar technologies • Proficiency in some of the following languages: SQL, Scala, Java, Python, Bash • Deep understanding of design principles of distributed systems and familiar with mainstream big data related technologies and distributed frameworks • Leadership, mentorship, collaboration, and communication skills • Exposure to working and leading in a globally distributed, culturally diverse team • Knowledge of data modeling, data warehousing, ETL processes, and business intelligence reporting tools • Experience with SQL and NoSQL systems • Experience with automated testing systems • Experience working in Agile methodologies with continuous integration and delivery as CI/CD • Experience working on and building distributed data pipelines that ingest and process large scale data and optimizations. • Experience working with containerization, and virtualization tools such as Kubernetes, Docker • Experience with integration of data from multiple data sources • Experience with scheduling tools such as airflow, oozie

Benefits

• Comprehensive health, dental, and vision plans for you and your dependents • Paid time off, health days, and personal obligation days plus flexible work schedules • Competitive retirement matching plans • Equity packages • Generous parental leave available to birthing, non-birthing, and adoptive parents • Annual well-being allowance plus fitness discounts and group wellness activities • Commuter benefits and discounts, where available • Employee assistance program • Mental health first aid program that provides an in-the-moment point of contact and reassurance • One day of volunteer time off per year and a donation-matching program • Bi-weekly town halls and regular community-led team events • Multiple resources and programming to support continuous learning • A workplace that supports a diverse, equitable, and inclusive environment – learn more here