Staff Data Systems Engineer

We shaped the earliest forms of ad tech and we re looking for the technical expertise to help shape its future Our customers have unique problems that can only be solved at internet scale and that s where the technical skills of our team make a real difference Our exchange handles over 500 billion requests every day for comparison Google serves an estimated 9 billion searches a day all running in our own global data centers Every member of our technology team has an enormous amount of autonomy in building and managing our systems to support and enable our growing level of scale Through the transparency of our technology dedication to innovation and integrity and long-standing customer relationships we lead through change What s it like to work at IndexWe have more than 550 Indexers around the globe dedicated to building a safe and transparent marketplace that provides a trusted experience for consumers Index is an exciting and fast-paced place to work We re built on our values of change support learning and teaching trust and intention We pride ourselves on our independence and openness not only in our technology but in our teams too Our diverse and inclusive culture celebrates how we can leverage our unique differences to help drive Index forward Our culture of success is truly supportive and collaborative In working together across our teams we re continually investing in the people and technology to solve the industry s most complex problems As we extend the promise of ad tech to every channel we re looking for talented engineers to help advance Index and the industry forward Are you ready to join the programmatic evolutionIndex Exchange funds the open web Content and journalism across the internet are funded through advertising and we are the engine that helps to make that happen transparently safely and efficiently Handling hundreds of billions of auctions per day within milliseconds requires an intense understanding of the exchange and the ecosystem that we live in Our business is growing significantly every year and is poised to grow even faster Our people and our platforms are the foundation and enabler of that growth We are significantly expanding our technology teams and are looking for technologists with a passion for high performance software development and a drive to deliver software products and platforms that enable and empower industries at a global scale About The Role We re looking for a Staff Engineer Data Systems to join our team and help build and maintain the next generation of big and small data solutions at Index Exchange Data is a big deal at Index Exchange Index Index s advertising exchange handles billions of auctions and generates terabytes of auction-related information every day Our team builds tools and infrastructure to manage this vast amount of data and make it available to both internal and external customers and partners for their reporting and analytics as well as machine model training needs Working with exciting technologies your team will experiment with new tools and engineer innovative approaches to solve interesting challenges under your technical leadership Things shift very quickly in our industry and we rely on our Technology Operations and Engineering teams to keep Index and our clients ahead of the curve and moving in the right direction We are looking for Engineers who have experience in an Agile environment who can execute and innovate between all layers of the data stacks from application event driven systems and RDBs to big data query engines and storage patterns and their automation pipelines Index s scale spans the globe our transactions happen 24x7 in our global data centers and every second that passes millions of requests are evaluated across our exchange In order to achieve our mission global efficiency and reliability are absolutely key as every millisecond quite literally counts in our business What We re Looking For Experience and Execution An established engineer with exposure execution of projects at a lead staff level or a functional area A developer first and for most that understands how to operate scale and join various data systems Problem Solvers You don t stop until the problem gets solved and you find more than one way to solve it You love working with other people presenting your viewpoint but ultimately working towards the best solution regardless of where it comes from Knowledge Hungry Learning new frameworks and languages is exciting to you - you re not satisfied with the status quo We use a variety of languages and tools to solve problems and we re interested in what you re looking to learn Passionate and Self Motivated You have a passion for Small and Big Data and an interest in the latest trends and developments constantly researching new tools and data technologies Here s What You ll be Doing Evaluate new technologies design implement and maintain big and small data systems and their associated pipelines governance audit installations operations best practices code libraries Maintain operate expand and govern existing big and small data systems from small caches and RDBs in Kubernetes to large Trino Spark Hadoop OLAP clusters Automate and manual hardships deployments create CI CD pipelines for everything best practices and internal methodologies for making everyone s life just that much easier Lead and mentor team members Identify and assess potential solutions for technical and business suitability Have a deep understanding about Index and its products Drive initiatives that produce positive outcomes across divisions Here s What You Need Bachelor Master s Degree in Computer Science or Engineering related fields 8 years of experience as a Senior Software Engineer in enterprise grade large scale distributed software product development 5 years of work experience designing and building high performance data pipelines and applications using Hadoop Spark Hive Presto Kafka and Flink streaming Druid or other similar technologies General Working and Operational knowledge in traditional RDBS mysql postgres etc Proficiency in some of the following languages Kotlin Scala Java Python Golang Rust Bash Deep understanding of design principles of distributed systems and familiar with mainstream big data related technologies and distributed frameworks Strong technical leadership mentorship collaboration and communication skills Exposure to working with a globally distributed culturally diverse team Knowledge of data modeling index patterns query optimization Some Experience NoSQL systems usage operations installations cassandra redis scylladb keyDB etc Experience with automated testing systems Experience working in Agile methodologies with continuous integration and delivery as CI CD Experience working with containerization and virtualization tools such as Kubernetes Docker Some experience with scheduling tools such as airflow oozie Why You ll Love Working Here Company paid comprehensive health and life insurance plans Paid Time off and flexible work schedules Company contribution to Provident Fund Participation in our company Stock options plan Company paid Parental Leave Monthly internet stipend Quarterly Wellness allowance Community engagement opportunities and donation-matching program Volunteer paid day off Annual virtual company retreats and regular community-led team events A workplace that supports a diverse equitable and inclusive environment - NotificationIndex Exchange is aware that there have been recent scams directed toward candidates regarding job interviews and offers Please be vigilant and do not accept interview requests job offers or other hiring-related documents from anyone other than our dedicated recruitment team from the domain of indexexchange com Our interview process consists of several steps including phone screens and video interviews We do not conduct interviews via an email questionnaire or request money at any point in the process We remain dedicated to resolving this matter and we appreciate your support Equal employment opportunityAt Index Exchange we believe that successful products are built by teams just as diverse as the audience who uses them As such we are committed to equal employment opportunities We celebrate diversity of race color ancestry religion sex national origin sexual orientation age citizenship marital status disability gender identity or expression or veteran status Additionally we realize that diversity is deeper than any status or classification-diversity is the human experience For those who show grit passion and humility-Index will welcome you Accessibility for applicants with disabilitiesIndex Exchange welcomes and encourages individuals with disabilities to apply to work with us If you require an accommodation please share the details of your request and any information how we can assist you with the hiring recruiter when they contact you Index Exchange will make reasonable efforts to ensure accommodation requests are met throughout the recruitment process Index Everywhere Index AnywhereOur corporate headquarters are in Toronto with major offices in New York Montreal Kitchener London San Francisco and many other global cities As a major global advertising exchange we are committed to operating as a tightly knit global team and embracing and empowering talent wherever our colleagues may be LI-REMOTE LI-AS4