Senior Data Engineer

4 months ago

Bengaluru, India Index Exchange Full time

We shaped the earliest forms of ad tech, and we’re looking for the technical expertise to help shape its future. Our customers have unique problems that can only be solved at internet scale, and that’s where the technical skills of our team make a real difference.

Our exchange handles over 350 billion requests every day (for comparison Google serves an estimated 9 billion searches a day), all running in our own global data centers. Every member of our technology team has an enormous amount of autonomy in building and managing our systems to support and enable our growing level of scale. Through the transparency of our technology, dedication to innovation and integrity, and long-standing customer relationships, we lead through change.

What’s it like to work at Index?

We have more than 550 Indexers around the globe dedicated to building a safe and transparent marketplace that provides a trusted experience for consumers.

Index is an exciting and fast-paced place to work. We’re built on our values of change, support, learning and teaching, trust, and intention. We pride ourselves on our independence and openness, not only in our technology, but in our teams, too. Our diverse and inclusive culture celebrates how we can leverage our unique differences to help drive Index forward.

Our culture of success is truly supportive and collaborative. In working together across our teams, we’re continually investing in the people and technology to solve the industry’s most complex problems. As we extend the promise of ad tech to every channel, we’re looking for talented engineers to help advance Index, and the industry, forward.

Are you ready to join the programmatic evolution?

Index Exchange funds the open web. Content and journalism across the internet are funded through advertising, and we are the engine that helps to make that happen transparently, safely and efficiently. Handling hundreds of billions of auctions per day within milliseconds requires an intense understanding of the exchange and the ecosystem that we live in.

Our business is growing significantly every year and is poised to grow even faster. Our people and our platforms are the foundation and enabler of that growth. We are significantly expanding our technology teams, and are looking for technologists with a passion for high performance software development, and a drive to deliver software products and platforms that enable and empower industries at a global scale.

About The Role:

We’re looking for a Senior Data Engineer to join our team and help build the next generation of big data solutions at Index Exchange with real-time streaming and batch analytical capabilities. Data is a big deal at Index Exchange (Index). Index’s advertising exchange handles billions of auctions and generates terabytes of auction-related information every day. Our team builds tools and infrastructure to manage this vast amount of data and make it available to both internal and external customers and partners for their reporting and analytics as well as machine model training needs. 

Working with exciting technologies, your team will experiment with new tools and engineer innovative approaches to solve interesting challenges. Things shift very quickly in our industry, and we rely on our Engineering teams to keep Index and our clients ahead of the curve and moving in the right direction. We’re looking for Engineers who have experience in an Agile environment, who can drive innovation, and be a technical leader on our team.

Index’s scale spans the globe, our transactions happen 24x7 in our global data centers, and every second that passes millions of requests are evaluated across our exchange. In order to achieve our mission, global efficiency and reliability are absolutely key, as every millisecond quite literally counts in our business.

What We’re Looking For:

Experience and Leadership: A senior engineer with exposure leading projects and mentoring junior developers. A leader who continuously challenges the status quo and brings forth innovative ideas and improvements for the team. Problem Solvers: You don’t stop until the problem gets solved and you find more than one way to solve it. You love working with other people, presenting your viewpoint but ultimately working towards the best solution, regardless of where it comes from Knowledge Hungry: Learning new frameworks and languages is exciting to you – you’re not satisfied with the status quo. We use a variety of languages and tools to solve problems and we're interested in what you're looking to learn. Passionate: You have a passion for Big Data and an interest in the latest trends and developments constantly researching new tools and data technologies

Here’s What You’ll be Doing:

Evaluate new technologies, design, implement, and maintain data pipelines for extraction, transformation, and loading of data from a wide variety of data sources to various data services Identify, design, and implement system performance improvements Identify, design, and implement internal process improvements Automate manual processes and optimize data delivery Lead and mentor team members Identify and assess potential solutions for technical and business suitability

Here's What You Need:

Bachelor/ Master’s Degree in Computer Science or Engineering related fields 8+ years of experience as a Software Engineer in enterprise grade, large scale distributed software product development 5+ years of work experience designing and building high performance data pipelines and applications using Hadoop, Spark, Hive, Presto, Kafka and Flink streaming, Druid, or other similar technologies Proficiency in some of the following languages: SQL, Scala, Java, Python, Bash Deep understanding of design principles of distributed systems and familiar with mainstream big data related technologies and distributed frameworks Leadership, mentorship, collaboration, and communication skills Exposure to working and leading in a globally distributed, culturally diverse team Knowledge of data modeling, data warehousing, ETL processes, and business intelligence reporting tools Experience with SQL and NoSQL systems Experience with automated testing systems Experience working in Agile methodologies with continuous integration and delivery as CI/CD Experience working on and building distributed data pipelines that ingest and process large scale data and optimizations. Experience working with containerization, and virtualization tools such as Kubernetes, Docker Experience with integration of data from multiple data sources Experience with scheduling tools such as airflow, oozie

Why You’ll Love Working Here:

Company paid comprehensive health and life insurance plans Paid Time off and flexible work schedules Company contribution to Provident Fund Participation in our company Stock options plan Company paid Parental Leave Monthly internet stipend Quarterly Wellness allowance Community engagement opportunities and donation-matching program Volunteer paid day off Annual virtual company retreats and regular community-led team events A workplace that supports a diverse, equitable, and inclusive environment – learn more here

Notification

Index Exchange is aware that there have been recent scams directed toward candidates regarding job interviews and offers.

Please be vigilant and do not accept interview requests, job offers, or other hiring-related documents from anyone other than our dedicated recruitment team, from the domain of @indexexchange.com. Our interview process consists of several steps, including phone screens and video interviews. We do not conduct interviews via an email questionnaire or request money at any point in the process.

We remain dedicated to resolving this matter and we appreciate your support.

Equal employment opportunity

At Index Exchange, we believe that successful products are built by teams just as diverse as the audience who uses them. As such, we are committed to equal employment opportunities. We celebrate diversity of race, color, ancestry, religion, sex, national origin, sexual orientation, age, citizenship, marital status, disability, gender identity or expression, or veteran status. Additionally, we realize that diversity is deeper than any status or classification—diversity is the human experience. For those who show grit, passion, and humility—Index will welcome you.

Accessibility for applicants with disabilities

Index Exchange welcomes and encourages individuals with disabilities to apply to work with us. 

If you require an accommodation, please share the details of your request and any information how we can assist you with the hiring recruiter when they contact you. Index Exchange will make reasonable efforts to ensure accommodation requests are met throughout the recruitment process.

Index Everywhere, Index Anywhere

Our corporate headquarters are in Toronto, with major offices in New York, Montreal, Kitchener, London, San Francisco, and many other global cities. As a major global advertising exchange, we are committed to operating as a tightly knit global team and embracing and empowering talent wherever our colleagues may be.

#Ll-SK1

#LI-Remote

  • Senior Data Engineer

    4 weeks ago

    Bengaluru, India NTT DATA Full time

    Job Description Req ID: 302206 NTT DATA strives to hire exceptional, innovative and passionate individuals who want to grow with us. If you want to be part of an inclusive, adaptable, and forward-thinking organization, apply now.We are currently seeking a Senior Data Engineer to join our team in Bangalore, Karnātaka (IN-KA), India (IN).Job...

  • Senior Data Engineering Specialist

    4 weeks ago

    Bengaluru, Karnataka, India NTT DATA Full time

    About the RoleWe are seeking a skilled Senior Data Engineering Specialist to join our team in Bangalore, India. The successful candidate will have a strong background in ETL development and data engineering using Azure concepts and technologies.Key ResponsibilitiesDesign and implement high and low-level design documents for ETL processes.Develop ETL code in...

  • Senior Data Engineer

    4 weeks ago

    Bengaluru, Karnataka, India NTT DATA Full time

    About NTT DATANTT DATA is a $30+ billion global innovator of business and technology services. We help clients innovate, optimize, and transform for success. As a Global Top Employer, we have diverse experts in more than 50 countries and a robust partner ecosystem. Our services include business and technology consulting, data and artificial intelligence,...

  • Senior Data Engineer

    1 month ago

    Bengaluru, India NTT DATA Services Full time

    Req ID: 302206 NTT DATA strives to hire exceptional, innovative and passionate individuals who want to grow with us. If you want to be part of an inclusive, adaptable, and forward-thinking organization, apply now.We are currently seeking a Senior Data Engineer to join our team in Bangalore, Karnātaka (IN-KA), India (IN).Job PurposeThe senior data...

  • Data Engineering Senior Specialist

    4 weeks ago

    Bengaluru, Karnataka, India NTT DATA Services Full time

    Data Engineering Senior Specialist RoleDiverse and dynamic Data Engineering activities on Azure Data platform. The role involves building and delivering Data pipelines connecting various enterprise data sources, both RDBMS and NoSQL. Develop data mappings to existing data sources and design big data processing notebooks using Azure Databricks. Scripting and...

  • Senior Data Engineer

    4 weeks ago

    Bengaluru, Karnataka, India NTT DATA Full time

    Job Description Data Engineer - Cloud Solutions Diverse Data Engineering activities on Azure Data platform. Build & Deliver Data pipeline connecting various enterprise data sources. Develop data mappings to existing data sources. Design and develop big data processing notebooks using Azure Databricks. Scripting and programming using programming languages...

  • Data Engineering Specialist

    4 weeks ago

    Bengaluru, Karnataka, India NTT DATA Full time

    Job SummaryReq ID: 302206NTT DATA is seeking a highly skilled Senior Data Engineer to join our team in Bangalore, India.Job PurposeThe Senior Data Engineer will play a key role within the Data & Analytics team, designing, building, and maintaining systems and infrastructure for processing, collecting, storing, and analyzing large volumes of data.Key...

  • Data Systems Engineer

    4 weeks ago

    Bengaluru, Karnataka, India NTT DATA Full time

    About the RoleNTT DATA is seeking a highly skilled Senior Data Engineer to join our team in Bangalore, India. The ideal candidate will have a strong background in designing, building, and maintaining data systems.Key ResponsibilitiesDesign and develop data warehouses and data models to support business intelligence and analytics.Create and maintain data...

  • Senior Data Analytics Specialist

    4 weeks ago

    Bengaluru, Karnataka, India NTT DATA Services Full time

    Job Title: Senior Data Analytics SpecialistAbout the Role:We are seeking a skilled Senior Data Analytics Specialist to join our team in India. As a Senior Data Analytics Specialist, you will play a key role in designing, building, and maintaining the systems and infrastructure necessary for processing, collecting, storing, and analyzing large volumes of...

  • Senior Data Engineer for AI and Machine Learning

    4 days ago

    Bengaluru, Karnataka, India NTT DATA Full time

    Job Title: Senior Data Engineer for AI and Machine LearningWe are seeking an experienced Data Scientist & AIML, GenAI Lead/Engineer to join our team in Bangalore, India.About the Role:Develop and implement traditional machine learning algorithms.Deploy at least one model in a production environment.Write and maintain Python code for data science and machine...

  • Senior Time Series Data Engineer

    2 weeks ago

    Bengaluru, Karnataka, India NTT DATA Full time

    About the RoleWe are seeking a highly skilled Senior Time Series Data Engineer to join our team in Bangalore, India. As a Senior Time Series Data Engineer, you will be responsible for designing, developing, and implementing large-scale data processing systems that handle complex time series data.Key ResponsibilitiesDesign and develop scalable data pipelines...

  • Senior AI Data Engineer and Solutions Architect

    2 weeks ago

    Bengaluru, Karnataka, India NTT DATA Full time

    About NTT DATANTT DATA is a global innovator of business and technology services, serving 75% of the Fortune Global 100. Our diverse experts in over 50 countries collaborate to drive long-term success for clients.Job OverviewWe are seeking an experienced Senior AI Data Engineer and Solutions Architect to join our team in Bangalore, India. This role requires...

  • Senior Data Architect

    4 days ago

    Bengaluru, Karnataka, India NTT DATA Services Full time

    Job OverviewWe are seeking an experienced Senior Data Architect - Cloud Engineer to join our team in Remote India. The successful candidate will play a critical role in supporting and enhancing our Azure Data Lakehouse environment.About the RoleThis is an exciting opportunity to leverage your expertise in designing and implementing efficient data models,...

  • Senior Cloud Data Architect

    2 weeks ago

    Bengaluru, Karnataka, India NTT DATA Full time

    NTT DATA is a global technology services company with a presence in over 50 countries.We have a wide range of job opportunities available for talented professionals like you.About the Job:Job DescriptionWe are seeking a Senior Cloud Data Architect to join our team in Bangalore, India. The successful candidate will be responsible for designing and...

  • Senior Power BI Data Engineer Professional

    1 week ago

    Bengaluru, Karnataka, India NTT DATA Services Full time

    Job OverviewWe are seeking a highly skilled Senior Power BI Data Engineer to join our team in Bangalore, India. This role will involve developing and implementing data engineering solutions using Power BI reporting tools.About the RoleThis is an exciting opportunity for an experienced data engineer to work with our team and contribute to the development of...

  • Senior Java Software Engineer

    4 weeks ago

    Bengaluru, Karnataka, India NTT DATA Full time

    Job Title: Senior Java Software EngineerJob Summary:We are seeking a highly skilled Senior Java Software Engineer to join our team. The ideal candidate will have a strong background in Java development, with a focus on enterprise-level applications and cloud-based systems.Design, develop, and deploy scalable and efficient Java applications on cloud...

  • Snowflake Data Engineer and Architect

    3 weeks ago

    Bengaluru, Karnataka, India NTT DATA Full time

    About the RoleWe are seeking a highly skilled Snowflake Data Engineer and Architect to join our team in Bangalore, India. This is a senior-level position that requires expertise in designing, developing, and maintaining large-scale data warehousing solutions using Snowflake.Key ResponsibilitiesDesign and implement efficient data models and architectures for...

  • Senior Data Engineer Position

    4 weeks ago

    Bengaluru, Karnataka, India NTT DATA Services Full time

    Data Engineering Role OverviewWe are seeking a Data Engineering professional to join our team at NTT DATA. This role involves designing, building, and maintaining data systems and infrastructure to process, collect, store, and analyze large volumes of data.The ideal candidate will have experience with data modeling, data warehousing, and data integration....

  • Senior Engineering Manager

    4 weeks ago

    Bengaluru, Karnataka, India HEVO DATA Full time

    Job Description:This is an excellent opportunity to lead the development of scalable and fault-tolerant platform services at Hevo Data.As a Senior Engineering Manager, you will be responsible for building and managing a team of passionate software engineers who share a sense of ownership and impact.The successful candidate will drive on-time, high-quality...

  • Hevo Data

    4 weeks ago

    Bengaluru, India HEVO DATA Full time

    This role provides a great opportunity to own and build highly scalable and fault-tolerant platform services that will help support thousands of customers' data pipelines and load data reliability to the different cloud warehouses. These services are the core of the Hevo platform that helps provide building no code-low pipeline. Also, makes a huge...