Senior Data Engineer

1 week ago

Bengaluru, Karnataka, India eClerx Full time

Job Title: Senior Data Engineering Lead (Databricks)

Next Step:

If this role excites you and matches your expertise, kindly fill out the Google Form with the required details so we can reach out to you and make the process seamless:

Role Overview:

We are seeking a highly experienced Senior Data Engineering Lead with a strong focus on Databricks and cloud-based data engineering to lead our data engineering team. This leadership role requires a visionary who can design, develop, and manage scalable data infrastructure and pipelines, while mentoring and inspiring a team of data engineers. You will work closely with cross-functional teams including data scientists, analysts, and software engineers to enable robust data-driven decision-making and support business goals.

Key Responsibilities:

  • Lead and manage a team of data engineers, providing mentorship, technical guidance, and fostering a culture of collaboration and innovation.
  • Architect, design, and oversee implementation of large-scale data pipelines, data lakes, and cloud-based data warehouses using Databricks, Apache Spark, and Snowflake.
  • Develop and optimize ETL/ELT workflows ensuring performance, reliability, and scalability of data infrastructure.
  • Collaborate with business stakeholders, data scientists, and software teams to understand requirements and translate them into scalable, efficient data solutions.
  • Implement best practices for data quality, governance, security, and compliance.
  • Drive continuous improvement of data engineering processes, standards, and tools across the organization.
  • Support presales activities by contributing to RFPs, technical proposals, and client engagements.
  • Stay abreast of emerging data technologies and trends, recommending innovative solutions to enhance analytics capabilities.
  • Manage resource planning, project prioritization, and delivery timelines ensuring alignment with business objectives.
  • Lead performance reviews, identify skill gaps, and champion professional development within the data engineering team.
  • Facilitate cross-team communication to streamline data workflows and improve overall delivery.

Qualifications & Skills:

  • Bachelor's or Master's degree in Computer Science, Data Science, Engineering, or a related discipline.
  • Minimum 18 years of professional experience in data engineering with at least 12 years in leadership or senior technical roles.
  • Deep hands-on expertise with Databricks and Apache Spark for large-scale data processing.
  • Strong programming skills in Python, Scala, or Java.
  • Extensive experience with cloud data platforms such as AWS, Azure, or GCP, including services like S3, Redshift, BigQuery, Snowflake.
  • Solid understanding of data modeling, data warehousing, ETL/ELT design, and data lakes.
  • Experience with big data technologies like Hadoop, Kafka, and Databricks ecosystem.
  • Knowledge of CI/CD pipelines, data orchestration tools (e.g., Apache Airflow), and data governance best practices.
  • Proven experience managing high-performing teams and delivering complex data engineering projects on time.
  • Familiarity with analytics solutions and the ability to translate business needs into technical requirements.
  • Strong communication skills, capable of engaging with both technical teams and senior leadership.
  • Experience supporting presales efforts and client technical discussions is a plus.
  • Bonus: Exposure to machine learning lifecycle and model deployment on Databricks.

  • Data Senior Engineer

    2 weeks ago

    Bengaluru, Karnataka, India NTT DATA Full time US$ 80,000 - US$ 1,20,000 per year

    Req ID: 337669NTT DATA strives to hire exceptional, innovative and passionate individuals who want to grow with us. If you want to be part of an inclusive, adaptable, and forward-thinking organization, apply now. We are currently seeking a Data Senior Engineer to join our team in Bangalore, Karnātaka (IN-KA), India (IN). Job Duties: 8+ years of experience...

  • Data Senior Engineer

    2 weeks ago

    Bengaluru, Karnataka, India NTT DATA North America Full time US$ 1,00,000 - US$ 1,50,000 per year

    Req ID: NTT DATA strives to hire exceptional, innovative and passionate individuals who want to grow with us. If you want to be part of an inclusive, adaptable, and forward-thinking organization, apply now.We are currently seeking a Data Senior Engineer to join our team in Bangalore, Karnātaka (IN-KA), India (IN).Job Duties: 8+ years of experience in a Data...

  • Senior, Data Engineer

    2 weeks ago

    Bengaluru, Karnataka, India NTT DATA Full time US$ 1,04,000 - US$ 1,30,878 per year

    Make an impact with NTT DATAJoin a company that is pushing the boundaries of what is possible. We are renowned for our technical excellence and leading innovations, and for making a difference to our clients and society. Our workplace embraces diversity and inclusion – it's a place where you can grow, belong and thrive.Your day at NTT DATAThe Manager,...

  • Senior Associate Data Engineer

    2 weeks ago

    Bengaluru, Karnataka, India NTT DATA, Inc. Full time

    Job DescriptionMake an impact with NTT DATAJoin a company that is pushing the boundaries of what is possible. We are renowned for our technical excellence and leading innovations, and for making a difference to our clients and society. Our workplace embraces diversity and inclusion its a place where you can grow, belong and thrive.Your day at NTT DATAThe...

  • Data Engineer

    2 weeks ago

    Bengaluru, Karnataka, India Data Analytics Full time ₹ 15,00,000 - ₹ 20,00,000 per year

    Get to Know the Team Grab has been expanding into multiple lines of businesses. The Grab Data Warehouse team builds business intelligence systems using data from all business lines to provide insights to key stakeholders across the company. Get to Know the Role We are looking for a Lead Data Engineer to lead the design and enhancement of our data...

  • Senior Data Engineer

    2 weeks ago

    Bengaluru, Karnataka, India beBeeData Full time ₹ 1,04,000 - ₹ 1,30,878

    Job Title: Senior Data Engineer About the RoleThis is an exciting opportunity to join our team as a senior data engineer. We are looking for a highly skilled and experienced professional who can design, develop, and implement large-scale data processing systems.

  • Senior Data Engineer

    7 days ago

    Bengaluru, Karnataka, India beBeeDataEngineering Full time ₹ 15,00,000 - ₹ 25,00,000

    Data Engineering Role OverviewWe are seeking a senior data engineer to drive business strategies through robust data pipelines.Develop and refine intricate ETL pipelines for processing high volumes of data.Maintain data precision, coherence, and system performance.Collaborate with cross-functional teams for impactful solutions.Implement top-notch practices...

  • Senior Data Engineer

    2 weeks ago

    Bengaluru, Karnataka, India beBeeDataEngineer Full time ₹ 20,00,000 - ₹ 25,00,000

    Job Title: Senior Data EngineerWe are seeking a highly skilled Senior Data Engineer to join our team. As a Senior Data Engineer, you will be responsible for designing and executing test cases for ETL processes and data pipelines.You will perform source-to-target data validation, data quality checks, and reconciliation using your strong expertise in SQL for...

  • Data Engineer

    5 days ago

    Bengaluru, Karnataka, India NTT DATA, Inc. Full time ₹ 1,04,000 - ₹ 1,30,878 per year

    Req ID:321800We are currently seeking a Data Engineer (Talend &Pyspark) to join our team in Bangalore, Karntaka (IN-KA), India (IN)."Job Duties: Key Responsibilities: Design and implement tailored data solutions to meet customer needs and use cases, spanning from streaming to data lakes, analytics, and beyond within a dynamically evolving technical...

  • Senior Data Engineer

    1 week ago

    Bengaluru, Karnataka, India eClerx Full time

    Job Title: Senior Data Engineering Lead (Databricks) Next Step:If this role excites you and matches your expertise, kindly fill out the Google Form with the required details so we can reach out to you and make the process seamless:https://forms.gle/Z6qWwcGUHf7rtiFaARole Overview:We are seeking a highly experienced Senior Data Engineering Lead with a strong...