Senior Data Engineer

3 weeks ago


Mumbai, India eClerx Full time
Job Title: Senior Data Engineering Lead (Databricks)
Next Step:
If this role excites you and matches your expertise, kindly fill out the Google Form with the required details so we can reach out to you and make the process seamless:
Overview:
We are seeking a highly experienced Senior Data Engineering Lead with a strong focus on Databricks and cloud-based data engineering to lead our data engineering team. This leadership role requires a visionary who can design, develop, and manage scalable data infrastructure and pipelines, while mentoring and inspiring a team of data engineers. You will work closely with cross-functional teams including data scientists, analysts, and software engineers to enable robust data-driven decision-making and support business goals.
Key Responsibilities:
- Lead and manage a team of data engineers, providing mentorship, technical guidance, and fostering a culture of collaboration and innovation.
- Architect, design, and oversee implementation of large-scale data pipelines, data lakes, and cloud-based data warehouses using Databricks, Apache Spark, and Snowflake.
- Develop and optimize ETL/ELT workflows ensuring performance, reliability, and scalability of data infrastructure.
- Collaborate with business stakeholders, data scientists, and software teams to understand requirements and translate them into scalable, efficient data solutions.
- Implement best practices for data quality, governance, security, and compliance.
- Drive continuous improvement of data engineering processes, standards, and tools across the organization.
- Support presales activities by contributing to RFPs, technical proposals, and client engagements.
- Stay abreast of emerging data technologies and trends, recommending innovative solutions to enhance analytics capabilities.
- Manage resource planning, project prioritization, and delivery timelines ensuring alignment with business objectives.
- Lead performance reviews, identify skill gaps, and champion professional development within the data engineering team.
- Facilitate cross-team communication to streamline data workflows and improve overall delivery.
Qualifications & Skills:
- Bachelor’s or Master’s degree in Computer Science, Data Science, Engineering, or a related discipline.
- Minimum 18 years of professional experience in data engineering with at least 12 years in leadership or senior technical roles.
- Deep hands-on expertise with Databricks and Apache Spark for large-scale data processing.
- Strong programming skills in Python, Scala, or Java.
- Extensive experience with cloud data platforms such as AWS, Azure, or GCP, including services like S3, Redshift, BigQuery, Snowflake.
- Solid understanding of data modeling, data warehousing, ETL/ELT design, and data lakes.
- Experience with big data technologies like Hadoop, Kafka, and Databricks ecosystem.
- Knowledge of CI/CD pipelines, data orchestration tools (e.g., Apache Airflow), and data governance best practices.
- Proven experience managing high-performing teams and delivering complex data engineering projects on time.
- Familiarity with analytics solutions and the ability to translate business needs into technical requirements.
- Strong communication skills, capable of engaging with both technical teams and senior leadership.
- Experience supporting presales efforts and client technical discussions is a plus.
- Bonus: Exposure to machine learning lifecycle and model deployment on Databricks.
  • Senior Data Engineer

    3 weeks ago


    Mumbai, India eClerx Full time

    Job Title: Senior Data Engineering Lead (Databricks)Next Step:If this role excites you and matches your expertise, kindly fill out the Google Form with the required details so we can reach out to you and make the process seamless: Overview:We are seeking a highly experienced Senior Data Engineering Lead with a strong focus on Databricks and cloud-based...


  • Mumbai, India EClerx Full time

    Job Title: Senior Data Engineering Lead (Databricks)Next Step:If this role excites you and matches your expertise, kindly fill out the Google Form with the required details so we can reach out to you and make the process seamless:Wwc GUHf7rti Fa ARole Overview:We are seeking a highly experienced Senior Data Engineering Lead with a strong focus on Databricks...


  • Mumbai, India EClerx Full time

    Job Title: Senior Data Engineering Lead (Databricks)Next Step:If this role excites you and matches your expertise, kindly fill out the Google Form with the required details so we can reach out to you and make the process seamless:Wwc GUHf7rti Fa ARole Overview:We are seeking a highly experienced Senior Data Engineering Lead with a strong focus on Databricks...


  • mumbai, India eClerx Full time

    Job Title: Senior Data Engineering Lead (Databricks)📌 Next Step:If this role excites you and matches your expertise, kindly fill out the Google Form with the required details so we can reach out to you and make the process seamless:https://forms.gle/Z6qWwcGUHf7rtiFaARole Overview:We are seeking a highly experienced Senior Data Engineering Lead with a...


  • Mumbai, India eClerx Full time

    Job Title: Senior Data Engineering Lead (Databricks)Next Step:If this role excites you and matches your expertise, kindly fill out the Google Form with the required details so we can reach out to you and make the process seamless: Overview:We are seeking a highly experienced Senior Data Engineering Lead with a strong focus on Databricks and cloud-based...

  • Senior data engineer

    3 weeks ago


    Mumbai, India EClerx Full time

    Job Title: Senior Data Engineering Lead (Databricks) Next Step: If this role excites you and matches your expertise, kindly fill out the Google Form with the required details so we can reach out to you and make the process seamless: Role Overview: We are seeking a highly experienced Senior Data Engineering Lead with a strong focus on Databricks and...


  • Mumbai, India eClerx Full time

    Job Title: Senior Data Engineering Lead (Databricks) Next Step: If this role excites you and matches your expertise, kindly fill out the Google Form with the required details so we can reach out to you and make the process seamless: Role Overview: We are seeking a highly experienced Senior Data Engineering Lead with a strong focus on Databricks and...


  • Mumbai, India eClerx Full time

    Job Title: Senior Data Engineering Lead (Databricks)Next Step:If this role excites you and matches your expertise, kindly fill out the Google Form with the required details so we can reach out to you and make the process seamless: Overview:We are seeking a highly experienced Senior Data Engineering Lead with a strong focus on Databricks and cloud-based data...


  • Mumbai, India eClerx Full time

    Job Title: Senior Data Engineering Lead (Databricks) Next Step: If this role excites you and matches your expertise, kindly fill out the Google Form with the required details so we can reach out to you and make the process seamless: Role Overview: We are seeking a highly experienced Senior Data Engineering Lead with a strong focus on Databricks and...

  • Senior Data Engineer

    2 weeks ago


    Mumbai, Maharashtra, India Oracle Financial Services Software Ltd Full time ₹ 15,00,000 - ₹ 25,00,000 per year

    Senior Consultant - Databricks Senior Data Engineer – Databricks (Azure/AWS) Role Overview: We are looking for a hands-on Senior Data Engineer experienced in migrating and building large-scale data pipelines on Databricks using Azure or AWS platforms. The role will focus on implementing batch and streaming pipelines, applying the bronze-silver-gold...