Senior Data Engineer

1 week ago

Bengaluru, Karnataka, India USEReady Full time ₹ 12,00,000 - ₹ 36,00,000 per year

Job Title: Senior Databricks Engineer

Experience Level: 5-8 Years

Job Summary

As a Senior Databricks Engineer, you will be responsible for designing, developing, and optimizing our data architecture and pipelines on the Databricks Lakehouse Platform. You will leverage your deep expertise in Spark, Delta Lake, and cloud technologies to build scalable and reliable solutions that process large-scale data efficiently. The ideal candidate is a proactive problem-solver with a strong background in data engineering and a passion for mentoring and driving technical excellence.

Key Responsibilities

  • Architect and Develop:
    Design, build, and maintain robust and scalable data pipelines and ETL/ELT processes using Databricks, Apache Spark, and Python/Scala.
  • Lakehouse Implementation:
    Architect and implement solutions on the Databricks Lakehouse Platform, including data modeling, ingestion, storage, and processing using Delta Lake.
  • Performance Optimization:
    Analyze and tune the performance of Spark jobs and Databricks clusters to ensure high efficiency, reliability, and cost-effectiveness.
  • Data Governance:
    Implement and manage data governance, data quality, and security best practices within Databricks, utilizing features like Unity Catalog.
  • Collaboration:
    Work closely with data scientists, analysts, and business stakeholders to understand their data requirements and deliver high-quality, end-to-end data solutions.
  • Automation & CI/CD:
    Develop and maintain CI/CD pipelines for automated testing and deployment of data workflows (e.g., using Azure DevOps, Jenkins, GitHub Actions).
  • Mentorship:
    Mentor junior engineers, conduct code reviews, and champion best practices in data engineering and software development.
  • Innovation:
    Stay current with the latest advancements in the Databricks platform and the broader big data ecosystem, and drive the adoption of new tools and technologies.

Required Qualifications and Skills

  • Experience:
    5-8 years of professional experience in a data engineering role.
  • Databricks Expertise:
    Proven hands-on experience architecting and building solutions on the Databricks platform.
  • Core Technical Skills:
  • Strong proficiency in
    Python
    or
    Scala
    .
  • Expert-level knowledge of
    Apache Spark
    , including Spark SQL and DataFrame APIs.
  • In-depth understanding and practical experience with
    Delta Lake
    .
  • Advanced
    SQL
    skills and experience with data warehousing concepts.
  • Cloud Proficiency:
    Solid experience with at least one major cloud platform (
    Azure
    ,
    AWS
    , or
    GCP
    ), including their data storage and processing services (e.g., Azure Data Lake Storage, AWS S3, Google Cloud Storage).
  • ETL/ELT:
    Demonstrable experience in designing and implementing complex ETL/ELT pipelines.
  • Problem-Solving:
    Excellent analytical and problem-solving abilities with a keen attention to detail.
  • Communication:
    Strong verbal and written communication skills, with the ability to explain complex technical concepts to non-technical stakeholders.
  • Data Visualization:
    Experience supporting data visualization tools like Power BI or Tableau

  • Data Senior Engineer

    2 weeks ago

    Bengaluru, Karnataka, India NTT DATA Full time ₹ 20,00,000 - ₹ 25,00,000 per year

    Req ID: 337669NTT DATA strives to hire exceptional, innovative and passionate individuals who want to grow with us. If you want to be part of an inclusive, adaptable, and forward-thinking organization, apply now. We are currently seeking a Data Senior Engineer to join our team in Bangalore, Karnātaka (IN-KA), India (IN). Job Duties: 8+ years of experience...

  • Senior Data Engineer cum Data Scientist

    4 days ago

    Bengaluru, Karnataka, India NTT DATA, Inc. Full time ₹ 12,00,000 - ₹ 36,00,000 per year

    About the RoleAs a Senior Data Engineer cum Data Scientist, you will be a key contributor to designing, developing, and operating advanced data architectures, pipelines, and analytics solutions within the Palantir ecosystemYou will leverage your deep expertise in Palantir Foundry and Gotham platforms, combined with strong AI capabilities, to solve complex...

  • Senior Azure Data Engineer

    6 days ago

    Bengaluru, Karnataka, India NTT DATA Global Delivery Services Ltd Full time ₹ 20,00,000 - ₹ 25,00,000 per year

    ERP Senior Specialist Job Title: Azure Senior Data Engineer We are looking a highly skilled and experienced Senior Azure Data Engineer to join our team. This role requires deep expertise in Azure Data Factory and Databricks, including CI/CD setup for Databricks, and strong proficiency in ETL, SQL, and modern data engineering practices. You will be the...

  • Data Engineer Senior Consultant

    2 days ago

    Bengaluru, Karnataka, India NTT DATA Full time ₹ 1,20,000 - ₹ 3,00,000 per year

    Req ID: 341131NTT DATA strives to hire exceptional, innovative and passionate individuals who want to grow with us. If you want to be part of an inclusive, adaptable, and forward-thinking organization, apply now. We are currently seeking a Data Engineer Senior Consultant to join our team in Bangalore, Karnātaka (IN-KA), India (IN). Location: | Experience:...

  • Senior, Data Engineer

    2 weeks ago

    Bengaluru, Karnataka, India NTT DATA Full time ₹ 10,00,000 - ₹ 25,00,000 per year

    Make an impact with NTT DATAJoin a company that is pushing the boundaries of what is possible. We are renowned for our technical excellence and leading innovations, and for making a difference to our clients and society. Our workplace embraces diversity and inclusion – it's a place where you can grow, belong and thrive.Your day at NTT DATAThe Manager,...

  • Senior Data Scientist

    7 days ago

    Bengaluru, Karnataka, India Enable Data Incorporated Full time ₹ 15,00,000 - ₹ 25,00,000 per year

    Enable Data Incorporated is looking for a talented and experienced Senior Data Scientist to join our innovative team. In this role, you will be responsible for driving data science initiatives, developing predictive models, and providing insights that guide key business decisions. The ideal candidate has a strong background in statistical analysis, machine...

  • Senior Data Scientist

    3 days ago

    Bengaluru, Karnataka, India Enable Data Incorporated Full time ₹ 20,00,000 - ₹ 25,00,000 per year

    Enable Data Incorporated is looking for a talented and experienced Senior Data Scientist to join our innovative team. In this role, you will be responsible for driving data science initiatives, developing predictive models, and providing insights that guide key business decisions. The ideal candidate has a strong background in statistical analysis, machine...

  • Senior Data Scientist

    2 weeks ago

    Bengaluru, Karnataka, India Anicca Data Science Solutions Full time ₹ 1,20,000 - ₹ 3,60,000 per year

    Job Description – Senior Data ScientistLocation:Bengaluru (Full-time, Onsite)About Anicca DataAnicca Data is a leading team of Data Science and Technology experts specializing in:Personalization, Recommendation Engines, and Product Search RankingLoyalty Programs and Customer AnalyticsSupply Chain Optimization (Demand Forecasting, Inventory, Replenishment &...

  • Data Engineer

    3 days ago

    Bengaluru, Karnataka, India NTT DATA Full time ₹ 15,00,000 - ₹ 25,00,000 per year

    Design and implement tailored data solutions to meet customer needs and use cases, spanning from streaming to data lakes, analytics, and beyond within a dynamically evolving technical stack. Provide thought leadership by recommending the most appropriate technologies and solutions for a given use case, covering the entire spectrum from the application layer...

  • Data Engineer

    2 weeks ago

    Bengaluru, Karnataka, India Data Analytics Full time ₹ 15,00,000 - ₹ 25,00,000 per year

    Get to Know the Team Grab has been expanding into multiple lines of businesses. The Grab Data Warehouse team builds business intelligence systems using data from all business lines to provide insights to key stakeholders across the company. Get to Know the Role We are looking for a Lead Data Engineer to lead the design and enhancement of our data...