Senior Data Engineer

12 hours ago

Bangalore Urban Karnataka India, IN USEReady Full time

Job Title: Senior Databricks Engineer

Experience Level: 5-8 Years

Job Summary

As a Senior Databricks Engineer, you will be responsible for designing, developing, and optimizing our data architecture and pipelines on the Databricks Lakehouse Platform. You will leverage your deep expertise in Spark, Delta Lake, and cloud technologies to build scalable and reliable solutions that process large-scale data efficiently. The ideal candidate is a proactive problem-solver with a strong background in data engineering and a passion for mentoring and driving technical excellence.

Key Responsibilities

  • Architect and Develop: Design, build, and maintain robust and scalable data pipelines and ETL/ELT processes using Databricks, Apache Spark, and Python/Scala.
  • Lakehouse Implementation: Architect and implement solutions on the Databricks Lakehouse Platform, including data modeling, ingestion, storage, and processing using Delta Lake.
  • Performance Optimization: Analyze and tune the performance of Spark jobs and Databricks clusters to ensure high efficiency, reliability, and cost-effectiveness.
  • Data Governance: Implement and manage data governance, data quality, and security best practices within Databricks, utilizing features like Unity Catalog.
  • Collaboration: Work closely with data scientists, analysts, and business stakeholders to understand their data requirements and deliver high-quality, end-to-end data solutions.
  • Automation & CI/CD: Develop and maintain CI/CD pipelines for automated testing and deployment of data workflows (e.g., using Azure DevOps, Jenkins, GitHub Actions).
  • Mentorship: Mentor junior engineers, conduct code reviews, and champion best practices in data engineering and software development.
  • Innovation: Stay current with the latest advancements in the Databricks platform and the broader big data ecosystem, and drive the adoption of new tools and technologies.


Required Qualifications and Skills

  • Experience: 5-8 years of professional experience in a data engineering role.
  • Databricks Expertise: Proven hands-on experience architecting and building solutions on the Databricks platform.
  • Core Technical Skills:
  • Strong proficiency in Python or Scala.
  • Expert-level knowledge of Apache Spark, including Spark SQL and DataFrame APIs.
  • In-depth understanding and practical experience with Delta Lake.
  • Advanced SQL skills and experience with data warehousing concepts.
  • Cloud Proficiency: Solid experience with at least one major cloud platform (Azure, AWS, or GCP), including their data storage and processing services (e.g., Azure Data Lake Storage, AWS S3, Google Cloud Storage).
  • ETL/ELT: Demonstrable experience in designing and implementing complex ETL/ELT pipelines.
  • Problem-Solving: Excellent analytical and problem-solving abilities with a keen attention to detail.
  • Communication: Strong verbal and written communication skills, with the ability to explain complex technical concepts to non-technical stakeholders.
  • Data Visualization: Experience supporting data visualization tools like Power BI or Tableau

  • Senior Principal Data Engineer

    12 hours ago

    Bangalore Urban, Karnataka, India, IN MakeMyTrip Full time

    Position: Senior Principal Data EngineerExperience: Must have 10+ years of experienceAbout Role:We are looking for experienced Data engineers with excellent problem-solving skills to develop machine-learning powered Data Products design to enhance customer experiences.About us:Nurtured from the seed of a single great idea - to empower the traveler -...

  • Senior Data Analyst

    12 hours ago

    Bangalore Urban, Karnataka, India, IN Relanto Full time

    About the RoleWe are seeking a highly skilled and detail-oriented Senior Data Analyst with strong experience in the finance domain to join our team. In this role, you will work closely with cross-functional teams including GTM, Accounting, Finance, Tax, and Engineering to deliver actionable insights, support financial processes, and drive operational...

  • Data Engineer

    12 hours ago

    india, IN Data-Hat AI Full time

    Department: Data Engineering & AI Solutions Reports To: Lead Data Solutions Architect Travel: International travel required (up to 30–40%) Position Summary: We are hiring a senior-level Data Engineer to lead the design, development, and optimization of high-performance data infrastructure that underpins mission-critical AI systems. With 12+ years of...

  • Data Engineer

    12 hours ago

    Bangalore Urban, Karnataka, India, IN Synechron Full time

    Good-day,We have immediate opportunity for Data Engineer (Python, Spark/Scala).Job Role: Data Engineer (Python, Spark/Scala)Job Location: Bangalore Experience-5 to 10 yearsNotice Period: Immediate joiner only.About Company:At Synechron, we believe in the power of digital to transform businesses for the better. Our global consulting firm combines creativity...

  • Data Engineer

    12 hours ago

    Bangalore Urban, Karnataka, India, IN SatSure Full time

    As a Data Engineer specializing in geospatial data, your primary responsibility is to design, build, and maintain data infrastructure and systems that handle geospatial information effectively. You will work closely with cross-functional teams, including data scientists, geospatial analysts, and software engineers, to ensure that geospatial data is...

  • Senior Data Engineer

    12 hours ago

    Bangalore Urban, Karnataka, India, IN Impetus Full time

    Qualifications:4-6 years of good hands-on exposure with Big Data technologies – pySpark (Data frame and SparkSQL), Hadoop, and Hive Good hands-on experience of python and Bash Scripts Good understanding of SQL and data warehouse concepts Strong analytical, problem-solving, data analysis and research skills Demonstrable ability to think outside of the box...

  • Data Scientist

    12 hours ago

    Bangalore Urban, Karnataka, India, IN Straive Full time

    About the RoleStraive is looking for a talented and driven Consultant / Data Scientist / GenAI Engineer to join our Analytics & GenAI delivery team. In this role, you will work under the guidance of the Senior Project Manager / Engagement Manager to design, develop, and deploy advanced AI/ML and Generative AI solutions for global enterprise clients. You will...

  • Senior Data Scientist – Forecasting

    12 hours ago

    Bangalore Urban, Karnataka, India, IN Happiest Minds Technologies Full time

    Position:Advanced Intelligence: Senior Data Scientist – ForecastingKey Responsibilities:Apply advanced forecasting methodologies to estimate sales and revenue for newly launched and pipeline pharmaceutical products (Demand Forecasting good to have skills).Incorporate financial modelling and corporate finance principles into forecasting frameworks to...

  • Senior Software Engineer

    12 hours ago

    Bangalore Urban, Karnataka, India, IN ConnectWise Full time

    `About the CompanyGeneral Summary: Senior Software Engineering -I is responsible for developing high-quality, innovative, fully performing software in compliance with coding standards. This individual works in partnership with cross-functional teams to ensure that software deliverables, including designs, codes, and tests, are completed in a timely manner,...

  • GCP Data Engineer

    12 hours ago

    Bangalore Urban, Karnataka, India, IN Impetus Full time

    About ImpetusImpetus Technologies is a digital engineering company focused on delivering expert services and products to help enterprises achieve their transformation goals. We solve the analytics, AI, and cloud puzzle, enabling businesses to drive unmatched innovation and growth.Founded in 1991, we are cloud and data engineering leaders providing solutions...