Senior Data Engineer

2 days ago

Bengaluru, Karnataka, India beBeeData Full time ₹ 1,50,00,000 - ₹ 2,00,00,000
Job Opportunity: Senior Data Engineer

We are seeking a seasoned data engineer with expertise in migrating and building large-scale data pipelines on Databricks using Azure or AWS platforms. The successful candidate will focus on implementing batch and streaming pipelines, applying the bronze-silver-gold data lakehouse model, and ensuring scalable and reliable data solutions.

Key Responsibilities:

  • Design, develop, and operationalize scalable data pipelines on Databricks following medallion architecture principles.
  • Migrate and transform large data volumes from traditional on-prem systems (Oracle, Hadoop, Exadata) into cloud data platforms.
  • Develop efficient Spark (PySpark/Scala) jobs for ingestion, transformation, aggregation, and publishing of data.
  • Implement data quality checks, error handling, retries, and data validation frameworks.
  • Build automation scripts and CI/CD pipelines for Databricks workflows and deployment.
  • Tune Spark jobs and optimize cost and performance in cloud environments.

Required Skills and Qualifications:

  • 6+ years of hands-on experience as a senior data engineer, with 2+ years specifically working on Databricks in Azure or AWS.
  • Proficiency in building and optimizing Spark pipelines (batch and streaming).
  • Strong experience implementing bronze/silver/gold data models.
  • Working knowledge of cloud storage systems (ADLS, S3) and compute services.
  • Experience migrating data from RDBMS (Oracle, SQL Server) or Hadoop ecosystems.
  • Familiarity with Airflow, Azure Data Factory, or AWS Glue for orchestration.
  • Good scripting skills (Python, Scala, SQL) and version control (Git).

Benefits of Success:

  • A strong analytical and problem-solving mindset.
  • An attention to scalability, resilience, and cost efficiency.
  • A collaborative attitude and passion for clean, maintainable code.

Databricks Experience Preferred:

  • Databricks Certified Data Engineer Associate or Professional.
  • Experience with Delta Live Tables (DLT) and Databricks SQL.
  • Understanding of cloud security best practices (IAM roles, encryption, ACLs).

  • Senior Associate Data Engineer

    17 hours ago

    Bengaluru, Karnataka, India NTT DATA, Inc. Full time

    Job DescriptionMake an impact with NTT DATAJoin a company that is pushing the boundaries of what is possible. We are renowned for our technical excellence and leading innovations, and for making a difference to our clients and society. Our workplace embraces diversity and inclusion its a place where you can grow, belong and thrive.Your day at NTT DATAThe...

  • Senior Data Engineer

    2 days ago

    Bengaluru, Karnataka, India beBeeData Full time ₹ 37,50,000 - ₹ 45,00,000

    Job Opportunity: Senior Data Engineer">We are seeking a highly experienced and skilled Senior Data Engineer to contribute to the design, development, and deployment of large-scale data systems.">This role involves designing, developing, and deploying large-scale data systems that support our business needs. A high degree of technical expertise is required to...

  • Senior Data Engineer

    3 hours ago

    Bengaluru, Karnataka, India beBeeDataEngineer Full time ₹ 1,80,00,000 - ₹ 2,40,00,000

    Senior Data Engineer - MumbaiThe role of Senior Data Engineer is an exciting opportunity for a seasoned professional to drive the development and implementation of our data pipelines, leveraging their expertise in PySpark and Spark APIs.This position requires a strong background in data engineering, with experience in designing, developing, and maintaining...

  • Senior Quality Engineer

    2 weeks ago

    Bengaluru, Karnataka, India NTT Data Full time

    Job DescriptionReq ID:332649NTT DATA strives to hire exceptional, innovative and passionate individuals who want to grow with us. If you want to be part of an inclusive, adaptable, and forward-thinking organization, apply now.We are currently seeking a Senior Quality Engineer - Remote to join our team in Bangalore, Karntaka (IN-KA), India (IN).Senior Quality...

  • Senior Data Engineer

    2 days ago

    Bengaluru, Karnataka, India beBeeDataEngineering Full time ₹ 15,00,000 - ₹ 20,00,000

    Senior Data Engineer PositionWe are seeking an experienced Senior Data Engineer to join our team. The ideal candidate will have a strong background in data engineering, with expertise in designing and implementing large-scale data systems.The Senior Data Engineer will be responsible for owning end-to-end delivery of large features and systems, defining...

  • Senior Data Engineer

    3 weeks ago

    Bengaluru, Karnataka, India One Click AI Full time

    Senior Data EngineerJob Description : Senior Data EngineerCompany : Think Right Type : : Type : HybridSenior Data Engineer at Think Right Technologies will be responsible for building and deploying scalable data driven solutions. Data Engineers are responsible for working with both SQL and NoSQL technologies and collaborating with other product...

  • Senior Data Engineer

    3 weeks ago

    Bengaluru, Karnataka, India UNP Consultancy & Training PVT. LTD. Full time

    Senior Data EngineerJob Title: Senior Data EngineerLocation: Bengaluru Job Type: Full-Time Experience Required: 5–10 Years Department: Data Engineering / AnalyticsAbout the Role:We are seeking a highly skilled and experienced Senior Data Engineer to lead the design, development, and maintenance of scalable and resilient data infrastructure and pipelines...

  • Senior Data Engineer

    2 weeks ago

    Bengaluru, Karnataka, India UNP Consultancy & Training PVT. LTD. Full time

    Senior Data Engineer Job Title: Senior Data Engineer Location: Bengaluru Job Type: Full-Time Experience Required: 5–10 Years Department: Data Engineering / Analytics About the Role: We are seeking a highly skilled and experienced Senior Data Engineer to lead the design, development, and maintenance of scalable and resilient data infrastructure...

  • Senior Software Engineer

    1 day ago

    Bengaluru, Karnataka, India beBeeSoftware Full time ₹ 1,00,00,000 - ₹ 1,50,00,000

    Senior Software Engineer - Data Engineering\

  • Senior Cloud Engineer

    2 weeks ago

    Bengaluru, Karnataka, India NTT Data Full time

    Job DescriptionNTT DATA strives to hire exceptional, innovative and passionate individuals who want to grow with us. If you want to be part of an inclusive, adaptable, and forward-thinking organization, apply now.We are currently seeking a Senior Cloud Engineer to join our team in Bangalore, Karntaka (IN-KA), India (IN).Request you to share these Screening...