Databricks Engineer

2 weeks ago

Jamnagar, Gujarat, India DataE2E Technologies Full time

Job Title: Databricks Engineer (Remote)

Location: 100 % Remote

Job Type: Full-Time

Shift timings: 3 pm - 11 pm IST

About the Role:

We are looking for an experienced Databricks Engineer with a strong background in data engineering to help build and optimize scalable, high-performance data solutions. The ideal candidate has hands-on experience in Databricks production environments and a deep understanding of modern data architecture. You'll work with cross-functional teams to create robust data pipelines and ensure the reliability, quality, and observability of data across platforms.

Key Responsibilities

  • Design, develop, and maintain data pipelines and ETL processes on Databricks.
  • Lead the architecture and implementation of scalable, secure, and high-performance data solutions.
  • Collaborate with business stakeholders, data scientists, and analysts to gather requirements and deliver actionable data solutions.
  • Optimize data workflows for performance, cost-efficiency, and reliability.
  • Integrate data from multiple structured and unstructured sources into Delta Lake and cloud data warehouses.
  • Implement best practices in data governance, security, and quality management.
  • Mentor junior engineers and provide technical leadership in data engineering best practices.
  • Troubleshoot and resolve issues in data pipelines, ensuring high data availability and integrity.

Required Skills & Experience

  • 6-7 years of experience in Data Engineering.
  • Proven Subject Matter Expertise in Databricks (including Databricks SQL, Delta Lake, and MLflow).
  • Strong experience with PySpark, Spark SQL, and Scala.
  • Hands-on experience with cloud platforms (Azure preferred; AWS/GCP a plus).
  • Proficiency in data modeling, ETL development, and data warehousing concepts.
  • Solid understanding of big data ecosystems (Hadoop, Kafka, etc.).
  • Strong SQL development skills with a focus on performance tuning.
  • Experience in implementing CI/CD pipelines for data solutions.

  • Senior Data Engineer

    2 weeks ago

    Jamnagar, Gujarat, India beBeeData Full time ₹ 1,50,00,000 - ₹ 2,50,00,000

    We're seeking a seasoned data engineer to join our team, with expertise in designing and deploying scalable data pipelines using Databricks.This role involves collaborating with stakeholders to understand data requirements and translating them into technical solutions. You'll be responsible for optimizing Spark jobs, developing and maintaining Databricks...

  • Advanced Cloud Data Engineer

    2 weeks ago

    Jamnagar, Gujarat, India beBeeDataEngineering Full time ₹ 2,00,00,000 - ₹ 2,40,00,000

    Job Title: Data Engineering LeadOverview:We are seeking a visionary and experienced Senior Data Engineering Lead to lead our data engineering team. This leadership role requires a strong focus on Databricks and cloud-based data engineering to design, develop, and manage scalable data infrastructure and pipelines.Main Responsibilities:Lead and manage a team...

  • Lead Data Engineering Expert

    2 weeks ago

    Jamnagar, Gujarat, India beBeeData Full time ₹ 15,00,000 - ₹ 25,00,000

    Senior ETL Developer Job DescriptionWe are seeking a highly experienced Senior ETL Developer to join our team.The ideal candidate will have a strong background in data engineering and experience working with big data technologies.Main Responsibilities:Collaborate with stakeholders to understand data requirements and translate them into technical...

  • Highly skilled Azure Data Engineer wanted

    2 weeks ago

    Jamnagar, Gujarat, India beBeeDataEngineer Full time ₹ 1,50,00,000 - ₹ 2,00,00,000

    We are seeking an experienced Azure Data Engineer to join our team.This role involves working with Azure Databricks, Scala and PySpark, as well as other technologies. The successful candidate will have a strong background in software development life cycles, Azure cloud platform, and DevOps practices.Design, develop and maintain scalable data engineering...

  • Data Architect

    2 weeks ago

    Jamnagar, Gujarat, India beBeeDatabricksEngineer Full time ₹ 20,00,000 - ₹ 25,00,000

    We're seeking an accomplished Databricks Engineer to spearhead the development of high-performance data solutions.About this Opportunity:This role entails designing, building, and refining scalable data pipelines and ETL processes on Databricks.Lead the creation and maintenance of data architectures that drive business growth and innovation.Collaborate with...

  • Advanced Data Architect

    2 weeks ago

    Jamnagar, Gujarat, India beBeeDataEngineer Full time ₹ 1,80,00,000 - ₹ 2,40,00,000

    Azure Data Engineer RoleAs a highly skilled Azure Data Engineer, you will be responsible for designing and optimizing modern data platforms.Key Responsibilities:Lead the development of Databricks architecture, ensuring scalability and efficiency.Design and implement ETL/ELT pipelines using Python (PySpark) to optimize data processing and analysis.Set up and...

  • Senior Big Data Specialist

    1 week ago

    Jamnagar, Gujarat, India beBeeDataEngineering Full time ₹ 1,50,00,000 - ₹ 2,50,00,000

    **Data Engineering Opportunity**We are seeking an experienced Data Engineer to join our team.Design, implement, and manage CI/CD pipelines using GitHub Actions or equivalent tools.Configure and maintain GitHub branch protection rules and workflows to ensure smooth code integration and deployment.Build, optimize, and debug Spark jobs in Databricks for...

  • Career Opportunities for Data Engineers

    2 weeks ago

    Jamnagar, Gujarat, India beBeeDataEngineering Full time ₹ 20,00,000 - ₹ 25,00,000

    Data Engineering Role OpportunityWe are seeking experienced data engineers to join our team in a challenging environment. The ideal candidate will possess strong technical expertise and a proven track record of building and managing large-scale data solutions.Key Responsibilities:Design, develop, and maintain scalable data engineering systems using...

  • Data Pipeline Specialist

    2 weeks ago

    Jamnagar, Gujarat, India beBeeDataEngineer Full time ₹ 20,00,000 - ₹ 30,00,000

    Job Description">We seek a seasoned Data Engineer to optimize our data infrastructure and deliver robust data pipelines.Key Responsibilities:">Design, implement, and maintain Continuous Integration/Continuous Deployment (CI/CD) pipelines using GitHub Actions or equivalent tools.Configure and maintain GitHub branch protection rules and workflows to ensure...

  • Chief Data Engineering Specialist

    2 weeks ago

    Jamnagar, Gujarat, India beBeeDataEngineer Full time ₹ 1,80,00,000 - ₹ 2,50,00,000

    Senior Data EngineerWe are seeking an experienced Senior Data Engineer to play a key role in designing, developing, and managing data pipelines and transformation frameworks that enable analytics, reporting, and business intelligence capabilities across the enterprise.The ideal candidate will collaborate with data architects, platform engineers, and DevOps...