Databricks Engineer

3 weeks ago

Gandhinagar, Gujarat, India DataE2E Technologies Full time

Key Responsibilities

  • Design, develop, and maintain data pipelines and ETL processes on Databricks.
  • Lead the architecture and implementation of scalable, secure, and high-performance data solutions.
  • Collaborate with business stakeholders, data scientists, and analysts to gather requirements and deliver actionable data solutions.
  • Optimize data workflows for performance, cost-efficiency, and reliability.
  • Integrate data from multiple structured and unstructured sources into Delta Lake and cloud data warehouses.
  • Implement best practices in data governance, security, and quality management.
  • Mentor junior engineers and provide technical leadership in data engineering best practices.
  • Troubleshoot and resolve issues in data pipelines, ensuring high data availability and integrity.

Required Skills & Experience

  • 7+ years of experience in Data Engineering.
  • Proven Subject Matter Expertise in Databricks (including Databricks SQL, Delta Lake, and MLflow).
  • Strong experience with PySpark, Spark SQL, and Scala.
  • Hands-on experience with cloud platforms (Azure preferred; AWS/GCP a plus).
  • Proficiency in data modeling, ETL development, and data warehousing concepts.
  • Solid understanding of big data ecosystems (Hadoop, Kafka, etc.).
  • Strong SQL development skills with a focus on performance tuning.
  • Experience in implementing CI/CD pipelines for data solutions.

  • Senior Azure Databricks Specialist

    4 days ago

    Gandhinagar, Gujarat, India beBeeData Full time ₹ 20,00,000 - ₹ 30,00,000

    Azure Databricks Engineer JobWe are seeking an experienced Azure Databricks specialist to join our team for a short-term contract role.

  • Large Scale Data Engineering Specialist

    18 hours ago

    Gandhinagar, Gujarat, India beBeeData Full time ₹ 40,00,000 - ₹ 50,00,000

    We are seeking an experienced Data Engineer to join our team.The successful candidate will be responsible for designing, constructing and optimizing large-scale data processing systems that enable advanced analytics and business intelligence.You will collaborate closely with data scientists, analysts and other engineers to ensure the availability,...

  • Lead Cloud Data Specialist

    18 hours ago

    Gandhinagar, Gujarat, India beBeeDataEngineering Full time ₹ 1,80,00,000 - ₹ 2,50,00,000

    We are seeking a Lead Azure Data Engineer to join our team.This role requires a highly motivated and experienced individual with deep hands-on expertise in Azure and Databricks.The ideal candidate will have strong technical skills, excellent communication abilities, and the ability to work in a fast-paced environment.Key ResponsibilitiesDesign, develop, and...

  • Senior Cloud Pipeline Specialist

    1 day ago

    Gandhinagar, Gujarat, India beBeeAzureEngineer Full time ₹ 2,00,00,000 - ₹ 2,50,00,000

    Job Title:Azure Databricks Engineer Description: We are seeking a seasoned professional to fill the role of Azure Databrick Engineer. The ideal candidate will have at least 7 years of experience in creating, modifying and optimizing Azure Data Factory pipelines. This is a contract position lasting approximately 3-4 months. Key Responsibilities:...

  • Chief Data Strategist

    21 hours ago

    Gandhinagar, Gujarat, India beBeeData Full time ₹ 1,20,00,000 - ₹ 2,00,00,000

    As a data architect, you will be responsible for reimagining scalable data platforms and AI solutions.We are looking for an expert who can help our clients build, optimize, and enablement their data to harness its full potential.The successful candidate will design and implement efficient Databricks solutions, develop data pipelines, architect data lakes,...

  • Chief Data Architect – Data Infrastructure

    21 hours ago

    Gandhinagar, Gujarat, India beBeeEngineering Full time ₹ 1,50,00,000 - ₹ 2,50,00,000

    Lead Big Data Engineering TeamWe are seeking an experienced Engineering Manager to spearhead a team of talented data engineers in designing and delivering scalable data pipelines and analytics platforms using Big Data platforms, Microsoft Azure, and Databricks.Key Responsibilities:Oversee the development and implementation of end-to-end data solutions using...

  • Chief Data Architect

    18 hours ago

    Gandhinagar, Gujarat, India beBeeDataEngineer Full time ₹ 1,20,00,000 - ₹ 2,00,00,000

    Job Description:We are seeking a highly skilled Data Engineer to join our team. The successful candidate will be responsible for designing, developing, and maintaining large-scale data systems using Azure Databricks.Key Responsibilities:Design and develop data pipelines using Databricks Delta LakeWork with cross-functional teams to integrate data solutions...

  • Cloud Data Architect

    1 day ago

    Gandhinagar, Gujarat, India beBeeData Full time ₹ 18,00,000 - ₹ 24,00,000

    Transformative SolutionsWe are crafting a world-class cloud data platform using cutting-edge technologies. As a Cloud Data Architect, you will spearhead the design and development of our data infrastructure, making it scalable, reliable, and cost-efficient.Key Responsibilities:Analyze existing data warehouse implementations to inform migration and...

  • Intelligent Systems Developer

    18 hours ago

    Gandhinagar, Gujarat, India beBeeMachineLearning Full time ₹ 1,80,00,000 - ₹ 2,50,00,000

    Machine Learning Engineer PositionWe are seeking an experienced Machine Learning Engineer to join our team of consultants. In this role, you will be responsible for designing, developing, and deploying machine learning models and algorithms to solve complex business challenges with Databricks.Key Responsibilities:Design and implement machine learning models...

  • Data Ingestion Specialist

    4 days ago

    Gandhinagar, Gujarat, India beBeeIngestion Full time ₹ 20,00,000 - ₹ 25,00,000

    We are seeking a highly skilled Data Ingestion Specialist to join our team.This role requires a strong understanding of data ingestion processes, focusing on integrating various data sources into Databricks.The ideal candidate will have hands-on experience with data pipelines, automation, and infrastructure management to support scalable and efficient...