Databricks Engineering Specialist

5 days ago

Alwar, Rajasthan, India beBeeData Full time ₹ 90,00,000 - ₹ 1,20,00,000

Azure Databricks Engineer Role

We are seeking an Ingestion Engineer with expertise in CI/CD and Kubernetes to fill a critical position within our organization.

  • Develop and optimize data ingestion pipelines for integrating multiple sources into Databricks, ensuring seamless data flow and efficient processing.
  • Implement and maintain CI/CD pipelines for data workflows, guaranteeing high-quality and on-time delivery of data-driven insights.
  • Deploy and manage containerized applications using Kubernetes, maximizing scalability and flexibility in a cloud-based environment.
  • Prioritize data integrity, security, and compliance throughout the ingestion process, mitigating potential risks and ensuring regulatory adherence.
  • Collaborate with Data Engineers and other stakeholders to streamline data ingestion strategies, fostering cross-functional teamwork and knowledge sharing.
  • Troubleshoot and optimize ingestion pipelines for performance and scalability, leveraging technical expertise and innovative problem-solving skills.

Required Skills & Qualifications:

  • Proven experience in data ingestion and pipeline development, demonstrating mastery of complex data architectures and technologies.
  • Hands-on experience with CI/CD tools (GitHub Actions, Jenkins, Azure DevOps, etc.), ensuring seamless integration and automation of data workflows.
  • Strong knowledge of Kubernetes and container orchestration, driving efficiency and scalability in cloud-based environments.
  • Experience with Databricks, Spark, and data lake architectures, showcasing proficiency in big data processing and analytics.
  • Proficiency in Python, Scala, or SQL for data processing, leveraging programming skills to drive data-driven decision making.
  • Familiarity with cloud platforms such as AWS, Azure, or GCP, navigating the complexities of cloud computing and infrastructure management.

  • Databricks Cloud Engineering Specialist

    4 days ago

    Alwar, Rajasthan, India beBeeDataEngineer Full time ₹ 1,50,00,000 - ₹ 2,50,00,000

    Senior Databricks Data EngineerWe are seeking a highly skilled Senior Databricks Data Engineer with strong hands-on experience in Databricks and AWS to join our dynamic data engineering team.Key Responsibilities:Design, develop, and maintain scalable and high-performance data pipelines using Databricks and PySpark.Implement and manage data solutions on AWS,...

  • Chief Data Engineering Strategist

    5 days ago

    Alwar, Rajasthan, India beBeeData Full time ₹ 1,50,00,000 - ₹ 2,00,00,000

    Unlock Data Potential with a Leading Consulting FirmThe role of Data Architect is pivotal in designing and implementing efficient Databricks solutions, developing data pipelines, architecting data lakes, and implementing data warehousing solutions using Databricks.As a Data Architect, you will collaborate with data scientists and analysts to develop and...

  • Senior Data Engineer Specialist

    3 days ago

    Alwar, Rajasthan, India beBeeData Full time ₹ 1,75,00,000 - ₹ 2,25,00,000

    Job Opportunity: Data Solutions ArchitectWe are seeking a highly skilled Data Solutions Architect to design, develop, and maintain efficient data pipelines that extract, transform, and load data from various sources into data lake and data warehouse.Main Responsibilities:We are looking for a professional who will be instrumental in:Designing and Developing...

  • Data Architecture Specialist

    4 days ago

    Alwar, Rajasthan, India beBeeData Full time ₹ 60,00,000 - ₹ 1,20,00,000

    Job Title: Data Architecture SpecialistWe are seeking a highly skilled professional with 4+ years of experience in designing, building, and optimizing large-scale data processing workflows. The ideal candidate will have hands-on experience working with Azure Cloud technologies, including Azure Data Lake, Azure Data Factory, Azure Databricks, and Azure SQL...

  • AI Workflow Specialist

    22 hours ago

    Alwar, Rajasthan, India beBeeArtificialIntelligence Full time ₹ 1,50,00,000 - ₹ 2,00,00,000

    Job Description:As a seasoned AI Engineer, you will play a pivotal role in designing and implementing cutting-edge artificial intelligence solutions for compliance-heavy business processes. Your expertise in developing automated workflows on Databricks and Azure will be instrumental in transforming our organization's operations.About the Role:Design and...

  • Data Ingestion Specialist

    19 hours ago

    Alwar, Rajasthan, India beBeeIngestion Full time ₹ 12,00,000 - ₹ 20,00,000

    Job Title: Data Ingestion SpecialistAbout the Role:We are seeking an experienced Data Ingestion Specialist to join our team. The ideal candidate will have hands-on experience with data pipelines, automation, and infrastructure management to support scalable and efficient ingestion workflows.Main Responsibilities:Data Ingestion Pipelines: Design, develop, and...

  • Advanced Data Ingestion Professional

    1 week ago

    Alwar, Rajasthan, India beBeeDataIngestion Full time ₹ 9,00,000 - ₹ 18,00,000

    Job Title: Data Ingestion SpecialistThis is an exciting opportunity to design, develop, and optimize data ingestion pipelines for integrating multiple sources into Databricks.Key Responsibilities:Design and develop data ingestion pipelines to integrate various data sources into Databricks.Implement and maintain Continuous Integration/Continuous Deployment...

  • Senior Data Engineer

    1 week ago

    Alwar, Rajasthan, India beBeeData Full time ₹ 1,50,00,000 - ₹ 2,50,00,000

    Large Scale Data Engineering SolutionsJob Description:The successful candidate will have the opportunity to work with clients to design, develop, and maintain large scale data engineering solutions.Responsibilities:Design, develop, and maintain large scale data engineering solutionsWork closely with client stakeholders to capture requirements, design, and...

  • Lead Data Governance Specialist

    4 days ago

    Alwar, Rajasthan, India beBeeDataEngineer Full time ₹ 10,00,000 - ₹ 17,50,000

    Job OverviewAzure Data Engineer – Data Governance & PipelinesWe are seeking an experienced Data Engineer to develop, optimize and maintain automated data pipelines supporting data governance and analytics initiatives. The successful candidate will have strong expertise in designing, building and deploying robust ETL/ELT pipelines in Databricks (PySpark,...

  • Transformative Data Engineering Leader

    3 days ago

    Alwar, Rajasthan, India beBeeDataEngineer Full time ₹ 18,00,000 - ₹ 25,00,000

    Key ResponsibilitiesWe are seeking a highly skilled Data Engineer with 4–7 years of experience to build and optimize scalable ETL/ELT pipelines using Azure Databricks, PySpark, and Delta Lake.The role involves working across teams to develop data solutions, ensure data governance with Unity Catalog, and support real-time and batch processing. Strong...