Data Engineering Specialist

8 hours ago

Dombivli, Maharashtra, India beBeeCloud Full time ₹ 1,50,00,000 - ₹ 2,50,00,000
Job Description

We are seeking a skilled Data Engineering Specialist to support our data engineering platform powered by Databricks. This role combines DevOps practices, system reliability, and security auditing to ensure our data infrastructure is robust, secure, and scalable.

Key Responsibilities:
  • Maintain and monitor Databricks-based data pipelines and Azure services such as the data lake, Synapse, and Key Vault.
  • Implement continuous integration/continuous deployment (CI/CD) pipelines using Azure DevOps for data engineering workflows.
  • Conduct regular system health checks and performance tuning of clusters and jobs.
  • Automate infrastructure provisioning using tools like Terraform or ARM templates.
  • Utilize monitoring tools such as Azure Monitor, Log Analytics, and Prometheus to track system metrics and alert on anomalies.
  • Perform security audits using tools like Databricks Security Analysis Tool (SAT) to ensure compliance with best practices.
  • Manage secrets and credentials securely using Azure Key Vault and Databricks secret scopes.
  • Collaborate with security teams to enforce network security, access control, and data encryption policies.
Qualifications:
  • Bachelor's degree in computer science, engineering, or a related field.
  • Five or more years of experience in DevOps, cloud operations, or data platform support.
  • Proficiency in Azure services, Databricks, and scripting languages such as Python and Bash.
  • Experience with CI/CD tools like Azure DevOps and GitHub Actions, as well as infrastructure-as-code.
  • Familiarity with security frameworks and auditing tools in cloud environments.
  • Strong troubleshooting skills and a proactive approach to system reliability.

  • Data Engineer

    2 days ago

    Dombivli, Maharashtra, India beBeeData Full time ₹ 1,50,00,000 - ₹ 2,00,00,000

    Job Title: Data Engineer - Databricks SpecialistWe are seeking an experienced Data Engineer to join our team as a Databricks Specialist. As a key member of our data engineering group, you will play a critical role in designing, developing, and maintaining scalable, high-performance data solutions on Databricks.

  • Data Engineering Specialist

    5 days ago

    Dombivli, Maharashtra, India beBeeDataEngineering Full time ₹ 15,00,000 - ₹ 25,00,000

    Job Title: Data Engineering Specialist">We are seeking an experienced professional to join our analytics division as a Data Engineering Specialist. In this role, you will play a key part in shaping our data strategy and contributing to the design, development, and maintenance of robust data pipelines and ETL processes.">The ideal candidate will have a strong...

  • Data Engineer Specialist

    6 days ago

    Dombivli, Maharashtra, India beBeeDataEngineering Full time ₹ 18,00,000 - ₹ 24,00,000

    **Job Title:** Data Engineer SpecialistWe are seeking a highly skilled data engineer to join our data engineering team.Key Responsibilities:Data Pipelines and Distributed Systems:Design, develop, and optimize large-scale data pipelines using Scala, Spark (PySpark), and Python.Develop and integrate streaming solutions using Apache Kafka and orchestration...

  • Highly Skilled Data Engineering Specialist

    6 hours ago

    Dombivli, Maharashtra, India beBeeDataEngineering Full time ₹ 20,00,000 - ₹ 25,00,000

    About the RoleWe are seeking a highly skilled Data Engineering Specialist to lead our data team. As a Data Engineering Specialist, you will be responsible for designing and developing scalable data pipelines using Spark, Snowflake, and Azure technologies.Main ResponsibilitiesDesigning efficient and scalable data architectures using Spark and...

  • Data Engineering Specialist

    4 days ago

    Dombivli, Maharashtra, India beBeeDataEngineering Full time ₹ 1,52,50,000 - ₹ 2,02,50,000

    About Position: Data Engineering SpecialistWe are seeking a highly skilled and experienced Data Engineer who can bring deep expertise in cloud-based data engineering, healthcare data modeling, and consulting. The ideal candidate will have a strong background in Azure, Databricks, Azure Data Factory (ADF), Kafka, and Snowflake.Job Responsibilities:Design,...

  • Big Data Engineering Specialist

    2 days ago

    Dombivli, Maharashtra, India beBeeBigDataEngineer Full time ₹ 20,00,000 - ₹ 30,00,000

    Big Data Engineering SpecialistWe are seeking a seasoned professional to lead our big data engineering efforts, leveraging expertise in cloud-based architectures and scalable data pipelines.Drive the design and implementation of high-performance data processing systems using Spark, ensuring optimal cost and performance balance.Analyze existing data...

  • Senior Data Specialist Position

    1 week ago

    Dombivli, Maharashtra, India beBeeData Full time ₹ 9,00,000 - ₹ 12,00,000

    Senior Data Specialist  We are looking for an experienced Senior Data Specialist to join our team. The successful candidate will be responsible for designing, building and optimizing data pipelines and ETL workflows.  Key Responsibilities include:Designing, building and optimizing data pipelines and ETL workflowsManaging and processing large datasets...

  • Data Ingestion Specialist

    2 weeks ago

    Dombivli, Maharashtra, India beBeeIngestion Full time ₹ 20,00,000 - ₹ 25,00,000

    Data Ingestion Engineer Job DescriptionWe are seeking a highly skilled Data Ingestion Specialist to join our team. The successful candidate will have expertise in data ingestion processes and pipelines, with a strong understanding of how to integrate multiple sources into Databricks.The ideal candidate will design, develop, and optimize data ingestion...

  • Data Analytics Specialist

    6 days ago

    Dombivli, Maharashtra, India beBeeDataAnalysis Full time ₹ 1,50,00,000 - ₹ 2,00,00,000

    Job Title: Data Analytics SpecialistThis is a remote contract position that requires expertise in data analytics platforms, particularly SAP HANA and Snowflake. As a Data Analytics Specialist, you will play a critical part in the migration of enterprise data solutions from HANA to Snowflake, ensuring business continuity, data integrity, and performance...

  • Data Integration Specialist

    2 days ago

    Dombivli, Maharashtra, India beBeeDataIntegration Full time ₹ 15,00,000 - ₹ 20,10,000

    Job Title: Data Integration SpecialistOur organization seeks a highly skilled Data Integration Specialist to join its team. The ideal candidate will have expertise in designing, developing, and optimizing data ingestion pipelines for integrating multiple sources into Databricks.Key Responsibilities:Design, develop, and optimize data ingestion pipelines for...