Data Engineering Expert

3 days ago

Hubli, Karnataka, India beBeeEngineering Full time ₹ 18,00,000 - ₹ 21,00,000
About the Role

We are seeking a highly skilled data engineer to design, build, and optimize scalable data pipelines and lakehouse architectures.

As a senior data engineer, you will work closely with cross-functional teams to provide thought leadership, deliver robust, secure, and high-performance data solutions that empower analytics and data science initiatives.

Key Responsibilities
  • Design, develop, and maintain scalable data pipelines using Azure Data Factory and Azure Synapse Analytics.
  • Build and optimize lakehouse architectures on Azure using Delta Lake.
  • Work closely with stakeholders to understand their requirements and provide technical guidance.
  • Implement data ingestion, transformation, and orchestration workflows from diverse sources (APIs, databases, cloud storage).
  • Ensure data quality, consistency, and security across the data lifecycle.
  • Leverage Azure services such as Data Lake Storage Gen2, Event Hubs, Azure Functions, and Key Vault.
  • Implement Infrastructure as Code (IaC) using Terraform or Bicep for automated provisioning and configuration.
  • Optimize cloud resource usage for performance and cost-efficiency.
  • Design and implement star schema and other data modeling techniques to support analytical workloads.
  • Collaborate with analysts and data scientists to deliver advanced analytics solutions.
  • Conduct data quality assessments and contribute to data governance initiatives.
Required Technical Skills
  • Expert-level experience with Azure Data Services: Azure Data Factory, Azure Databricks, Azure Synapse, Azure Data Lake Storage.
  • Strong proficiency in SQL for complex transformations and performance tuning.
  • Advanced Python skills for data pipeline development and orchestration.
  • Experience with Terraform or similar IaC tools for Azure.
  • Familiarity with CI/CD pipelines and DevOps practices.
  • Experience with containerization (Docker, Kubernetes) is a plus.
  • Strong understanding of data governance, security (RBAC, VNETs, Managed Identities), and compliance in Azure.
  • Experience with batch and streaming data processing using tools like Structured Streaming or Event Hubs.
Preferred Qualifications
  • Microsoft Certified: Azure Data Engineer Associate or equivalent.
  • Experience with Delta Live Tables, Unity Catalog, or MLflow is a plus.

  • Key Data Engineering Expert

    7 days ago

    Hubli, Karnataka, India beBeeDataEngineering Full time ₹ 20,00,000 - ₹ 25,00,000

    Our organization is seeking a highly skilled and experienced Data Engineering expert to assume key responsibilities.The ideal candidate will have:4+ years of hands-on experience with Big Data technologies – including Spark, Hadoop, and Hive;Strong analytical and problem-solving skills, with the ability to think critically;Excellent communication and...

  • Lead Data Engineering Expert

    2 weeks ago

    Hubli, Karnataka, India beBeeDataEngineering Full time ₹ 20,00,000 - ₹ 25,00,000

    Job Title: Lead Data Engineering ExpertWe are seeking a seasoned Data Engineer(Lead) to join our team and spearhead the design, development, and optimization of complex data pipelines using Apache Spark, AWS Glue, and Azure Data Factory.This role requires 6+ years of experience in data engineering or cloud computing data development. The ideal candidate will...

  • Senior Expert in Data Engineering

    5 days ago

    Hubli, Karnataka, India beBeeDeveloper Full time ₹ 1,50,00,000 - ₹ 2,50,00,000

    Big Data DeveloperWe are seeking a skilled expert to join our team, with a dual focus on hands-on project support and mentoring junior engineers.This role is ideal for a developer who not only thrives in a technical, fast-paced environment but is also passionate about coaching and developing the next generation of talent.You will work on live client...

  • Expert Data Migration Engineer

    7 days ago

    Hubli, Karnataka, India beBeeDataEngineer Full time ₹ 1,80,00,000 - ₹ 2,00,00,000

    About the RoleJob SummarySeeking a seasoned expert in large-scale data migrations, ETL development, and data validation to drive innovation and enhance business processes. The ideal candidate will have strong expertise in SQL, Python, orchestration frameworks, and performance optimization.Key Responsibilities:Convert complex data workloads into scalable,...

  • Ai Security Engineer

    2 weeks ago

    Hubli, Karnataka, India NTT DATA Full time

    Req ID 338875 NTT DATA strives to hire exceptional innovative and passionate individuals who want to grow with us If you want to be part of an inclusive adaptable and forward-thinking organization apply now We are currently seeking a AI Security Engineer - Shared Security Services Engineering to join our team in Banaglore Karn taka IN-KA India ...

  • Cloud Data Expert

    6 days ago

    Hubli, Karnataka, India beBeeData Full time ₹ 15,00,000 - ₹ 25,00,000

    Cloud Data ExpertA highly skilled professional is required to design, implement and maintain scalable data pipelines using cloud services.Responsibilities:Develop and deploy data models, workflows and visualizations using various tools.Collaborate with cross-functional teams to integrate data engineering capabilities into business applications.Ensure data...

  • Data Engineering Expert

    2 weeks ago

    Hubli, Karnataka, India beBeeEngineering Full time ₹ 2,00,00,000 - ₹ 2,50,00,000

    Software Engineering SpecialistWe are looking for a skilled Software Engineering Specialist to join our team. This role involves developing and optimizing data engineering pipelines using various technologies.This position requires experience with Azure Data Factory (ADF), Databricks, and Synapse Analytics.You will be responsible for designing scalable data...

  • Cloud Data Expert

    2 weeks ago

    Hubli, Karnataka, India beBeeData Full time ₹ 20,00,000 - ₹ 25,00,000

    As a Cloud Data Expert, you will be working on various projects and opportunities involving large-scale data processing systems.The role requires designing, building, and maintaining efficient data pipelines using Azure Data Factory, Azure Database, PySpark, and SQL. You will work closely with cross-functional teams to understand business needs and develop...

  • Data Engineer Specialist

    1 week ago

    Hubli, Karnataka, India beBeeDataEngineering Full time ₹ 10,00,000 - ₹ 25,00,000

    Job Role: Data Engineering ExpertPrimary Responsibilities:Design, develop, and implement data pipelines leveraging Oracle Data Flow or Apache Spark (PySpark)Ensure seamless integration and automation across data services by orchestrating data workflowsCollaborate effectively with cross-functional teams and engage with stakeholders to drive business...

  • Data Engineer

    7 days ago

    Hubli, Karnataka, India beBeeEngineering Full time ₹ 90,00,000 - ₹ 1,50,00,000

    Data Engineering ExpertAs a Data Engineering Expert, you will play a pivotal role in designing and developing large-scale data pipelines that drive business growth through innovative data solutions.Key Responsibilities:Design and implement scalable data architectures using cloud-based technologies like AWS and big data platforms.Collaborate with...