Data Engineer

11 hours ago

Mumbai, Maharashtra, India Arohanam Tech LLP Full time ₹ 15,00,000 - ₹ 25,00,000 per year

Data Engineer - Job Discussion Summary
Data Integration

  • Sources/Targets:
    SQL Server, Azure Data Lake Storage (ADLS), APIs, PostgreSQL.
  • Focus:
    Secure and scalable integration approaches.
  • Security:
    Emphasis on using secure connections and credentials (e.g., Azure Key Vault, managed identities).

Azure Services and Architecture

  • Data Ingestion & Orchestration:
  • Industry best practices discussed for ingestion, transformation, and orchestration.
  • Tools mentioned:
    Azure Data Factory (ADF)
    ,
    Azure Synapse
    ,
    Azure Databricks
    .
  • Azure Databricks Configuration:
  • Cluster sizing and choosing appropriate VM SKUs.
  • Cost optimization via autoscaling and job clusters.

Security & Governance

  • Azure Unity Catalog:
  • Centralized data governance, access control, and cataloging of assets.
  • Security Measures:
  • Role-Based Access Control (RBAC)
  • Azure Key Vault for secrets management
  • Private Endpoints for securing network traffic

Analytics & Reporting

  • Front-End Tools:
    Integration with
    Power BI
    for data consumption.
  • Data Connectivity:
    Best practices for connecting datasets securely and efficiently.

Data Architecture & Quality

  • Data Modeling Concepts:
  • Use of Bronze–Silver–Gold
    layered architecture for data refinement.
  • Data Quality:
    Ensuring validation, monitoring, and consistency across layers.

Development Lifecycle & CI/CD

  • Environment Strategy:
  • Dev/Test/Prod separation for robust lifecycle management.
  • Version Control:
    Integration with
    Git
    for source control.
  • CI/CD Pipelines:
    Automating deployment with tools like
    Azure DevOps
    or
    GitHub Actions
    .

Best Practices Emphasized

  • Cloud-native development
  • Scalable and cost-efficient architecture
  • Secure data handling and governance
  • Automation and DevOps in data engineering workflows

  • Data Engineer

    2 weeks ago

    Mumbai, Maharashtra, India NTT DATA Full time ₹ 15,00,000 - ₹ 25,00,000 per year

    Design and implement tailored data solutions to meet customer needs and use cases, spanning from streaming to data lakes, analytics, and beyond within a dynamically evolving technical stack. Provide thought leadership by recommending the most appropriate technologies and solutions for a given use case, covering the entire spectrum from the application layer...

  • Specialist - Data Center Operations - IBMS IT/OT

    2 weeks ago

    Mumbai, Maharashtra, India NTT DATA Full time ₹ 5,00,000 - ₹ 15,00,000 per year

    Make an impact with NTT DATAJoin a company that is pushing the boundaries of what is possible. We are renowned for our technical excellence and leading innovations, and for making a difference to our clients and society. Our workplace embraces diversity and inclusion – it's a place where you can grow, belong and thrive.Your day at NTT DATAThe role of...

  • Director - Data Center Operations

    1 week ago

    Mumbai, Maharashtra, India NTT DATA Full time ₹ 12,00,000 - ₹ 36,00,000 per year

    Make an impact with NTT DATAJoin a company that is pushing the boundaries of what is possible. We are renowned for our technical excellence and leading innovations, and for making a difference to our clients and society. Our workplace embraces diversity and inclusion – it's a place where you can grow, belong and thrive.Your day at NTT DATAThe Director,...

  • Specialist- Data Center Operations

    5 days ago

    Mumbai, Maharashtra, India NTT DATA, Inc. Full time ₹ 12,00,000 - ₹ 36,00,000 per year

    Make an impact with NTT DATAJoin a company that is pushing the boundaries of what is possible. We are renowned for our technical excellence and leading innovations, and for making a difference to our clients and society. Our workplace embraces diversity and inclusion – it's a place where you can grow, belong and thrive.Your day at NTT DATAThe role of...

  • SOC Engineer

    2 weeks ago

    Mumbai, Maharashtra, India NTT DATA Full time ₹ 5,00,000 - ₹ 12,00,000 per year

    Make an impact with NTT DATAJoin a company that is pushing the boundaries of what is possible. We are renowned for our technical excellence and leading innovations, and for making a difference to our clients and society. Our workplace embraces diversity and inclusion – it's a place where you can grow, belong and thrive.Your day at NTT DATAAs a Security...

  • Managed Service Engineer

    1 week ago

    Mumbai, Maharashtra, India NTT DATA Full time ₹ 5,00,000 - ₹ 12,00,000 per year

    Make an impact with NTT DATAJoin a company that is pushing the boundaries of what is possible. We are renowned for our technical excellence and leading innovations, and for making a difference to our clients and society. Our workplace embraces diversity and inclusion – it's a place where you can grow, belong and thrive.Your day at NTT DATAAs a Cross...

  • Senior Associate Automation Engineer

    7 days ago

    Mumbai, Maharashtra, India NTT DATA Full time ₹ 12,00,000 - ₹ 36,00,000 per year

    Make an impact with NTT DATAJoin a company that is pushing the boundaries of what is possible. We are renowned for our technical excellence and leading innovations, and for making a difference to our clients and society. Our workplace embraces diversity and inclusion – it's a place where you can grow, belong and thrive.Your day at NTT DATAThe Senior...

  • Senior MS Engineer

    14 hours ago

    Mumbai, Maharashtra, India NTT DATA Full time ₹ 12,00,000 - ₹ 36,00,000 per year

    Make an impact with NTT DATAJoin a company that is pushing the boundaries of what is possible. We are renowned for our technical excellence and leading innovations, and for making a difference to our clients and society. Our workplace embraces diversity and inclusion – it's a place where you can grow, belong and thrive.Your day at NTT DATAAs a Networking...

  • Data Engineer

    5 hours ago

    Mumbai, Maharashtra, India N53 Tech Full time ₹ 25,00,000 - ₹ 60,00,000 per year

    Our client is expanding their Data Engineering function and hiring across multiple levels (3 to 10 years). You will help build and scale their data architecture, data pipelines, data platform governance, and analytics ecosystem. The role includes working closely with business, analytics, engineering, and external partners to enable a strong enterprise-wide...

  • Data Engineer

    2 weeks ago

    Mumbai, Maharashtra, India COREDATA CONSULTANCY Full time ₹ 9,00,000 - ₹ 12,00,000 per year

    Company DescriptionCoredata Consultancy is an IT consulting start-up committed to leveraging technology to empower businesses to achieve success in the digital era. Our mission is driven by innovation and a passion for excellence. Our team of skilled professionals brings depth of expertise and industry knowledge to solve intricate challenges with precision....