Data Engineer

7 days ago

Chennai, Tamil Nadu, India CyberOne Full time ₹ 15,00,000 - ₹ 20,00,000 per year

About the Role

We are seeking a
Senior Data Engineer
with deep expertise in data cataloging, orchestration systems, and backend engineering to join our data platform team. You will be responsible for building and managing scalable metadata solutions, orchestrating data workflows, and ensuring secure and production-grade deployments.

Key Responsibilities

  • Deploy and manage containerized services
    using
    Amazon ECS
    and/or
    Kubernetes
  • Design and orchestrate data workflows using
    Apache Airflow
  • Work with cloud-native data storage systems such as
    Amazon RDS
    and
    OpenSearch
    (or equivalent solutions)
  • Implement and maintain
    end-to-end data cataloging
    using tools like
    OpenMetadata
    ,
    Unity Catalog
    , or
    AWS Glue Catalog
  • Develop and extend custom connectors
    for metadata tools (e.g., OpenMetadata), enabling:
  • Data lineage capture
  • Metadata enrichment
  • Impact analysis
  • Debug, patch, and manage upgrades for native connectors, ensuring high availability and performance
  • Implement and manage security
    features like
    RBAC
    and
    SSO integration
    (e.g., with
    Okta
    )
  • Support
    production-grade deployments
    , including monitoring, logging, and alerting for metadata and orchestration services
  • Build backend tools such as:
  • Code scanners
  • Pull request lineage tools
  • Automation scripts
  • GitHub App-based ingestion pipelines
  • Collaborate with data engineering and platform teams to drive data governance and cataloging strategy

Requirements

  • Proven experience with
    Docker
    and managing containerized services in cloud environments (ECS/Kubernetes)
  • Strong hands-on experience with
    Apache Airflow
  • Solid knowledge of
    relational databases
    (e.g., RDS) and search/analytics engines (e.g., OpenSearch)
  • In-depth understanding of
    data cataloging
    tools, particularly
    OpenMetadata
    ,
    Unity Catalog
    , or
    AWS Glue Catalog
  • Experience developing backend features in Python or similar languages
  • Familiarity with
    SSO integration
    ,
    RBAC
    models, and production system hardening
  • Experience in building reliable and scalable systems for
    metadata and data lineage

Preferred Qualifications

  • Contributions to OpenMetadata or similar open-source projects
  • Familiarity with GitHub APIs, GitHub Actions, and GitHub App development
  • Background in DevOps or Site Reliability Engineering is a plus

  • Data Engineer

    2 weeks ago

    Chennai, Tamil Nadu, India NTT DATA Full time ₹ 12,00,000 - ₹ 36,00,000 per year

    Req ID: 336026NTT DATA strives to hire exceptional, innovative and passionate individuals who want to grow with us. If you want to be part of an inclusive, adaptable, and forward-thinking organization, apply now. We are currently seeking a Data Engineer - Azure to join our team in Chennai, Tamil Nādu (IN-TN), India (IN). "Job Duties: Key Responsibilities:...

  • Data Engineer

    1 week ago

    Chennai, Tamil Nadu, India CX Data Labs Full time ₹ 15,00,000 - ₹ 25,00,000 per year

    HiRole - Azure Data engineerLocation - Chennai, Gurugram (5days Onsite)Full timeImmediate joiner Only (15days Notice period only)Technical Skills:o Proficiency in SQL for complex queries, database design, and optimization.o Strong experience with PySpark for data transformation and processing.o Hands-on experience with Databricks for building and managing...

  • Data Engineer

    2 weeks ago

    Chennai, Tamil Nadu, India CustomerLabs ❤️ 1P Data OPs Full time ₹ 5,00,000 - ₹ 15,00,000 per year

    As a Data Engineer (GCP) at CustomerLabs Inc., you will play a crucial role in designing, developing, and maintaining our data infrastructure on Google Cloud Platform. You will be responsible for ensuring the reliability, scalability, and efficiency of our data pipelines to support our analytics and machine learning initiatives.Key ResponsibilitiesDesign and...

  • Data Engineer

    2 weeks ago

    Chennai, Tamil Nadu, India NTT DATA North America Full time ₹ 12,00,000 - ₹ 36,00,000 per year

    Req ID:336025NTT DATA strives to hire exceptional, innovative and passionate individuals who want to grow with us. If you want to be part of an inclusive, adaptable, and forward-thinking organization, apply now.We are currently seeking a Data Engineer - Azure to join our team in Chennai, Tamil Nādu (IN-TN), India (IN)."Job Duties: Key...

  • Data Engineer

    1 week ago

    Chennai, Tamil Nadu, India NTT DATA Global Delivery Services Ltd Full time ₹ 10,00,000 - ₹ 25,00,000 per year

    Data Engineer - Azure Req ID: 336041 NTT DATA strives to hire exceptional, innovative and passionate individuals who want to grow with us. If you want to be part of an inclusive, adaptable, and forward-thinking organization, apply now. We are currently seeking a Data Engineer - Azure to join our team in Chennai, Tamil Nādu (IN-TN), India (IN). "Job...

  • GCP Data Engineer

    2 weeks ago

    Chennai, Tamil Nadu, India CustomerLabs ❤️ 1P Data OPs Full time ₹ 8,00,000 - ₹ 18,00,000 per year

    Data Engineer Job DescriptionPosition Overview Yesterday is history, tomorrow is a mystery, but today is a gift. That's why we call it the present.- Master OogwayJoin CustomerLabs' dynamic data team as a Data Engineer and play a pivotal role in transforming raw marketing data into actionable insights that power our digital marketing platform. As a key member...

  • Data Engineer for Azure DevOps

    2 weeks ago

    Chennai, Tamil Nadu, India NTT DATA Full time ₹ 12,00,000 - ₹ 36,00,000 per year

    Req ID: 336023NTT DATA strives to hire exceptional, innovative and passionate individuals who want to grow with us. If you want to be part of an inclusive, adaptable, and forward-thinking organization, apply now. We are currently seeking a Data Engineer for Azure DevOps to join our team in Chennai, Tamil Nādu (IN-TN), India (IN). "Job Duties: 7+ years of...

  • Python & SSIS Data Engineer

    3 days ago

    Chennai, Tamil Nadu, India AABM Cloud Data Solutions Full time ₹ 10,00,000 - ₹ 42,00,000 per year

    MANDATORY PREVIOUS WORK EXPERIENCE IN SSIS AND PYTHON. (Candidates without this experience in the past will NOT be considered for this role)JOB RESPONSIBILITIES5+ years previous work experience as a Data Engineer.Design and build data pipelines using SSIS, ADF, Talend, Informatica, Data Stage, or Ab Initio to move and transform data reliably.Manage and...

  • Senior Data scientist

    3 days ago

    Chennai, Tamil Nadu, India Crayon Data Full time ₹ 12,00,000 - ₹ 36,00,000 per year

    Senior Data Scientist Chennai (AI/ML & BFSI Focus) From models to measurable impact — drive real change with AI.Location: Chennai, India Experience: 6–8 years in Data Science/ML (preferably in BFSI or other data-rich industries) Innovators who don't just build models but drive measurable business impact. Expertise: Fierce desire to use AI in every...

  • Senior Software Engineer

    3 days ago

    Chennai, Tamil Nadu, India Crayon Data Full time ₹ 8,00,000 - ₹ 24,00,000 per year

    Senior Software Engineer Chennai (AI/ML Engineering Focus) Build the backbone of AI — engineer the systems that power enterprise intelligenceLocation: Chennai, India Experience: 6–8 years in software engineering (preferably in AI/ML or data-driven product development) Problem solvers who don't just write code but build scalable, impactful AI...