Data Engineer

7 days ago

Chennai, Tamil Nadu, India CyberOne Full time ₹ 15,00,000 - ₹ 20,00,000 per year

About the Role

We are seeking a
Senior Data Engineer
with deep expertise in data cataloging, orchestration systems, and backend engineering to join our data platform team. You will be responsible for building and managing scalable metadata solutions, orchestrating data workflows, and ensuring secure and production-grade deployments.

Key Responsibilities

  • Deploy and manage containerized services
    using
    Amazon ECS
    and/or
    Kubernetes
  • Design and orchestrate data workflows using
    Apache Airflow
  • Work with cloud-native data storage systems such as
    Amazon RDS
    and
    OpenSearch
    (or equivalent solutions)
  • Implement and maintain
    end-to-end data cataloging
    using tools like
    OpenMetadata
    ,
    Unity Catalog
    , or
    AWS Glue Catalog
  • Develop and extend custom connectors
    for metadata tools (e.g., OpenMetadata), enabling:
  • Data lineage capture
  • Metadata enrichment
  • Impact analysis
  • Debug, patch, and manage upgrades for native connectors, ensuring high availability and performance
  • Implement and manage security
    features like
    RBAC
    and
    SSO integration
    (e.g., with
    Okta
    )
  • Support
    production-grade deployments
    , including monitoring, logging, and alerting for metadata and orchestration services
  • Build backend tools such as:
  • Code scanners
  • Pull request lineage tools
  • Automation scripts
  • GitHub App-based ingestion pipelines
  • Collaborate with data engineering and platform teams to drive data governance and cataloging strategy

Requirements

  • Proven experience with
    Docker
    and managing containerized services in cloud environments (ECS/Kubernetes)
  • Strong hands-on experience with
    Apache Airflow
  • Solid knowledge of
    relational databases
    (e.g., RDS) and search/analytics engines (e.g., OpenSearch)
  • In-depth understanding of
    data cataloging
    tools, particularly
    OpenMetadata
    ,
    Unity Catalog
    , or
    AWS Glue Catalog
  • Experience developing backend features in Python or similar languages
  • Familiarity with
    SSO integration
    ,
    RBAC
    models, and production system hardening
  • Experience in building reliable and scalable systems for
    metadata and data lineage

Preferred Qualifications

  • Contributions to OpenMetadata or similar open-source projects
  • Familiarity with GitHub APIs, GitHub Actions, and GitHub App development
  • Background in DevOps or Site Reliability Engineering is a plus

  • Data Engineer

    2 weeks ago

    Chennai, Tamil Nadu, India Quantrail Data Full time US$ 60,000 - US$ 1,00,000 per year

    Location: Chennai, India (On-site)Duration: 3 monthsStipend: UnpaidEligibility:2025 graduates onlyConversion: Opportunity for a full-time role based on performance Note: Please apply only if you are serious about joining us. This is a learning-focused internship, and we expect interns to be committed to upskilling themselves and contributing to real-world...

  • Data Engineer

    2 weeks ago

    Chennai, Tamil Nadu, India NTT DATA Full time US$ 80,000 - US$ 1,20,000 per year

    Req ID: 336026NTT DATA strives to hire exceptional, innovative and passionate individuals who want to grow with us. If you want to be part of an inclusive, adaptable, and forward-thinking organization, apply now. We are currently seeking a Data Engineer - Azure to join our team in Chennai, Tamil Nādu (IN-TN), India (IN). "Job Duties: Key Responsibilities:...

  • Data Engineer

    1 week ago

    Chennai, Tamil Nadu, India CX Data Labs Full time ₹ 1,04,000 - ₹ 1,30,878 per year

    HiRole - Azure Data engineerLocation - Chennai, Gurugram (5days Onsite)Full timeImmediate joiner Only (15days Notice period only)Technical Skills:o Proficiency in SQL for complex queries, database design, and optimization.o Strong experience with PySpark for data transformation and processing.o Hands-on experience with Databricks for building and managing...

  • Senior Data Engineer

    1 week ago

    Chennai, Tamil Nadu, India Eucloid Data Solutions Full time US$ 1,50,000 - US$ 2,00,000 per year

    About The Role:Eucloid is looking for a senior Data Engineer with hands-on expertise in Databricks to join our Data Platform team supporting various business applications. The ideal candidate will support development of data infrastructure on Databricks for our clients by participating in activities which may include starting from up- stream and down-stream...

  • Data Engineer

    22 hours ago

    Chennai, Tamil Nadu, India NTT DATA North America Full time ₹ 15,00,000 - ₹ 20,00,000 per year

    Req ID: NTT DATA strives to hire exceptional, innovative and passionate individuals who want to grow with us. If you want to be part of an inclusive, adaptable, and forward-thinking organization, apply now.We are currently seeking a Data Engineer - Azure to join our team in Chennai, Tamil Nādu (IN-TN), India (IN)."Job Duties: Key Responsibilities:•  ...

  • Data Engineer

    2 weeks ago

    Chennai, Tamil Nadu, India CustomerLabs ❤️ 1P Data OPs Full time ₹ 9,00,000 - ₹ 12,00,000 per year

    As a Data Engineer (GCP) at CustomerLabs Inc., you will play a crucial role in designing, developing, and maintaining our data infrastructure on Google Cloud Platform. You will be responsible for ensuring the reliability, scalability, and efficiency of our data pipelines to support our analytics and machine learning initiatives.Key ResponsibilitiesDesign and...

  • Data Engineer

    2 weeks ago

    Chennai, Tamil Nadu, India NTT DATA North America Full time US$ 80,000 - US$ 1,20,000 per year

    Req ID:336025NTT DATA strives to hire exceptional, innovative and passionate individuals who want to grow with us. If you want to be part of an inclusive, adaptable, and forward-thinking organization, apply now.We are currently seeking a Data Engineer - Azure to join our team in Chennai, Tamil Nādu (IN-TN), India (IN)."Job Duties: Key...

  • GCP Data Engineer

    2 weeks ago

    Chennai, Tamil Nadu, India CustomerLabs 1P Data OPs Full time

    Position Overview:"Yesterday is history, tomorrow is a mystery, but today is a gift. That's why we call itthe present." - Master OogwayJoin CustomerLabs' dynamic data team as a Data Engineer and play a pivotal role intransforming raw marketing data into actionable insights that power our digitalmarketing platform. As a key member of our data infrastructure...

  • GCP Data Engineer

    2 weeks ago

    Chennai, Tamil Nadu, India CustomerLabs ❤️ 1P Data OPs Full time US$ 90,000 - US$ 1,20,000 per year

    Data Engineer Job DescriptionPosition Overview Yesterday is history, tomorrow is a mystery, but today is a gift. That's why we call it the present.- Master OogwayJoin CustomerLabs' dynamic data team as a Data Engineer and play a pivotal role in transforming raw marketing data into actionable insights that power our digital marketing platform. As a key member...

  • Data Engineer for Azure DevOps

    2 weeks ago

    Chennai, Tamil Nadu, India NTT DATA Full time ₹ 15,00,000 - ₹ 20,00,000 per year

    Req ID: 336023NTT DATA strives to hire exceptional, innovative and passionate individuals who want to grow with us. If you want to be part of an inclusive, adaptable, and forward-thinking organization, apply now. We are currently seeking a Data Engineer for Azure DevOps to join our team in Chennai, Tamil Nādu (IN-TN), India (IN). "Job Duties: 7+ years of...