Sr Data Engineer

2 days ago

Chennai, Tamil Nadu, India Talentship Full time ₹ 20,00,000 - ₹ 25,00,000 per year

Senior Data Engineer - Cloud Data Platform

Position Overview

We are seeking a highly skilled Senior Data Engineer to join our data platform team, responsible for designing and implementing scalable, cloud-native data solutions. This role focuses on building modern data infrastructure using AWS and Azure services to support our growing analytics and machine learning initiatives.

Key Responsibilities

  • Business Translation: Collaborate with business stakeholders to understand requirements and translate them into scalable data models, architectures, and robust end-to-end data pipelines
  • ETL/ELT Implementation: Design, develop, and maintain high-performance batch and real-time data pipelines using modern frameworks like Apache Spark, Delta Lake, and streaming technologies
  • Data Platform Management: Architect and implement data lakes, data warehouses, and Lakehouse architectures following medallion architecture principles (Bronze, Silver, Gold layers)

Data Operations & Quality

  • Pipeline Orchestration: Implement complex workflow orchestration using tools like AWS Step Functions or Azure Data Factory
  • Data Quality Assurance: Establish comprehensive data validation, monitoring, and quality frameworks using tools like Great Expectations or custom Python solutions
  • Performance Optimization: Monitor, troubleshoot, and optimize data pipeline performance, implementing partitioning strategies and query optimization techniques
  • Data Governance: Implement data lineage tracking, metadata management, and ensure compliance with data privacy regulations (GDPR)

Cloud Infrastructure & DevOps

Experience & Background

  • 6+ years of hands-on experience in Data Engineering roles with demonstrated expertise in cloud-native data solutions
  • Cloud Expertise: Strong preference for AWS/Azure data services
  • Production Experience: Proven track record of building and maintaining production-grade data pipelines processing terabytes of data

Technical Skills

Programming & Development

  • Python: Advanced proficiency in Python for data engineering (pandas, numpy, boto3, azure-sdk)
  • SQL: Expert-level SQL skills including complex queries, window functions, CTEs, and performance tuning
  • PySpark: Hands-on experience with PySpark for large-scale data processing and optimization
  • Version Control: Proficient with Git workflows, branching strategies, and collaborative development

AWS Data Services (Primary Focus)

  • Compute: Experience working on services like AWS Glue, Lambda Azure Data Factory, Synapse Analytics, Data Lake Storage Gen2, S3 Redshift, RDS, DynamoDB
  • Analytics: Power BI, Athena, Kinesis (Data Streams, Data Firehose, Analytics)

Security: IAM, KMS, VPC, Security Groups for secure data access patterns

  • Sr .Net Engineer

    2 weeks ago

    Chennai, Tamil Nadu, India NTT Data Full time

    Job DescriptionNTT DATA strives to hire exceptional, innovative and passionate individuals who want to grow with us. If you want to be part of an inclusive, adaptable, and forward-thinking organization, apply now.We are currently seeking a Sr .Net Engineer to join our team in Chennai, Tamil Ndu (IN-TN), India (IN).Who We Are:NTT DATA America strives to hire...

  • Senior Azure Data Engineer/Azure Data architect

    2 weeks ago

    Chennai, Tamil Nadu, India Deerak Solutions Full time ₹ 15,00,000 - ₹ 28,00,000 per year

    Sr. Azure Data Engineer / Azure Data Architect (C2H Remote)5–15 years of experience in data engineering with strong expertise in Azure Databricks, Azure Data Factory (ADF), Azure Data Lake, and Synapse Analytics.Proficiency in Python (PySpark) and advanced SQL for building, optimizing, and maintaining large-scale data pipelines.Strong knowledge of ETL/ELT...

  • Sr. Engineer

    1 week ago

    Chennai, Tamil Nadu, India Qode Full time ₹ 15,00,000 - ₹ 28,00,000 per year

    Position Title: Sr. Engineer / Technical Lead – .NET Core Development Experience: 6–10 Years Location: Chennai / Gurugram Company Name : Incedo Technology About the Role: We are looking for a highly skilled and motivated Sr. Engineer / Technical Lead to join our team. The ideal candidate should have hands-on experience in developing enterprise...

  • Sr .Net Engineer

    2 weeks ago

    Chennai, Tamil Nadu, India NTT DATA North America Full time US$ 1,04,000 - US$ 1,30,878 per year

    Req ID: NTT DATA strives to hire exceptional, innovative and passionate individuals who want to grow with us. If you want to be part of an inclusive, adaptable, and forward-thinking organization, apply now.We are currently seeking a Sr .Net Engineer to join our team in Chennai, Tamil Nādu (IN-TN), India (IN).Who We Are:NTT DATA America strives to hire...

  • Sr Engineer Maintenance

    2 days ago

    Chennai, Tamil Nadu, India RCS CAREERLINK SOLUTIONS PVT LTD Full time ₹ 3,00,000 - ₹ 5,00,000 per year

    Position - Sr Engineer MaintenanceExperience - 3 to 5 YearsLocation - WalajabadExperience in glass-lined equipment maintenance. A valid C-License is mandatory. Familiarity with PLC systems will be considered an added advantage.Job Type: Full-timePay: ₹300, ₹500,000.00 per yearWork Location: In person

  • Software Qlty Assurance Sr. Specialist

    3 weeks ago

    Chennai, Tamil Nadu, India NTT Data Full time

    Job DescriptionNTT DATA strives to hire exceptional, innovative and passionate individuals who want to grow with us. If you want to be part of an inclusive, adaptable, and forward-thinking organization, apply now.We are currently seeking a Software Qlty Assurance Sr. Specialist to join our team in Chennai, Tamil Ndu (IN-TN), India (IN).ETL, PL/SQL,...

  • Software Qlty Assurance Sr. Specialist

    2 weeks ago

    Chennai, Tamil Nadu, India NTT DATA, Inc. Full time ₹ 15,00,000 - ₹ 28,00,000 per year

    We are currently seeking a Software Qlty Assurance Sr. Specialist to join our team in Chennai, Tamil Ndu (IN-TN), India (IN).ETL, PL/SQL, Databricks and PySpark experience, with experience migrating to the cloud

  • Data Engineer

    1 week ago

    Chennai, Tamil Nadu, India NTT DATA North America Full time ₹ 15,00,000 - ₹ 20,00,000 per year

    Req ID: NTT DATA strives to hire exceptional, innovative and passionate individuals who want to grow with us. If you want to be part of an inclusive, adaptable, and forward-thinking organization, apply now.We are currently seeking a Data Engineer - Azure to join our team in Chennai, Tamil Nādu (IN-TN), India (IN)."Job Duties: Key Responsibilities:•  ...

  • Sr Data Engineer

    2 weeks ago

    Chennai, Tamil Nadu, India Virtusa Full time ₹ 1,50,000 - ₹ 28,00,000 per year

    Senior Data EngineerPosition Summary:The Senior Data Engineer leads complex data engineering projects, working on designing data architectures that align with business requirements. This role focuses on optimizing data workflows, managing data pipelines, and ensuring the smooth operation of data systems.Minimum Qualifications:8+ Years overall IT experience...

  • Sr. SOC Engineer – SIEM Engineering

    2 weeks ago

    Chennai, Tamil Nadu, India qpact Full time ₹ 10 - ₹ 13 per year

    Sr. SOC Engineer – SIEM EngineeringExperience: 4 years to 9 yearsMax Budget: 4 to 7 Years - 10 LPA7 to 9 years – 13.5 LPAJob Description:•Configure, deploy, and maintain the organization's SIEM platform to ensure optimal performance and functionality.•Develop and customize SIEM rules, filters, and alerts to meet specific security monitoring and...