AWS Data Engineering Lead

1 week ago


Chennai, Tamil Nadu, India Overture Rede Full time
About Overture Rede

Overture Rede is a pioneering organization in the field of data engineering, committed to harnessing the power of AWS tools and technologies to drive business growth. With a focus on innovative solutions, our team strives to deliver cutting-edge ETL/ELT data pipelines that cater to the evolving needs of enterprises.

Job Summary

We are seeking an experienced AWS Data Engineer Lead to join our esteemed team. As a key member, you will play a pivotal role in designing, developing, and implementing large-scale data engineering solutions using AWS services such as Athena, Redshift, Glue, EMR, and S3. Your expertise in Python, Spark, and CI/CD technologies will enable you to build and deploy scalable data pipelines that drive business insights.

Key Responsibilities
  • Develop and implement enterprise-grade ETL/ELT data pipelines using AWS services (e.g., Athena, Redshift, Glue, EMR)
  • Design and develop big data ecosystems, including Cloudera/Hortonworks, AWS EMR, GCP DataProc, or GCP Cloud Data Fusion
  • Work with streaming technologies and processing engines (Kinesis, Kafka, Pub/Sub, and Spark Streaming)
  • Experience with relational SQL and NoSQL databases (Redshift, DynamoDB, RDS Postgres, and Oracle)
  • Implement data pipeline and workflow management technologies (Airflow) for efficient data processing
  • Provision and manage cloud infrastructure using AWS EC2, S3, and IAM
  • Collaborate with cross-functional teams to design and implement full-stack development solutions across distributed applications and services
Requirements
  • Minimum 6-10 years of experience in AWS toolsets, including Athena, Redshift, Glue, EMR, and Spark
  • Familiarity with Python, Scala, and Java programming languages
  • Hands-on experience with CI/CD tools, including Git, Jenkins, Spinnaker, GCP Cloud Build, and Ansible
  • Strong knowledge of data engineering best practices, including coding standards, unit testing, version control, and code review
  • Proficiency in working with various individuals and groups, fostering constructive relationships and effective communication
What We Offer
  • A highly competitive salary package: ₹30 lakhs - ₹40 lakhs per annum
  • An opportunity to work with a dynamic team of professionals who share your passion for innovation and excellence
  • A chance to contribute to the success of Overture Rede and shape the future of data engineering


  • Chennai, Tamil Nadu, India Tata Consultancy Services Full time

    About UsTata Consultancy Services is a leading IT services company that helps organizations transform and grow their businesses. We are a global leader in consulting and technology, combining our deep industry knowledge with innovative solutions to deliver results for our clients.Job OverviewWe are currently hiring for an AWS Data Engineer Lead position....


  • Chennai, Tamil Nadu, India Mphasis Full time

    We are seeking a highly skilled Data Engineering Lead to join our team at Mphasis, where you will play a key role in designing and implementing data ingestion pipelines using AWS services.This is an exceptional opportunity to showcase your expertise in data engineering and lead the development of high-performance data pipelines, architectures, and data...


  • Chennai, Tamil Nadu, India Tata Consultancy Services Full time

    Job Title: AWS Data Engineer LeadDescriptionJob RequirementsGood hands-on experience in Python programming and PySpark/ScalaData Engineering experience using AWS core services (Lambda, Glue, EMR, S3, and RedShift)Good knowledge on any of the ETL tools and SQL'sKey SkillsAWS GlueLambdaAthenaWhy Choose UsTata Consultancy Services is a leading IT services...


  • Chennai, Tamil Nadu, India Tata Consultancy Services Full time

    About the RoleThe successful candidate will lead engineering teams on cloud-based data projects utilizing AWS services.Key Responsibilities:Develop and maintain large-scale data pipelines using Python, PySpark, and AWS Glue.Design and implement scalable data architectures for cloud-based environments.Collaborate with cross-functional teams to ensure seamless...


  • Chennai, Tamil Nadu, India Tata Consultancy Services Full time

    Job Title: Highly Experienced AWS Data Engineer LeadAbout the Role: As a highly experienced AWS Data Engineer Lead at Tata Consultancy Services, you will be responsible for leading the design, implementation, and optimization of data pipelines and architectures using AWS services like S3, Redshift, Glue, Lambda, and Step Functions. Your primary goal will be...


  • Chennai, Tamil Nadu, India Tata Consultancy Services Full time

    AWS Data Engineer Lead Job SummaryWe are seeking an experienced AWS Data Engineer to lead the design and implementation of large-scale data processing systems using AWS core services, including Lambda, Glue, EMR, S3, and RedShift.Key Responsibilities:Designing and implementing scalable data pipelines to process and analyze large datasetsEnsuring high-quality...


  • Chennai, Tamil Nadu, India Tata Consultancy Services Full time

    Tata Consultancy Services is seeking an experienced AWS Data Engineer Lead to join our team. This is a challenging role that requires strong technical expertise in designing and implementing scalable, secure, and efficient data architectures using AWS services.About the RoleIn this role, you will be responsible for leading the design, implementation, and...

  • Senior Data Engineer

    4 weeks ago


    Chennai, Tamil Nadu, India Wavicle Data Solutions Full time

    We are seeking an Experienced AWS Data Architect with a strong background in designing, building, and maintaining scalable data pipelines and solutions on AWS. The ideal candidate will have a deep understanding of AWS services, data engineering best practices, and cloud architecture.Key Responsibilities:Design, develop, and maintain robust ETL pipelines on...


  • Chennai, Tamil Nadu, India Fulcrum Digital Full time

    About the RoleFulcrum Digital is a next-generation digital accelerating company providing digital transformation and technology services across various industries.We are seeking an experienced professional with a strong background in AWS cloud technologies and data engineering.The ideal candidate will be proficient in a wide range of AWS services and tools,...

  • Data Engineering Lead

    4 weeks ago


    Chennai, Tamil Nadu, India Forbes Advisor Full time

    Job Title: Data Engineering Lead About the RoleWe are seeking an experienced Data Engineer to lead our team in designing, building, and maintaining large-scale data systems. This is a unique opportunity to join Forbes Advisor and contribute to the success of our organization. Salary InformationThe estimated salary for this position is between $150,000 to...


  • Chennai, Tamil Nadu, India APPIT SOFTWARE SOLUTIONS PRIVATE LIMITED Full time

    Job Title: AWS Data Solutions Engineer - Cloud ArchitectAbout APPIT Software:APPIT Software is a leading technology consulting firm specializing in Oracle solutions. With a global presence and a development center in India, we offer consultancy services to help customers optimize their business systems and protect their IT investments.Job Description:We are...


  • Chennai, Tamil Nadu, India QBrainX Full time

    Job Title - Senior Data Engineering LeadWe are seeking a highly skilled Data Engineering Lead to join our team at QBrainX. As a key member of our data engineering team, you will play a crucial role in designing, developing, and maintaining our data pipelines.Estimated Salary: $120,000 - $180,000 per yearResponsibilities:Design, develop, and maintain scalable...

  • Data Engineering Lead

    2 weeks ago


    Chennai, Tamil Nadu, India Databricks Full time

    About the RoleWe are seeking an experienced Data Engineering Lead to join our Professional Services team at Databricks. In this role, you will work with customers on short to medium-term engagements to help them overcome their big data challenges using the Databricks platform.Key ResponsibilitiesDesign and implement data engineering solutions that integrate...


  • Chennai, Tamil Nadu, India LTIMindtree Full time

    About the RoleWe are seeking an experienced Data Engineer to lead our big data platform team at LTIMindtree. The successful candidate will have a strong background in designing and developing scalable data engineering solutions.Key Responsibilities:Design, develop, and deploy big data platforms using Spark and Scala.Collaborate with cross-functional teams to...

  • Data Engineer Lead

    7 days ago


    Chennai, Tamil Nadu, India Genpact Full time

    Genpact, a global professional services and solutions firm, seeks a Data Engineer Lead with expertise in cloud architecture to drive business outcomes. As a seasoned leader, you will spearhead the development of data pipelines, ensuring seamless integration with client systems. With a strong background in AWS technologies, including Glue, Athena,...


  • Chennai, Tamil Nadu, India Fulcrum Digital Full time

    Company OverviewFulcrum Digital is a forward-thinking digital acceleration company that provides comprehensive digital transformation and technology services. Our expertise spans multiple industries, including banking & financial services, insurance, retail, higher education, food, healthcare, and manufacturing.About the RoleWe seek an experienced...


  • Chennai, Tamil Nadu, India Tata Consultancy Services Full time

    Job DescriptionA Big Data Engineering Expert is required to join our team at Tata Consultancy Services in India. The successful candidate will work on big data Hadoop projects using the AWS ecosystem.Key ResponsibilitiesResolve production issues in big data Hadoop and AWS environmentsMaintain and monitor big data workflows, Flume jobs, Kafka jobs, and AWS...

  • Data Engineering Lead

    4 weeks ago


    Chennai, Tamil Nadu, India UnitedHealth Group Full time

    At UnitedHealth Group, we are committed to helping people live healthier lives and making the health system work better for everyone. As a Data Engineering Lead, you will play a critical role in advancing our data engineering capabilities and driving business value through innovative data strategies. Your responsibilities will include designing and building...


  • Chennai, Tamil Nadu, India Prodapt Full time

    Data Migration and Architecture ExpertWe are seeking an experienced Data Architect to lead a major cloud data migration initiative. The role involves designing and implementing strategies for migrating data from legacy systems to modern cloud platforms (AWS), ensuring data integrity, scalability, and security. The ideal candidate will have deep technical...


  • Chennai, Tamil Nadu, India RiDiK (a Subsidiary of CLPS. Nasdaq: CLPS) Full time

    At RiDiK (a Subsidiary of CLPS. Nasdaq: CLPS), we are seeking a highly skilled Tech Lead for our AWS Data Engineer team. As a senior member of our team, you will be responsible for guiding team members on technical aspects, conducting reviews of technical documents and artefacts, and ensuring successful initiation, planning, execution, control and completion...