Data Engineering Lead

2 days ago


Chennai, Tamil Nadu, India WLEN WORLDJOBS LLP Full time
About Client

WLEN WORLDJOBS LLP is a global leader in professional services and solutions at the forefront of AI data engineering and cloud technologies. With their distributed team of over 500 analytics professionals across North America, Europe, and Asia, they are dedicated to enabling global enterprises to transform and innovate through the power of AI (Artificial Intelligence) data engineering and cloud technologies.

They offer exciting career opportunities for professionals seeking to make a significant impact. Their diverse team represents a rich tapestry of talent, expertise, and cultural backgrounds.

Job DescriptionNotice Period

Up to 30 days

Experience

8-12 years

Roles and Responsibilities
  • Design, build, and operationalize large-scale enterprise data solutions and applications using one or more of AWS data and analytics services, Glue, RedShift, Lambda, and S3.
  • Create PySpark/Python code from scratch according to business requirements while implementing industry-standard best practices.
  • Utilize AWS Management Tools (CloudWatch, CloudTrail) to proactively monitor large and complex deployments.
  • Perform code version management through CodeCommit.
  • Analyze, rearchitect, and replatform on-premise data warehouses to data platforms on AWS.
  • Develop advanced SQL skills for end-to-end development and optimization of existing processes.
  • Maintain and optimize existing processes.
  • Gather requirements, conduct feasibility analysis, design, develop from scratch, and deliver.
  • Design data warehouses/data marts.
  • Lead client calls to flag off any delays, blockers, escalations, and collate all requirements.
  • Deploy data pipelines using automated CI/CD approaches.
  • Write production-ready code in Python and participate in code reviews to maintain and improve code quality, stability, and supportability.
  • Write modularized, reusable code components.
  • Identify data issues and anomalies during analysis.
  • Lead client calls to flag off any delays, blockers, escalations, and collate all requirements.
Must-Have

Experience in Data Engineering (min. 8 years)

Experience in Python or PySpark (either is mandatory)

Min. 67 years of experience

Exposure in Data Warehousing and Data Migration

Experience with AWS services (DynamoDB, RedShift, Lambda, and Glue) out of these services, the candidate should have experience with at least 2 of these services

SQL experience

Key Skills: AWS, Python, SQL, Data Migration, Cloud, Data Warehousing



  • Chennai, Tamil Nadu, India Crayon Data Full time

    Role: Senior Software Engineering LeadCrayon Data, a leading provider of AI-led revenue acceleration solutions, is seeking a seasoned Senior Software Engineering Lead to drive the development of our flagship platform, maya.ai. As a key member of our engineering team, you will be responsible for leading the design and implementation of scalable, flexible, and...


  • Chennai, Tamil Nadu, India Wavicle Data Solutions Full time

    Job Title: Director of Data EngineeringJob Summary:Wavicle Data Solutions is seeking an experienced and visionary Director of Data Engineering to lead and manage our growing Data Engineering team. As a Director, you will be responsible for driving the technical strategy, overseeing complex data projects, and delivering high-quality solutions that support our...


  • Chennai, Tamil Nadu, India Wavicle Data Solutions Full time

    Job Title: Director of Data EngineeringWavicle Data Solutions is seeking a seasoned data engineering leader to drive the technical strategy and oversee complex data projects.Key Responsibilities:Lead and manage the Data Engineering team, fostering a culture of innovation and collaboration.Develop and execute the data engineering strategy in alignment with...


  • Chennai, Tamil Nadu, India Wavicle Data Solutions Full time

    Job Title: Director of Data EngineeringWavicle Data Solutions is seeking a visionary leader to drive the technical strategy and manage our growing Data Engineering team.Key Responsibilities:Lead and mentor the Data Engineering team, fostering a culture of innovation and collaboration.Develop and execute the data engineering strategy in alignment with...

  • Lead Data Engineer

    6 days ago


    Chennai, Tamil Nadu, India Presidio Full time

    Unlock Your Potential as a Lead Data Engineer at PresidioAre you ready to take your career to the next level? We're seeking a talented Lead Data Engineer to join our team at Presidio, a leading global digital services and solutions provider.About the RoleAs a Lead Data Engineer, you will be responsible for designing, developing, and overseeing data systems...


  • Chennai, Tamil Nadu, India Fluidata Analytics Full time

    Fluidata Analytics is a cutting-edge data and analytics consultancy firm. We are seeking a highly skilled Lead Consultant to manage the delivery of data engineering projects and lead project teams. The ideal candidate should have deep technical expertise in data engineering and extensive experience in managing and delivering complex projects in a timely and...


  • Chennai, Tamil Nadu, India Zorba Consulting India Pvt. Ltd. Full time

    Job Title: Lead Data EngineerZorba Consulting India Pvt. Ltd. is seeking a highly skilled Lead Data Engineer to join our team. As a key member of our data engineering team, you will play a crucial role in helping our customers understand and implement the Databricks Lakehouse platform to achieve their business goals.Key Responsibilities:Collaborate with...

  • Data Engineer Lead

    6 days ago


    Chennai, Tamil Nadu, India Encora Inc. Full time

    About the RoleWe are seeking a highly skilled Data Engineer Lead to join our team at Encora Inc. in Chennai. As a Data Engineer Lead, you will be responsible for designing and implementing scalable solutions for ever-increasing data volumes, using big data/cloud technologies like Pyspark, Kafka, etc.Key ResponsibilitiesCollaborate with cross-functional teams...

  • Data Engineering Lead

    21 hours ago


    Chennai, Tamil Nadu, India Encora Inc. Full time

    About the RoleWe are seeking a highly skilled Data Engineering Lead to join our team at Encora. As a Data Engineering Lead, you will be responsible for designing and implementing scalable solutions for ever-increasing data volumes, using big data/cloud technologies like Pyspark, Kafka, etc.Key ResponsibilitiesCollaborate with cross-functional teams to...

  • Data Engineer Lead

    21 hours ago


    Chennai, Tamil Nadu, India UnitedHealth Group Full time

    At UnitedHealth Group, we're committed to helping people live healthier lives and making the health system work better for everyone. As a Data Engineer Lead, you'll play a critical role in designing and building data pipelines to process terabytes of data, ensuring that our systems are scalable and efficient. You'll work closely with our team to orchestrate...


  • Chennai, Tamil Nadu, India Sutherland Global Full time

    Role OverviewWe are seeking an experienced and motivated Data Engineer to lead our dynamic team. The ideal candidate will have a strong background in data engineering, with a focus on SQL, data warehousing, and AWS technologies.The successful candidate will be responsible for leading the design, development, and implementation of scalable data solutions that...

  • Lead Data Engineer

    6 days ago


    Chennai, Tamil Nadu, India Sutherland Global Full time

    About the RoleWe are seeking an experienced and motivated Lead Data Engineer to join our dynamic team at Sutherland Global. The ideal candidate will have a strong background in data engineering, with a focus on SQL, data warehousing, and AWS technologies.Key Responsibilities:Data Engineering Leadership:Lead the development and maintenance of data pipelines...

  • Lead Data Engineer

    6 days ago


    Chennai, Tamil Nadu, India Sutherland Global Full time

    About the RoleWe are seeking an experienced and motivated Lead Data Engineer to join our dynamic team at Sutherland Global. The ideal candidate will have a strong background in data engineering, with a focus on SQL, data warehousing, and AWS technologies.Key ResponsibilitiesData Engineering LeadershipLead the development and maintenance of data pipelines and...

  • Data Engineer Lead

    6 days ago


    Chennai, Tamil Nadu, India Gainwell Technologies Full time

    About the RoleWe are seeking a highly skilled Data Engineer to join our data analytics team at Gainwell Technologies. As a key member of our team, you will have the opportunity to work on designing, developing, and deploying data pipelines using Apache Spark and AWS.Your Key ResponsibilitiesDesign and develop data pipelines, including ETL processes, to...


  • Chennai, Tamil Nadu, India Databricks Full time

    Job Title: Solutions ArchitectAs a Solutions Architect at Databricks, you will play a key role in helping our customers overcome their big data challenges using our platform. You will work closely with customers on short to medium-term engagements, providing data engineering, data science, and cloud technology projects that require integrating with client...


  • Chennai, Tamil Nadu, India Resourcetree Full time

    Job Description : We are seeking a highly skilled Senior Lead Data Engineer to oversee the design, development, and optimization of our data infrastructure and integration processes. This role requires extensive experience in data engineering, leadership abilities, and proficiency in modern data technologies. Join us to drive innovation and lead a dynamic...


  • Chennai, Tamil Nadu, India UPS India Full time

    Explore your next opportunity at a Fortune Global 500 organization. Envision innovative possibilities, experience our rewarding culture, and work with talented teams that help you become better every day. We know what it takes to lead UPS into tomorrow—people with a unique combination of skill + passion. If you have the qualities and drive to lead yourself...


  • Chennai, Tamil Nadu, India NTT DATA Services Full time

    Key ResponsibilitiesRoles and Responsibilities:Design and develop machine learning systems that meet business needs.Research and implement cutting-edge machine learning algorithms and tools to drive business growth.Select and prepare relevant data sets for analysis.Identify and address data distribution differences that impact model performance.Verify data...


  • Chennai, Tamil Nadu, India NTT DATA Services Full time

    Key Responsibilities:Roles and Responsibilities:Design and Develop ML Systems: Create and implement machine learning systems that meet business requirements.Research and Implement ML Algorithms: Research and implement various machine learning algorithms and tools to improve model performance.Data Set Selection and Preparation: Select and prepare appropriate...


  • Chennai, Tamil Nadu, India Crayon Data Full time

    Senior Engineering LeaderCrayon Data is a leading provider of AI-led revenue acceleration solutions, headquartered in Singapore with a local presence in India and the UAE. We are seeking a Senior Engineering Leader to join our team and drive the development of our flagship platform, maya.ai.About the RoleWe are looking for a highly skilled and experienced...