Lead Data Engineer

6 days ago

Chennai, Tamil Nadu, India Sutherland Global Full time
About the Role

We are seeking an experienced and motivated Lead Data Engineer to join our dynamic team at Sutherland Global. The ideal candidate will have a strong background in data engineering, with a focus on SQL, data warehousing, and AWS technologies.

Key Responsibilities
  • Data Engineering Leadership
    • Lead the development and maintenance of data pipelines and ETL processes to support data integration, transformation, and loading into data warehouses.
    • Collaborate with cross-functional teams, including data scientists, analysts, and business stakeholders, to understand data requirements and deliver robust data solutions.
    • Provide technical guidance and mentorship to junior data engineers, fostering a culture of continuous learning and improvement.
  • SQL and Data Warehousing
    • Design, implement, and optimize data models and schemas within a data warehouse environment.
    • Write complex SQL queries, stored procedures, and functions to support data extraction, transformation, and reporting needs.
    • Perform performance tuning and query optimization to ensure efficient data retrieval and processing.
  • AWS Data Services
    • Leverage AWS data services, including Redshift, Lambda, Glue, S3, and others, to build scalable and cost-effective data solutions.
    • Implement data storage and processing solutions that align with best practices for security, performance, and cost optimization in the cloud.
    • Monitor and maintain the data infrastructure, ensuring high availability, reliability, and security of data assets.
  • Python Scripting and Automation
    • Utilize Python for data manipulation, scripting, and automation tasks to enhance data processing workflows.
    • Develop scripts and tools for data quality checks, data validation, and automated reporting.
    • Integrate Python-based solutions with AWS services to automate data processing pipelines.
  • Machine Learning and Big Data Technologies (Preferred)
    • Apply knowledge of machine learning concepts and frameworks to support data science initiatives.
    • Work with big data technologies such as Spark, Hadoop, or Kafka to process and analyze large-scale datasets.
    • Explore opportunities to integrate machine learning models into data pipelines for real-time analytics.
  • Reporting and Visualization
    • Develop and maintain reporting solutions using modern BI tools such as Power BI, Tableau, or SSRS.
    • Collaborate with business users to create interactive dashboards and reports that provide actionable insights.
    • Ensure data accuracy and consistency across all reporting platforms.
  • DevOps and CI/CD
    • Implement DevOps practices and tools to streamline the deployment and management of data pipelines and infrastructure.
    • Set up continuous integration and continuous delivery (CI/CD) pipelines for automated testing, deployment, and monitoring of data solutions.
    • Work within agile methodologies such as Scrum or Kanban to deliver high-quality data solutions on time.
  • AWS Certification and Professional Development
    • Maintain and apply knowledge of AWS services through certification as an AWS Certified Developer - Associate, AWS Certified Solutions Architect, or equivalent.
    • Stay up-to-date with the latest industry trends, best practices, and emerging technologies in data engineering and cloud computing.
Requirements
  • Bachelor's or Master's degree in Computer Science, Information Technology, or a related field.
  • 7+ years of experience in data engineering, with a strong emphasis on SQL, data warehousing, and AWS technologies.
  • Proficiency in SQL for complex queries, stored procedures, and performance tuning.
  • Hands-on experience with AWS data services (e.g., Redshift, Lambda, Glue, S3).
  • Proficiency in Python for data manipulation, scripting, and automation.
  • Solid understanding of data warehousing principles and best practices.
  • Knowledge of DevOps practices and CI/CD tools.
Preferred Qualifications
  • Experience with machine learning concepts and frameworks.
  • Hands-on experience with big data technologies (e.g., Spark, Hadoop, Kafka).
  • Experience with modern reporting and visualization tools (e.g., Power BI, Tableau, SSRS).
  • Certified AWS Professional (AWS Certified Developer - Associate, AWS Certified Solutions Architect).
  • Familiarity with agile methodologies such as Scrum or Kanban.
Personal Attributes
  • Strong analytical and problem-solving skills.
  • Excellent communication and collaboration abilities.
  • Ability to work independently and lead projects from conception to completion.
  • Continuous learner with a passion for staying current with new technologies and best practices.

  • Senior Software Engineering Lead

    22 hours ago

    Chennai, Tamil Nadu, India Crayon Data Full time

    Role: Senior Software Engineering LeadCrayon Data, a leading provider of AI-led revenue acceleration solutions, is seeking a seasoned Senior Software Engineering Lead to drive the development of our flagship platform, maya.ai. As a key member of our engineering team, you will be responsible for leading the design and implementation of scalable, flexible, and...

  • Data Engineering Leader

    4 days ago

    Chennai, Tamil Nadu, India Wavicle Data Solutions Full time

    Job Title: Director of Data EngineeringJob Summary:Wavicle Data Solutions is seeking an experienced and visionary Director of Data Engineering to lead and manage our growing Data Engineering team. As a Director, you will be responsible for driving the technical strategy, overseeing complex data projects, and delivering high-quality solutions that support our...

  • Data Engineering Leader

    6 days ago

    Chennai, Tamil Nadu, India Wavicle Data Solutions Full time

    Job Title: Director of Data EngineeringWavicle Data Solutions is seeking a seasoned data engineering leader to drive the technical strategy and oversee complex data projects.Key Responsibilities:Lead and manage the Data Engineering team, fostering a culture of innovation and collaboration.Develop and execute the data engineering strategy in alignment with...

  • Data Engineering Director

    6 days ago

    Chennai, Tamil Nadu, India Wavicle Data Solutions Full time

    Job Title: Director of Data EngineeringWavicle Data Solutions is seeking a visionary leader to drive the technical strategy and manage our growing Data Engineering team.Key Responsibilities:Lead and mentor the Data Engineering team, fostering a culture of innovation and collaboration.Develop and execute the data engineering strategy in alignment with...

  • Lead Data Engineer

    6 days ago

    Chennai, Tamil Nadu, India Presidio Full time

    Unlock Your Potential as a Lead Data Engineer at PresidioAre you ready to take your career to the next level? We're seeking a talented Lead Data Engineer to join our team at Presidio, a leading global digital services and solutions provider.About the RoleAs a Lead Data Engineer, you will be responsible for designing, developing, and overseeing data systems...

  • Data Engineering Lead

    6 days ago

    Chennai, Tamil Nadu, India Fluidata Analytics Full time

    Fluidata Analytics is a cutting-edge data and analytics consultancy firm. We are seeking a highly skilled Lead Consultant to manage the delivery of data engineering projects and lead project teams. The ideal candidate should have deep technical expertise in data engineering and extensive experience in managing and delivering complex projects in a timely and...

  • Data Engineering Lead

    6 days ago

    Chennai, Tamil Nadu, India Zorba Consulting India Pvt. Ltd. Full time

    Job Title: Lead Data EngineerZorba Consulting India Pvt. Ltd. is seeking a highly skilled Lead Data Engineer to join our team. As a key member of our data engineering team, you will play a crucial role in helping our customers understand and implement the Databricks Lakehouse platform to achieve their business goals.Key Responsibilities:Collaborate with...

  • Data Engineer Lead

    6 days ago

    Chennai, Tamil Nadu, India Encora Inc. Full time

    About the RoleWe are seeking a highly skilled Data Engineer Lead to join our team at Encora Inc. in Chennai. As a Data Engineer Lead, you will be responsible for designing and implementing scalable solutions for ever-increasing data volumes, using big data/cloud technologies like Pyspark, Kafka, etc.Key ResponsibilitiesCollaborate with cross-functional teams...

  • Data Engineering Lead

    21 hours ago

    Chennai, Tamil Nadu, India Encora Inc. Full time

    About the RoleWe are seeking a highly skilled Data Engineering Lead to join our team at Encora. As a Data Engineering Lead, you will be responsible for designing and implementing scalable solutions for ever-increasing data volumes, using big data/cloud technologies like Pyspark, Kafka, etc.Key ResponsibilitiesCollaborate with cross-functional teams to...

  • Data Engineer Lead

    21 hours ago

    Chennai, Tamil Nadu, India UnitedHealth Group Full time

    At UnitedHealth Group, we're committed to helping people live healthier lives and making the health system work better for everyone. As a Data Engineer Lead, you'll play a critical role in designing and building data pipelines to process terabytes of data, ensuring that our systems are scalable and efficient. You'll work closely with our team to orchestrate...

  • Data Engineering Lead

    6 days ago

    Chennai, Tamil Nadu, India Sutherland Global Full time

    Role OverviewWe are seeking an experienced and motivated Data Engineer to lead our dynamic team. The ideal candidate will have a strong background in data engineering, with a focus on SQL, data warehousing, and AWS technologies.The successful candidate will be responsible for leading the design, development, and implementation of scalable data solutions that...

  • Lead Data Engineer

    6 days ago

    Chennai, Tamil Nadu, India Sutherland Global Full time

    About the RoleWe are seeking an experienced and motivated Lead Data Engineer to join our dynamic team at Sutherland Global. The ideal candidate will have a strong background in data engineering, with a focus on SQL, data warehousing, and AWS technologies.Key Responsibilities:Data Engineering Leadership:Lead the development and maintenance of data pipelines...

  • Data Engineer Lead

    6 days ago

    Chennai, Tamil Nadu, India Gainwell Technologies Full time

    About the RoleWe are seeking a highly skilled Data Engineer to join our data analytics team at Gainwell Technologies. As a key member of our team, you will have the opportunity to work on designing, developing, and deploying data pipelines using Apache Spark and AWS.Your Key ResponsibilitiesDesign and develop data pipelines, including ETL processes, to...

  • Data Engineering Lead

    6 days ago

    Chennai, Tamil Nadu, India Databricks Full time

    Job Title: Solutions ArchitectAs a Solutions Architect at Databricks, you will play a key role in helping our customers overcome their big data challenges using our platform. You will work closely with customers on short to medium-term engagements, providing data engineering, data science, and cloud technology projects that require integrating with client...

  • Data Engineering Lead

    2 days ago

    Chennai, Tamil Nadu, India WLEN WORLDJOBS LLP Full time

    About ClientWLEN WORLDJOBS LLP is a global leader in professional services and solutions at the forefront of AI data engineering and cloud technologies. With their distributed team of over 500 analytics professionals across North America, Europe, and Asia, they are dedicated to enabling global enterprises to transform and innovate through the power of AI...

  • Senior/Lead Data Engineer

    3 weeks ago

    Chennai, Tamil Nadu, India Resourcetree Full time

    Job Description : We are seeking a highly skilled Senior Lead Data Engineer to oversee the design, development, and optimization of our data infrastructure and integration processes. This role requires extensive experience in data engineering, leadership abilities, and proficiency in modern data technologies. Join us to drive innovation and lead a dynamic...

  • Data Engineering Lead

    3 days ago

    Chennai, Tamil Nadu, India UPS India Full time

    Explore your next opportunity at a Fortune Global 500 organization. Envision innovative possibilities, experience our rewarding culture, and work with talented teams that help you become better every day. We know what it takes to lead UPS into tomorrow—people with a unique combination of skill + passion. If you have the qualities and drive to lead yourself...

  • Digital Engineering Lead

    6 days ago

    Chennai, Tamil Nadu, India NTT DATA Services Full time

    Key ResponsibilitiesRoles and Responsibilities:Design and develop machine learning systems that meet business needs.Research and implement cutting-edge machine learning algorithms and tools to drive business growth.Select and prepare relevant data sets for analysis.Identify and address data distribution differences that impact model performance.Verify data...

  • Digital Engineering Lead

    6 days ago

    Chennai, Tamil Nadu, India NTT DATA Services Full time

    Key Responsibilities:Roles and Responsibilities:Design and Develop ML Systems: Create and implement machine learning systems that meet business requirements.Research and Implement ML Algorithms: Research and implement various machine learning algorithms and tools to improve model performance.Data Set Selection and Preparation: Select and prepare appropriate...

  • Senior Engineering Leader

    4 days ago

    Chennai, Tamil Nadu, India Crayon Data Full time

    Senior Engineering LeaderCrayon Data is a leading provider of AI-led revenue acceleration solutions, headquartered in Singapore with a local presence in India and the UAE. We are seeking a Senior Engineering Leader to join our team and drive the development of our flagship platform, maya.ai.About the RoleWe are looking for a highly skilled and experienced...