Lead Data Engineer

7 days ago


ChennaiBangalorePuneHyderabad, India SMARTWORK IT SERVICES Full time

Job Title : Data Engineer Lead

Location : Chennai, Bangalore, Pune, Hyderabad

Experience : 8-10 Years

Skills Required : SQL, Data Modelling, Python

Job Description :

We are seeking an experienced and highly skilled Data Engineer Lead to join our growing team. In this role, you will lead data engineering initiatives, utilizing your expertise in data modeling, Python, and SQL to design and implement efficient data pipelines and systems.

You will work closely with cross-functional teams, including data scientists, analysts, and business stakeholders, to ensure that high-quality data is available for analysis and decision-making.

Key Responsibilities :

- Lead Data Engineering Projects : Oversee the design, development, and implementation of robust, scalable, and efficient data pipelines, ensuring smooth data flow from various sources to data warehouses and lakes.

- Data Modeling : Develop and optimize data models (logical and physical), ensuring they support business analytics and reporting needs.

- Design relational, dimensional, and NoSQL models for efficient querying and analysis.

- Team Leadership : Lead, mentor, and guide a team of data engineers, providing technical expertise, setting best practices, and ensuring the team's success in meeting project objectives and deadlines.

- Database Management : Use SQL to write complex queries and optimize database performance.

- Work with relational and non-relational databases to ensure data is stored, processed, and retrieved efficiently.

- Automation & Optimization : Leverage Python for automating data-related tasks, including data extraction, transformation, and loading (ETL) processes.

- Optimize existing data pipelines for better performance and lower costs.

Requirements :

- Education : Bachelor's or Master's degree in Computer Science, Engineering, Data Science, or a related field.

- Experience : 8+ years of experience in data engineering, with at least 8 years in a leadership or senior technical role.

Technical Skills :

- Expertise in Python for data engineering tasks, including building ETL pipelines, data processing, and automation.

- Strong proficiency in SQL for data manipulation, query optimization, and database management.

- Solid experience with data modeling techniques for relational, dimensional, and NoSQL databases.

- Experience with cloud platforms (AWS, Azure, Google Cloud) and relevant data engineering services (i.e., Redshift, BigQuery, Data Lake, S3).

- Familiarity with data warehousing and data lake architectures, ensuring data integration across systems.

- Experience with data pipeline orchestration tools (eApache Airflow, Luigi, Prefect) for automating workflows.

Tools & Technologies :

- Hands-on experience with data processing frameworks like Apache Spark, Hadoop, or similar big data technologies.

- Experience with data storage and query technologies such as MySQL, PostgreSQL, Snowflake, MongoDB, and others.

- Familiarity with version control systems like Git.

- Exposure to Docker, Kubernetes, or similar containerization/orchestration tools

(ref:hirist.tech)

  • Chennai/Bangalore/Pune/Hyderabad, India SMARTWORK IT SERVICES Full time

    About the RoleSMARTWORK IT SERVICES is seeking an experienced Data Engineer Lead to lead our data engineering initiatives. In this role, you will oversee the design, development, and implementation of robust, scalable, and efficient data pipelines.Key Responsibilities:Design and develop data models that support business analytics and reporting needs.Lead a...


  • Pune, Maharashtra, India Optimum Data Analytics Full time

    About UsAt Optimum Data Analytics, we help clients transform and realize their digital strategies through our unique Experience Centric Transformation approach.We deliver ground-breaking solutions in the space of mobile, cloud, and design, with an emphasis on excellent design skills that bring value to every project.Key ResponsibilitiesDesign and implement...

  • Data Engineer Lead

    7 days ago


    Bangalore/Hyderabad, India Response Informatics Limited Full time

    Company Overview">Response Informatics Limited is a leading provider of data engineering services. Our team of experts helps clients unlock the full potential of their data by designing and implementing scalable, efficient, and secure data pipelines.">Job Description">We are seeking an experienced Data Engineer to join our team. As a key member of our data...

  • Data Engineer

    4 weeks ago


    Chennai, Tamil Nadu, India NTT DATA Full time

    Job Description Req ID: 303790 NTT DATA strives to hire exceptional, innovative and passionate individuals who want to grow with us. If you want to be part of an inclusive, adaptable, and forward-thinking organization, apply now.We are currently seeking a Data Engineer to join our team in Chennai, Tamil Nādu (IN-TN), India (IN).Job Duties: As a data...


  • Bangalore/Hyderabad, India Gyansys Infotech Pvt ltd. Full time

    Job DescriptionWe are seeking a skilled Cloud Data Engineering Lead to join our team at Gyansys Infotech Pvt Ltd.As a key member of our data engineering team, you will be responsible for designing, developing, and maintaining ETL pipelines using Azure Databricks, PySpark, and ADF.You will work closely with cross-functional teams to support data analytics,...

  • Lead Engineer

    4 weeks ago


    Pune, Maharashtra, India NTT DATA Full time

    Req ID 286871NTT DATA Services strives to hire exceptional innovative and passionate individuals who want to grow with us If you want to be part of an inclusive adaptable and forward-thinking organization apply now We are currently seeking a Lead Engineer to join our team in Pune Mah xc4 x81r xc4 x81shtra IN-MH India IN Responsibilities 1 ...

  • Lead Engineer

    1 week ago


    Pune, Maharashtra, India NTT DATA Full time

    Req ID 280076NTT DATA Services strives to hire exceptional innovative and passionate individuals who want to grow with us If you want to be part of an inclusive adaptable and forward-thinking organization apply now We are currently seeking a Lead Engineer to join our team in Remote Mah xc4 x81r xc4 x81shtra IN-MH India IN esponsibilities 1 ...


  • Chennai/Bangalore/Pune/Hyderabad, India SMARTWORK IT SERVICES Full time

    Leading Data Engineering InitiativesSMARTWORK IT SERVICES is looking for a seasoned Data Engineer Lead to lead our data engineering initiatives. You will be responsible for designing, developing, and implementing robust, scalable, and efficient data pipelines and systems.Responsibilities:Design and develop data models that support business analytics and...

  • Data Engineer

    4 weeks ago


    Chennai, Tamil Nadu, India NTT DATA Services Full time

    Req ID: 303790 NTT DATA strives to hire exceptional, innovative and passionate individuals who want to grow with us. If you want to be part of an inclusive, adaptable, and forward-thinking organization, apply now.We are currently seeking a Data Engineer to join our team in Chennai, Tamil Nādu (IN-TN), India (IN).Job Duties: As a data engineer you will...


  • Pune, Maharashtra, India NTT DATA Full time

    Req ID 296847NTT DATA strives to hire exceptional innovative and passionate individuals who want to grow with us If you want to be part of an inclusive adaptable and forward-thinking organization apply now We are currently seeking a Digital Engineering Lead Engineer to join our team in Pune Mah xc4 x81r xc4 x81shtra IN-MH India IN Once You Are...


  • Hyderabad/Bangalore, India SMARTWORK IT SERVICES Full time

    ResponsibilitiesThe Senior GCP Data Engineer will be responsible for:Designing, developing, and implementing large-scale data engineering solutions using GCP services.Collaborating with cross-functional teams to analyze requirements, design, development, and deployment of technical solutions.Analyzing different source systems, profiling data, understanding,...

  • AI Engineering Lead

    7 days ago


    Bangalore/remote, India Aptus Data Labs Full time

    Aptus Data Labs seeks a seasoned Artificial Intelligence Engineering professional to lead the development and implementation of cutting-edge AI models. As an experienced AI Engineer, you will spearhead cross-functional teams to design and deliver tailored AI solutions that drive business growth.Key Responsibilities:Design and Implement AI Models: Develop and...

  • Data Engineer

    12 hours ago


    Chennai, Tamil Nadu, India Quantrail Data Full time

    Location: Chennai, India (On-site)Duration: 6 monthsStipend: UnpaidEligibility: Open to 2025 graduatesConversion: Opportunity for a full-time role based on performance Note: Please apply only if you are serious about joining us. This is a learning-focused internship, and we expect interns to be committed to upskilling themselves and contributing to...


  • Hyderabad, Telangana, India data Remote Work Freelance Full time

    What can you tell your friends when they ask you what you do? We're looking for an experienced Big Data Engineer who can create innovative new products in the analytics and data space. You will participate in the development that creates the world's #1 mobile app analytics service. Together with the team, you will build out new product features and...


  • Chennai, Tamil Nadu, India NTT DATA Full time

    Req ID 292803NTT DATA Services strives to hire exceptional innovative and passionate individuals who want to grow with us If you want to be part of an inclusive adaptable and forward-thinking organization apply now We are currently seeking a Digital Engineering Lead Engineer to join our team in Chennai Tamil N xc4 x81du IN-TN India IN Flutter...


  • Hyderabad, Telangana, India data Remote Work Freelance Full time

    What can you tell your friends when they ask you what you do? "As a Data Analyst at data.ai, I help analyze, monitor, and deliver comprehensive and high-quality app market data to app professionals. I am empowered to work independently with the support of team members spread across APAC, AMER, and EMEA. I am the key contributor to the new and existing...

  • Lead Engineer

    2 weeks ago


    Hyderabad, Telangana, India NTT DATA Services Full time

    Req ID: 318513 NTT DATA strives to hire exceptional, innovative and passionate individuals who want to grow with us. If you want to be part of an inclusive, adaptable, and forward-thinking organization, apply now.We are currently seeking a Lead Engineer to join our team in Hyderabad, Telangana (IN-TG), India (IN)."Job Description – Support Engineer (Data...

  • Data Engineer Lead

    3 days ago


    Pune/Bangalore/Gurgaon/Gurugram/Hyderabad, India EXL Full time

    Company Overview">At EXL, we are seeking a highly skilled Data Engineer Lead to join our team. As a key member of our data engineering group, you will be responsible for designing, developing, and maintaining large-scale data pipelines using AWS services such as Glue, Lambda, S3, and Redshift.">Job Description">The ideal candidate will have in-depth...


  • Pune, Maharashtra, India NTT DATA Full time

    Job Description Req ID: 305224 NTT DATA strives to hire exceptional, innovative and passionate individuals who want to grow with us. If you want to be part of an inclusive, adaptable, and forward-thinking organization, apply now.We are currently seeking a Digital Engineering Lead Engineer to join our team in Pune, Mahārāshtra (IN-MH), India (IN).Sr. Java...

  • Senior Data Engineer

    4 weeks ago


    Hyderabad, Telangana, India Enable Data Incorporated Full time

    Enable Data Incorporated is seeking a highly skilled Senior Data Engineer with expertise in cloud technologies, Spark, and Databricks to join our dynamic team. As a leading provider of advanced application, data, and cloud engineering services, we leverage modern solutions to drive increased value across our clients' business ecosystem.As a Senior Data...