Lead Data Engineer

2 days ago

Chennai, Tamil Nadu, India Cynosure Corporate Solutions Full time ₹ 12,00,000 - ₹ 36,00,000 per year

About The Role
We are seeking a highly skilled and experienced Senior / Lead Data Engineer to design, develop, and maintain scalable, reliable, and efficient data pipelines and ETL solutions. The role requires strong expertise across multi-cloud environments, modern data warehousing platforms, programming languages, and data orchestration tools. You will play a pivotal role in transforming raw data into actionable insights, ensuring data quality, and enabling analytics and reporting initiatives across the organization.

Responsibilities

  • Design, build, and optimize complex ETL/ELT data pipelines using Python, PySpark, Scala, and advanced SQL.
  • Implement and manage ETL processes using Informatics PowerCenter, Data bricks, AWS Glue, and Snowflake.
  • Develop and deploy scalable data solutions across AWS, Azure, GCP, and Microsoft Fabric using cloud-native services.
  • Manage and optimize databases including Redshift, SQL Server, and AWS RDS.
  • Orchestrate and monitor data workflows with Apache Airflow to ensure reliable and timely delivery.
  • Implement streaming solutions with Apache Kafka and containerized services with Kubernetes.
  • Automate data workflows and system monitoring using Unix shell scripting.
  • Apply CI/CD practices to data pipelines and enforce Data Clean room principles for privacy-compliant collaboration.
  • Collaborate with BI/reporting teams to deliver optimized datasets for Tableau, Looker, and PowerBI.
  • Troubleshoot and resolve performance issues in pipelines and database queries.
  • Maintain detailed technical documentation and collaborate closely with cross-functional teams.

Requirements

  • Bachelor's or Master's degree in Computer Science, Engineering, Information Technology, or related field.
  • 10+ years of experience as Data Engineer.
  • Languages: Proficiency in SQL, Python (including PySpark), Scala, and Unix Shell Scripting.
  • ETL Tools: Hands-on experience with Informatics PowerCenter, Data bricks, and AWS Glue.
  • Data Warehousing: Expertise in Snowflake and Redshift.
  • Cloud Platforms: Strong exposure to at least two of AWS, Azure, GCP; familiarity with Microsoft Fabric.
  • Databases: Solid knowledge of Redshift, SQL Server, and AWS RDS.
  • Orchestration: Proven experience with Apache Airflow.
  • Streaming & Containerization: Practical experience with Apache Kafka and Kubernetes.
  • Concepts: Working knowledge of CI/CD pipelines and Data Clean room practices.
  • Reporting Tools: Understanding of data provisioning for Tableau, Looker, or PowerBI.
  • Strong problem-solving skills, communication ability, and a proactive approach to emerging technologies.

  • Lead Data Engineer

    3 hours ago

    Chennai, Tamil Nadu, India Eucloid Data Solutions Full time ₹ 12,00,000 - ₹ 36,00,000 per year

    Eucloid is looking for a Lead Data Engineer to join our Data Platform team supporting various business applications. The ideal candidate will support the development of data infrastructure for our clients by participating in activities that may include starting from upstream and downstream technology selection to designing and building different components....

  • Data Engineer

    10 hours ago

    Chennai, Tamil Nadu, India CX Data Labs Full time ₹ 9,00,000 - ₹ 12,00,000 per year

    HiRole - Azure Data engineerLocation - Chennai, GurugramWork from officeFull timeImmediate joiner Only (15days Notice period only)Candidates with Certification in Databricks is good to haveTechnical Skills:o Proficiency in SQL for complex queries, database design, and optimization.o Strong experience with PySpark for data transformation and processing.o...

  • Data Engineer

    4 hours ago

    Chennai, Tamil Nadu, India CX Data Labs Full time ₹ 15,00,000 - ₹ 25,00,000 per year

    HiRole - Azure Data EngineerLocation - Chennai, Gurugram (5days Office)Full timeShift timing 2pm to 11pmKey Responsibilities:· Develop, maintain, and optimize scalable ETL/ELT pipelines using PySpark and Databricks.· Collaborate with cross-functional teams to design and implement data models and data integration solutions.· Create and maintain robust SQL...

  • Lead Data Engineer

    6 hours ago

    Chennai, Tamil Nadu, India SquareShift Full time ₹ 12,00,000 - ₹ 36,00,000 per year

    Lead Data Engineer - Job DescriptionOverviewWe are seeking a highly skilled Lead Data Engineer to architect, build, and scale enterprise-grade data platforms and pipelines. The ideal candidate has deep expertise in modern data engineering, cloud-native services, real-time data ingestion & CDC frameworks. This role involves leading complex data initiatives,...

  • Lead Data Engineer

    7 days ago

    Chennai, Tamil Nadu, India Alans Group Full time ₹ 20,00,000 - ₹ 25,00,000 per year

    The Role:As a Lead Data Engineer, you will be responsible for designing, building, and maintaining scalable data pipelines and architectures. You will lead a team of data engineers and collaborate with data scientists and analysts to ensure data is accessible and usable across the organization.Design and implement robust data pipelines for data ingestion and...

  • Lead Data Engineer

    6 hours ago

    Chennai, Tamil Nadu, India SquareShift Technologies Full time ₹ 12,00,000 - ₹ 36,00,000 per year

    Job InformationDate Opened11/24/2025Job TypeFull timeIndustryTechnologyWork Experience5+CityChennaiState/ProvinceTamil NaduCountryIndiaZip/Postal Code600001Job DescriptionLead Data Engineer - Job DescriptionOverviewWe are seeking a highly skilled Lead Data Engineer to architect, build, and scale enterprise-grade data platforms and pipelines. The ideal...

  • Lead Data Engineer

    5 hours ago

    Chennai, Tamil Nadu, India Augusta HiTech Software Full time ₹ 12,00,000 - ₹ 24,00,000 per year

    Industry: ITQualification: Any DegreeRequired Skills: Data Architect, AWS Redshift, Glue, Quicksight, SQL, PythonWorking Shift: 2PM to 11PM ISTCity: Coimbatore / Chennai / BangaloreCountry: IndiaName of the position: Lead Data EngineerLocation: Coimbatore/ Chennai/ BangaloreNo. of resources needed: 01Mode: Contract to HireYears of experience: 10+ YearsShift:...

  • Lead Data Engineer

    2 weeks ago

    Chennai, Tamil Nadu, India BrandIdea Granular Analytics Platform Full time ₹ 20,00,000 - ₹ 25,00,000 per year

    Lead Data Engineer – Python EcosystemChennai, India | HybridWe're growing our technology team atBrandIdea Analytics— a pioneer in spatial and behavioral analytics that helps businesses see their markets in entirely new ways. If you're passionate about building data platforms from the ground up and leading with Python, this is your opportunity to shape...

  • Lead Data Engineer

    1 week ago

    Chennai, Tamil Nadu, India ResourceTree Global Services Pvt Ltd Full time ₹ 12,00,000 - ₹ 36,00,000 per year

    Company DescriptionResourceTree Global Services Pvt Ltd. (ResourceTree) is a Talent Builder focused on offering careers in various industries, including Information & Technology, Manufacturing, Services, Banking, Agri-tech, Edu-tech, and others. The company collaborates with industry Leaders to fulfill their talent needs effectively. Over the past 7 years,...

  • Lead Data Engineer

    1 week ago

    Chennai, Tamil Nadu, India Forbes Technologies Full time ₹ 8,00,000 - ₹ 24,00,000 per year

    Company DescriptionForbes Advisor is a new initiative for consumers under the Forbes Marketplace umbrella that provides journalist- and expert-written insights, news and reviews on all things personal finance.We are an experienced team of industry experts dedicated to helping readers make smart decisions and choose the right products with ease. Marketplace...