Lead Data Engineer

4 weeks ago

Chennai, India Cynosure Corporate Solutions Full time

Description :About The Role :We are seeking a highly skilled and experienced Senior / Lead Data Engineer to design, develop, and maintain scalable, reliable, and efficient data pipelines and ETL solutions.The role requires strong expertise across multi-cloud environments, modern data warehousing platforms, programming languages, and data orchestration tools.You will play a pivotal role in transforming raw data into actionable insights, ensuring data quality, and enabling analytics and reporting initiatives across the :- Design, build, and optimize complex ETL/ELT data pipelines using Python, PySpark, Scala, and advanced SQL.- Implement and manage ETL processes using Informatica PowerCenter, Databricks, AWS Glue, and Snowflake.- Develop and deploy scalable data solutions across AWS, Azure, GCP, and Microsoft Fabric using cloud-native services.- Manage and optimize databases, including Redshift, SQL Server, and AWS RDS.- Orchestrate and monitor data workflows with Apache Airflow to ensure reliable and timely delivery.- Implement streaming solutions with Apache Kafka and containerized services with Kubernetes.- Automate data workflows and system monitoring using Unix shell scripting.- Apply CI/CD practices to data pipelines and enforce Data Cleanroom principles for privacy-compliant collaboration.- Collaborate with BI/reporting teams to deliver optimized datasets for Tableau, Looker, and Power BI.- Troubleshoot and resolve performance issues in pipelines and database queries.- Maintain detailed technical documentation and collaborate closely with cross-functional Bachelor's or master's degree in Computer Science, Engineering, Information Technology, or a related field.- Experience: 5+ years for Senior Data Engineer, 8+ years for Lead Data Engineer.- Languages: Proficiency in SQL, Python (including PySpark), Scala, and Unix Shell Scripting.- ETL Tools: Hands-on experience with Informatica PowerCenter, Databricks, and AWS Glue.- Data Warehousing: Expertise in Snowflake and Redshift.- Cloud Platforms: Strong exposure to at least two of AWS, Azure, and GCP; familiarity with Microsoft Fabric.- Databases: Solid knowledge of Redshift, SQL Server, and AWS RDS.- Orchestration: Proven experience with Apache Airflow.- Streaming Containerization: Practical experience with Apache Kafka and Kubernetes.- Concepts: Working knowledge of CI/CD pipelines and Data Cleanroom practices.- Reporting Tools: Understanding of data provisioning for Tableau, Looker, or Power BI.- Strong problem-solving skills, communication ability, and a proactive approach to emerging technologies. (ref:hirist.tech)

  • Lead Data Engineer

    1 week ago

    Chennai, Tamil Nadu, India Eucloid Data Solutions Full time ₹ 12,00,000 - ₹ 36,00,000 per year

    Eucloid is looking for a Lead Data Engineer to join our Data Platform team supporting various business applications. The ideal candidate will support the development of data infrastructure for our clients by participating in activities that may include starting from upstream and downstream technology selection to designing and building different components....

  • Lead Data Engineer

    4 days ago

    Chennai, Tamil Nadu, India AABM Cloud Data Solutions Full time ₹ 12,00,000 - ₹ 18,00,000 per year

    About the RoleWe are seeking a Lead Data Engineer to join our team. In this role, you will be crucial in designing, building, and maintaining our data infrastructure. This is a hands-on position requiring a strong foundation in data warehousing, ETL processes, and database management. The ideal candidate will have a keen eye for detail and the ability to...

  • Data Engineer

    6 days ago

    Chennai, Tamil Nadu, India Crayon Data Full time ₹ 5,00,000 - ₹ 15,00,000 per year

    Data Engineer – Chennai Build the foundation of data intelligence — design, develop, and optimize data pipelines that power AI-driven insights. Location: Chennai, India Experience: 2–3 years in data engineering or data-driven product development Role Overview As a Data Engineer, you will be responsible for building and...

  • Data Engineer

    6 days ago

    Chennai, Tamil Nadu, India CX Data Labs Full time ₹ 15,00,000 - ₹ 25,00,000 per year

    HiRole - Azure Data EngineerLocation - Chennai, Gurugram (5days Office)Full timeShift timing 2pm to 11pmKey Responsibilities:· Develop, maintain, and optimize scalable ETL/ELT pipelines using PySpark and Databricks.· Collaborate with cross-functional teams to design and implement data models and data integration solutions.· Create and maintain robust SQL...

  • Lead Data Engineer

    11 hours ago

    Chennai, Tamil Nadu, India ResourceTree Global Services Pvt Ltd Full time ₹ 20,00,000 - ₹ 25,00,000 per year

    Company DescriptionResourceTree Global Services Pvt Ltd. (ResourceTree) is a Talent Builder dedicated to offering careers to professionals across various industries, including Information & Technology, Manufacturing, Services, Banking, Agri-tech, and Edu-tech. ResourceTree has earned a reputation for helping industry leaders transform their talent needs into...

  • Lead Data Engineer

    6 days ago

    Chennai, Tamil Nadu, India Augusta HiTech Software Full time ₹ 12,00,000 - ₹ 24,00,000 per year

    Industry: ITQualification: Any DegreeRequired Skills: Data Architect, AWS Redshift, Glue, Quicksight, SQL, PythonWorking Shift: 2PM to 11PM ISTCity: Coimbatore / Chennai / BangaloreCountry: IndiaName of the position: Lead Data EngineerLocation: Coimbatore/ Chennai/ BangaloreNo. of resources needed: 01Mode: Contract to HireYears of experience: 10+ YearsShift:...

  • Data Engineer

    6 days ago

    Chennai, Tamil Nadu, India AABM Cloud Data Solution Full time ₹ 20,00,000 - ₹ 25,00,000 per year

    We are seeking a Senior Data Engineer with10+ yearsof experience to join our team.Required Qualifications10+ years of experience in data engineering or similar role.Hands on experience in snowflake, SSIS, Python ( including NumPy and Pandas) is mandatory.Expertise in SQL and any cloud environment (AWS & Azure, etc.) is mandatory.Proficiency in mordern BI...

  • Lead Data Engineer

    2 weeks ago

    Chennai, Tamil Nadu, India ResourceTree Global Services Pvt Ltd Full time ₹ 1,20,000 - ₹ 3,00,000 per year

    Job Description : We are seeking a highly skilled and motivated Lead Data Engineer to join our Data Integration and Analytics team. The ideal candidate will bring deep expertise in AWS Redshift, with strong knowledge of Redshift architecture, query performance tuning, and workload optimization. You will be responsible for leading the design, development,...

  • Lead data engineer

    4 weeks ago

    Chennai, India Guidanz Inc Full time

    About BI ConnectorBI Connector is the industry leading solution for integrating Oracle Fusion Cloud data into modern BI platforms like Power BI, Tableau, and Data Warehouse, without complex ETL. Our Data Architecture and Reporting Solutions team extends this mission by helping enterprises unlock the full value of their Oracle Fusion ERP, SCM, HCM data...

  • Lead Data Engineer

    4 days ago

    Chennai, Tamil Nadu, India Forbes Advisor Full time ₹ 12,00,000 - ₹ 36,00,000 per year

    Company Description Forbes Advisor is a new initiative for consumers under the Forbes Marketplace umbrella that provides journalist- and expert-written insights, news and reviews on all things personal finance.We are an experienced team of industry experts dedicated to helping readers make smart decisions and choose the right products with ease. Marketplace...