Lead Data Engineer

2 weeks ago

Chennai, Tamil Nadu, India Cynosure Corporate Solutions Full time

About the Role :

We are seeking a highly skilled and experienced Senior / Lead Data Engineer to design, develop, and maintain scalable, reliable, and efficient data pipelines and ETL solutions. The role requires strong expertise across multi-cloud environments, modern data warehousing platforms, programming languages, and data orchestration tools. You will play a pivotal role in transforming raw data into actionable insights, ensuring data quality, and enabling analytics and reporting initiatives across the :

- Design, build, and optimize complex ETL/ELT data pipelines using Python, PySpark, Scala, and advanced SQL.

- Implement and manage ETL processes using Informatica PowerCenter, Databricks, AWS Glue, and Snowflake.

- Develop and deploy scalable data solutions across AWS, Azure, GCP, and Microsoft Fabric using cloud-native services.

- Manage and optimize databases, including Redshift, SQL Server, and AWS RDS.

- Orchestrate and monitor data workflows with Apache Airflow to ensure reliable and timely delivery.

- Implement streaming solutions with Apache Kafka and containerized services with Kubernetes.

- Automate data workflows and system monitoring using Unix shell scripting.

- Apply CI/CD practices to data pipelines and enforce Data Cleanroom principles for privacy-compliant collaboration.

- Collaborate with BI/reporting teams to deliver optimized datasets for Tableau, Looker, and Power BI.

- Troubleshoot and resolve performance issues in pipelines and database queries.

- Maintain detailed technical documentation and collaborate closely with cross-functional teams.

Qualifications :

- Bachelors or Masters degree in Computer Science, Engineering, Information Technology, or a related field.

- Experience : 5+ years for Senior Data Engineer, 8+ years for Lead Data Engineer.

- Languages : Proficiency in SQL, Python (including PySpark), Scala, and Unix Shell Scripting.

- ETL Tools : Hands-on experience with Informatica PowerCenter, Databricks, and AWS Glue.

- Data Warehousing : Expertise in Snowflake and Redshift.

- Cloud Platforms : Strong exposure to at least two of AWS, Azure, and GCP; familiarity with Microsoft Fabric.

- Databases : Solid knowledge of Redshift, SQL Server, and AWS RDS.

- Orchestration : Proven experience with Apache Airflow.

- Streaming & Containerization : Practical experience with Apache Kafka and Kubernetes.

- Concepts : Working knowledge of CI/CD pipelines and Data Cleanroom practices.

- Reporting Tools : Understanding of data provisioning for Tableau, Looker, or Power BI.

- Strong problem-solving skills, communication ability, and a proactive approach to emerging technologies.

(ref:hirist.tech)

  • Data Engineer

    2 weeks ago

    Chennai, Tamil Nadu, India CX Data Labs Full time ₹ 1,04,000 - ₹ 1,30,878 per year

    HiRole - Azure Data engineerLocation - Chennai, Gurugram (5days Onsite)Full timeImmediate joiner Only (15days Notice period only)Technical Skills:o Proficiency in SQL for complex queries, database design, and optimization.o Strong experience with PySpark for data transformation and processing.o Hands-on experience with Databricks for building and managing...

  • Data Engineer

    6 days ago

    Chennai, Tamil Nadu, India NTT DATA North America Full time ₹ 15,00,000 - ₹ 20,00,000 per year

    Req ID: NTT DATA strives to hire exceptional, innovative and passionate individuals who want to grow with us. If you want to be part of an inclusive, adaptable, and forward-thinking organization, apply now.We are currently seeking a Data Engineer - Azure to join our team in Chennai, Tamil Nādu (IN-TN), India (IN)."Job Duties: Key Responsibilities:•  ...

  • Data Engineering Lead

    2 weeks ago

    Chennai, Tamil Nadu, India beBeeDataEngineeringLead Full time ₹ 15,00,000 - ₹ 28,00,000

    Job Title: Data Engineering LeadJob Summary:As a highly experienced data engineering lead, you will be responsible for spearheading the development and implementation of modern data pipelines using Snowflake. This role requires strong technical leadership skills to mentor and guide junior team members.Required Skills and Qualifications:Expertise in...

  • data engineering lead

    3 weeks ago

    Chennai, Tamil Nadu, India Randstad Full time

    At least 5 years' experience as a Senior or Lead Data Engineer Proven and demonstratable experience of Python, AWS, and SQL/ Oracle Bachelor's honours degree preferably in computer science, or engineering field, or demonstrable technical experience in a related engineering discipline At least 3 years of ETL experience using flat files to transposed...

  • Data Engineering Lead

    1 week ago

    Chennai, Tamil Nadu, India beBeeDataEngineer Full time ₹ 13,80,147 - ₹ 24,45,294

    Key Responsibilities:We are seeking a highly skilled data engineer to lead the development and maintenance of robust data pipelines. The successful candidate will have a strong background in computer science and data engineering with experience working with Python, SQL, PySpark, and bash scripts.The ideal candidate will have 3+ years of experience in...

  • Lead Data Engineer

    2 weeks ago

    Chennai, Tamil Nadu, India Vijay Venkatesh ( Proprietor of Cynosure Corporate Solutions ) Full time

    Job DescriptionAbout the RoleWe are seeking a highly skilled and experienced Senior / Lead Data Engineer to design, develop, and maintain scalable, reliable, and efficient data pipelines and ETL solutions. The role requires strong expertise across multi-cloud environments, modern data warehousing platforms, programming languages, and data orchestration...

  • Data Engineering Lead

    2 weeks ago

    Chennai, Tamil Nadu, India beBeeDataEngineering Full time ₹ 22,00,000 - ₹ 23,00,000

    Data Engineering Lead PositionWe are seeking a highly skilled and experienced Data Engineering Lead to spearhead the development of a cutting-edge data ingestion framework.Key Responsibilities:Data Ingestion Framework Development:Achieve scalability by designing, developing, and maintaining an end-to-end data ingestion framework that efficiently extracts,...

  • Lead Data Engineer

    2 weeks ago

    Chennai, Tamil Nadu, India Ixceed Solutions Full time

    About the Role :We are seeking a highly skilled and experienced Lead Data Engineer/Scala Developer with strong hands-on expertise in Scala programming, Apache Spark, Databricks, Python, and PySpark. The ideal candidate will lead the design, development, and deployment of scalable big data solutions, working closely with cross-functional teams to deliver...

  • Data Engineering Lead

    2 weeks ago

    Chennai, Tamil Nadu, India beBeeDataEngineer Full time ₹ 18,96,000 - ₹ 25,20,000

    Data Engineering ExpertWe are seeking a seasoned Senior Data Engineer to lead the development of enterprise-grade data platforms. With expertise in building and scaling complex data architectures, this role is ideal for those with a strong background in ETL, Cloud, Data Warehousing, and Big Data ecosystems.Key Responsibilities:Design & Optimize Data...

  • Senior Data Engineer Lead

    2 weeks ago

    Chennai, Tamil Nadu, India beBeeDataEngineering Full time ₹ 1,00,00,000 - ₹ 1,50,00,000

    Position Summary:Senior Data Engineering ManagerWe are seeking an experienced Senior Data Engineering Manager to lead our data engineering team in designing, building, and maintaining scalable data platforms for the healthcare domain.Primary Responsibilities: