Lead Data Engineer

2 weeks ago

Chennai, Tamil Nadu, India Neoware Technology Solutions Full time

Description
Requirements :

  • 8+ years of hands-on experience in delivering data engineering solutions
  • Experience leading a team of 5+ team members, responsible for technical project management including stakeholder management, design review, code reviews and mentoring
  • Strong hands-on experience in Microsoft Azure platform, with experience in data engineering related services and technologies including Azure Data Factory, Azure Functions, Azure Databricks, Azure Synapse Analytics, Azure Event Hub, Azure Stream Analytics and Azure Data Lake Storage
  • Expertise in database concepts, SQL and relational modelling
  • Experience establishing reference data management and data quality practices at enterprise scale
  • Good understanding and experience working with NoSQL databases
  • Strong hands-on experience in implementing data pipelines using Python and PySpark
  • Good understanding of data lake and data warehouse concepts, modern data architecture patterns and industry trends in data engineering space
  • Hands-on experience in data modelling, with a good understanding of both ER modelling and dimensional modelling
  • Good understanding and experience implementing data quality management solutions
  • Good understanding of metadata management for data engineering solutions and data platforms
  • Good understanding of data governance concepts including data stewardship, data security and data privacy management
  • Experience with version control tools like Git for managing version control for source code
  • Experience with DevOps processes, including experience implementing CI/CD pipelines for data engineering solution components
  • Strong analytical and problem-solving skills
  • Excellent communication and collaboration skills

Responsibilities

  • Lead technical architecture and design efforts for data engineering solution components for delivering business solutions
  • Design and implement scalable, secure and resilient data engineering solutions on Microsoft Azure platform, with a good understanding of data architecture patterns
  • Evaluate and select appropriate technology stack for data engineering solution components cloud native services, open-source tools, data storage, data processing frameworks etc.
  • Lead, mentor and manage a team of dynamic data engineers for development, testing and implementation of data pipelines ensuing quality, performance and on-time delivery
  • Responsible for detailed technical design and data mapping specification
  • Ensure adherence to industry best practices, coding standards and guidelines driving continuous improvement in code quality and delivery excellence
  • Optimize data solutions for performance, cost-efficiency and scalability
  • Ensure data quality and integrity for downstream systems and applications
  • Plan, prioritize and manage data engineering projects, ensuring timely delivery with quality
  • Identify and mitigate risks, troubleshoot issues, handle customer escalations
  • Ensure alignment with business requirements and priorities, working closely with stakeholders both internal and customer
  • Maintain comprehensive technical documentation, including architecture diagrams, high level / low level data integration design, data mapping specifications, database design etc.
  • Working closely with peers, BI engineers and data scientists to enable advanced analytics, machine learning models and reporting solutions

)

  • Senior Associate Data Engineer

    2 hours ago

    Chennai, Tamil Nadu, India NTT DATA Full time

    Make an impact with NTT DATAJoin a company that is pushing the boundaries of what is possible. We are renowned for our technical excellence and leading innovations, and for making a difference to our clients and society. Our workplace embraces diversity and inclusion – it's a place where you can grow, belong and thrive.Your day at NTT DATAThe Senior...

  • Lead Data Engineer

    6 days ago

    Chennai, Tamil Nadu, India Alans Group Full time

    The Role:As a Lead Data Engineer, you will be responsible for designing, building, and maintaining scalable data pipelines and architectures. You will lead a team of data engineers and collaborate with data scientists and analysts to ensure data is accessible and usable across the organization.Design and implement robust data pipelines for data ingestion and...

  • Lead Data Engineer

    1 week ago

    Chennai, Tamil Nadu, India Neoware Technology Solutions Full time

    DevelopmentLead Data Engineer (Azure) Requirements6+ years of hands-on experience in delivering data engineering solutionsExperience leading a team of 5+ team members, responsible for technical project management including stakeholder management, design review, code reviews and mentoringStrong hands-on experience in Microsoft Azure platform, with experience...

  • Lead Data Engineer

    2 weeks ago

    Chennai, Tamil Nadu, India BrandIdea Granular Analytics Platform Full time

    Lead Data Engineer – Python EcosystemChennai, India | HybridWe're growing our technology team atBrandIdea Analytics— a pioneer in spatial and behavioral analytics that helps businesses see their markets in entirely new ways. If you're passionate about building data platforms from the ground up and leading with Python, this is your opportunity to shape...

  • Lead Data Engineer

    1 week ago

    Chennai, Tamil Nadu, India Forbes Advisor Full time

    Company DescriptionForbes Advisor is a new initiative for consumers under the Forbes Marketplace umbrella that provides journalist- and expert-written insights, news and reviews on all things personal finance.We are an experienced team of industry experts dedicated to helping readers make smart decisions and choose the right products with ease. Marketplace...

  • Tech Lead Data Engineering

    2 weeks ago

    Chennai, Tamil Nadu, India JP Techno Park Full time

    Job Title:      Tech Lead Data Engineering (DBT)Location:      Chennai (On-Site)Experience:    7+ YearsPosition Type: Full-TimeShift Timings: PMSkillset: Data Engineering, ETL Pipelines, DBT (Data Build Tool / Data Built Tool), Python, SQLAbout the Role: We are seeking an experienced Data Engineering Lead (DBT Tech Lead) to design,...

  • Senior Data Engineer

    2 weeks ago

    Chennai, Tamil Nadu, India Eucloid Data Solutions Full time

    Senior Data Engineer - ChennaiAbout The Role:Eucloid is looking for a Senior Data Engineer to join our Data Platform team supporting various business applications. The ideal candidate will support development of data infrastructure for our clients by participating in activities which may include starting from up- stream and down-stream technology selection...

  • Azure Lead Data Engineer

    1 week ago

    Chennai, Tamil Nadu, India ResourceTree Global Services Pvt Ltd Full time

    Job Name: Lead Data Engineer (Azure Databricks)Years of Experience: 7Job Description:The Lead Data Engineer will take ownership of engineering, enhancement, and continuous evolution initiatives for the modernized Data Analytics and Reporting framework. The role involves driving end-to-end delivery for data engineering projects, coordinating cross-functional...

  • Data Engineer Lead

    4 hours ago

    Chennai, Tamil Nadu, India Barclays Full time

    Join us as a Data Engineer Lead at Barclays, where you'll take part in the evolution of our digital landscape, driving innovation and excellence. You'll harness cutting-edge technology to revolutionize our digital offerings, ensuring unparalleled customer experiences. As a part of the team, you will deliver technology stack, using strong analytical and...

  • Data Centre Remote Technical Support Engineer

    6 days ago

    Chennai, Tamil Nadu, India NTT DATA Full time

    Make an impact with NTT DATAJoin a company that is pushing the boundaries of what is possible. We are renowned for our technical excellence and leading innovations, and for making a difference to our clients and society. Our workplace embraces diversity and inclusion – it's a place where you can grow, belong and thrive.Your day at NTT DATAThe Data Centre...