Lead Data Engineer

2 weeks ago

Thiruvananthapuram, India CloudQ IT Services Full time

Role Overview :

The Lead Data Engineer will design, implement, and maintain data solutions on Microsoft Azure and SQL Server platforms. You will lead a team of data engineers, collaborate with stakeholders, and ensure efficient data processing, storage, and retrieval.

Technical Responsibilities :

- Design and maintain scalable data pipelines.

- Create solutions using Azure Data Factory and Databricks for ETL processes.

- Develop solutions in SSIS.

- Analyze and optimize the existing data landscape for efficiency and scalability.

- Collaborate with onshore counterparts to address technical gaps and complex scenarios.

- Monitor and troubleshoot data systems to ensure performance and reliability.

- Apply database management principles to ensure data quality.

- Optimize data processes for speed and efficiency.

- Ensure data architecture supports business needs and governance policies.

- Define and execute data engineering strategies aligned with company goals.

- Integrate data from various sources, ensuring quality and consistency.

- Stay updated with emerging technologies and industry trends.

- Translate banking industry business processes into data requirements.

- Manage data migrations across different databases and servers.

- Validate data transformations and support machine learning models.

- Define data requirements and mappings in collaboration with business and IT teams.

- Maintain and test data pipelines for performance validation.

- Assemble large data sets that meet business requirements.

- Identify data gaps and align with business and IT needs.

- Understand the impact of data conversions on operations.

- Manage complex data cases with accuracy and efficiency.

Leadership Responsibilities :

- Provide technical direction to the development team.

- Review and approve code to ensure quality standards.

- Troubleshoot and resolve technical issues.

- Foster a culture of collaboration, innovation, and continuous improvement.

- Optimize data flow for cross-functional teams.

- Work closely with onshore data counterparts, product owners, and stakeholders to understand data needs.

- Collaborate with IT and DevOps teams to align data infrastructure with IT architecture.

- Implement best practices for data security and privacy.

- Drive continuous improvement in data engineering.

Candidate Expectations :

- Design and develop warehouse solutions using Azure Synapse Analytics, ADLS, ADF, Databricks, Power BI, and Azure Analysis Services.

- Proficient in SSIS, SQL, and query optimization.

- Experience as a technical lead mentoring data engineers and managing data projects.

- Experience in an onshore-offshore model handling challenging scenarios.

- Lead data architecture and implementation to optimize data warehouse accuracy and usage.

- Expertise in handling large data sets, building ETL pipelines, and generating insights using Data Science and Analytics.

- Proficiency in Azure, AWS cloud services, and DevOps/CI/CD frameworks.

- Ability to transform ambiguous requirements into deliverables.

- Strong technical and interpersonal skills with excellent communication.

- Drive automation using Infrastructure as Code (IaC), Terraform, Jenkins, and other CI/CD tools.

- Help define architecture frameworks, best practices, and processes.

- Collaborate on data warehouse architecture and technical design.

- Expertise in Azure Data Factory for building ETL pipelines.

- Proficient in SQL and relational databases.

- Proficient in Python for ETL projects.

- Experience with Databricks is an advantage.

- Expertise in data lifecycle management, data ingestion, transformation, loading, validation, and performance tuning.

(ref:hirist.tech)

  • Lead Data Engineer

    1 week ago

    Thiruvananthapuram, Kerala, India CloudQ IT Services Full time

    Role Overview :The Lead Data Engineer will design, implement, and maintain data solutions on Microsoft Azure and SQL Server platforms. You will lead a team of data engineers, collaborate with stakeholders, and ensure efficient data processing, storage, and retrieval.Technical Responsibilities : Design and maintain scalable data pipelines. Create solutions...

  • Data Engineering Lead

    1 week ago

    Thiruvananthapuram, Kerala, India QBrainX Full time

    Job Title: Data Engineering Lead (With Architecture Experience)Experience Level: More than 10 yearsLocation: CoimbatorePosition Type: Full-TimeNo of Opening: 2Immediate Joiner (OR) Who can join us within 15 to 20 days is preferred.Key Responsibilities:Architect and Design Data Solutions:Collaborate with crossfunctional teams to understand business...

  • Lead Data Engineer

    1 day ago

    thiruvananthapuram, India CloudQ IT Services Full time

    Role Overview : The Lead Data Engineer will design, implement, and maintain data solutions on Microsoft Azure and SQL Server platforms. You will lead a team of data engineers, collaborate with stakeholders, and ensure efficient data processing, storage, and retrieval.Technical Responsibilities : - Design and maintain scalable data pipelines.- Create...

  • Data Technical Lead

    1 day ago

    Thiruvananthapuram, India VRIZE Full time

    Lead Data Engineer will be responsible for designing, implementing, and maintaining data solutions on the Microsoft Azure Data platform and SQL Server (SSIS, SSAS, UC4 Atomic)Leading a team of data engineers, collaborating with various stakeholders, and ensuring the efficient processing, storage, and retrieval of large volumes of dataTechnical Expertise and...

  • Data Technical Lead

    1 day ago

    Thiruvananthapuram, India VRIZE Full time

    Lead Data Engineer will be responsible for designing, implementing, and maintaining data solutions on the Microsoft Azure Data platform and SQL Server (SSIS, SSAS, UC4 Atomic)Leading a team of data engineers, collaborating with various stakeholders, and ensuring the efficient processing, storage, and retrieval of large volumes of dataTechnical Expertise and...

  • Senior Data Engineer

    1 week ago

    Thiruvananthapuram, Kerala, India Nissan Motor Full time

    Quality & After Sales team is integral part to Nissan's manufacturing process. While targeting high quality in our vehicles, we work to increase the quality of its sales and service to customers in the purchasing process. The goal is to exceed customer expectations at all contact points.We are looking for Hands-On lead data engineer to build next generation...

  • Lead Data Engineer

    1 week ago

    Trivandrum/Thiruvananthapuram, Thiruvananthapuram, India CloudQ IT Services Full time

    Role Overview :The Lead Data Engineer will design, implement, and maintain data solutions on Microsoft Azure and SQL Server platforms. You will lead a team of data engineers, collaborate with stakeholders, and ensure efficient data processing, storage, and retrieval.Technical Responsibilities :- Design and maintain scalable data pipelines.- Create solutions...

  • Senior Data Engineer

    1 week ago

    Thiruvananthapuram, Kerala, India Nissan Motor Full time

    Nissan is a pioneer in Innovation and Technology. With a focus on Mobility, Operational Excellence, Value to our Customers and Electrification of vehicles, you can expect to be part of a very exciting journey here at Nissan. Nissan is going after a massive Digital Transformation backed by leading technologies across the organization globally. We are...

  • Senior Data Engineer

    1 month ago

    Thiruvananthapuram, India Nissan Motor Full time

    Nissan is a pioneer in Innovation and Technology. With a focus on Mobility, Operational Excellence, Value to our Customers and Electrification of vehicles, you can expect to be part of a very exciting journey here at Nissan. Nissan is going after a massive Digital Transformation backed by leading technologies across the organization globally. We are...

  • Senior Data Engineer

    1 month ago

    thiruvananthapuram, India Nissan Motor Full time

    Nissan is a pioneer in Innovation and Technology. With a focus on Mobility, Operational Excellence, Value to our Customers and Electrification of vehicles, you can expect to be part of a very exciting journey here at Nissan. Nissan is going after a massive Digital Transformation backed by leading technologies across the organization globally. We are...

  • Senior Data Engineer

    3 weeks ago

    Thiruvananthapuram, India Nissan Motor Full time

    Nissan is a pioneer in Innovation and Technology. With a focus on Mobility, Operational Excellence, Value to our Customers and Electrification of vehicles, you can expect to be part of a very exciting journey here at Nissan. Nissan is going after a massive Digital Transformation backed by leading technologies across the organization globally. We are...

  • Senior Data Engineer

    3 weeks ago

    thiruvananthapuram, India Nissan Motor Full time

    Nissan is a pioneer in Innovation and Technology. With a focus on Mobility, Operational Excellence, Value to our Customers and Electrification of vehicles, you can expect to be part of a very exciting journey here at Nissan. Nissan is going after a massive Digital Transformation backed by leading technologies across the organization globally. We are...

  • Data Science Team Lead

    2 months ago

    thiruvananthapuram, India CONNECTING 2 WORK Full time

    Responsibilities: Team Leadership: ● Lead and mentor a team of data scientists, providing guidance and supportfor their professional development. ● Foster a collaborative and innovative team culture that encouragesknowledge sharing and continuous improvement.Project Management: ● Oversee the planning, execution, and delivery of data...

  • Data Science Team Lead

    3 weeks ago

    thiruvananthapuram, India CONNECTING 2 WORK Full time

    Responsibilities: Team Leadership: ● Lead and mentor a team of data scientists, providing guidance and supportfor their professional development. ● Foster a collaborative and innovative team culture that encouragesknowledge sharing and continuous improvement.Project Management: ● Oversee the planning, execution, and delivery of data...

  • Data Science Team Lead

    1 week ago

    Thiruvananthapuram, Kerala, India CONNECTING 2 WORK Full time

    Responsibilities:Team Leadership:Lead and mentor a team of data scientists, providing guidance and supportfor their professional development.Foster a collaborative and innovative team culture that encouragesknowledge sharing and continuous improvement.Project Management: Oversee the planning, execution, and delivery of data science projects tomeet...

  • Data Engineer- AtScale

    2 weeks ago

    thiruvananthapuram, India Arting Digital Private Limited Full time

    Job Description Position Title:     Data Engineer- AtScale / DataCTC:                     Upto 10 LPA Experience:         3+YearLocation:             Pune, Bangalore, Chennai, TrivandrumWorking Mode:  OnsitePrimary Skills:    AtScale, Python, SQL, ETL, SAP dataGood to have:     AWS/Azure/GCP,...

  • Data Engineer- AtScale

    2 weeks ago

    Thiruvananthapuram, India Arting Digital Private Limited Full time

    Job DescriptionPosition Title:    Data Engineer- AtScale / DataCTC:                     Upto 10 LPA Experience:        3+YearLocation:             Pune, Bangalore, Chennai, TrivandrumWorking Mode: OnsitePrimary Skills:    AtScale, Python, SQL, ETL, SAP dataGood to have:    AWS/Azure/GCP,...

  • Data Engineer

    1 day ago

    Thiruvananthapuram, India Nissan Digital India LLP Full time

    We are looking for passionate Data Engineers, with ETL experience, who can assist in the process of maintaining all the relevant sources of data and ensuring that it is being stored properly. He/she is involved in developing the ETL processes and is involved in designing and preparing the codes that meet the program specifications.Responsibilities:· Data...

  • Senior Data Engineer

    3 weeks ago

    thiruvananthapuram, India Quantiphi Full time

    Role : Senior Data EngineerExperience Level : 4 to 7 YearsWork location : Trivandrum (Hybrid Only)Required Skills :● Bachelor’s degree in Computer Science or similar field or equivalent work experience.● 3+ years of experience on Data Warehousing, Data Engineering or Data Integration projects.● Expert with data warehousing concepts, strategies, and...

  • Senior Data Engineer

    1 week ago

    Thiruvananthapuram, Kerala, India Nissan Motor Full time

    :We are looking for passionate senior ETL engineers, with Talend experience, who can assist in the process of maintaining all the relevant sources of data and ensuring that it is being stored properly. He/she is involved in developing the ETL processes and is involved in designing and preparing the codes that meet the program...