Lead Data Engineer

1 week ago

Thiruvananthapuram, Kerala, India CloudQ IT Services Full time

Role Overview :

The Lead Data Engineer will design, implement, and maintain data solutions on Microsoft Azure and SQL Server platforms. You will lead a team of data engineers, collaborate with stakeholders, and ensure efficient data processing, storage, and retrieval.

Technical Responsibilities :

  • Design and maintain scalable data pipelines.
  • Create solutions using Azure Data Factory and Databricks for ETL processes.
  • Develop solutions in SSIS.
  • Analyze and optimize the existing data landscape for efficiency and scalability.
  • Collaborate with onshore counterparts to address technical gaps and complex scenarios.
  • Monitor and troubleshoot data systems to ensure performance and reliability.
  • Apply database management principles to ensure data quality.
  • Optimize data processes for speed and efficiency.
  • Ensure data architecture supports business needs and governance policies.
  • Define and execute data engineering strategies aligned with company goals.
  • Integrate data from various sources, ensuring quality and consistency.
  • Stay updated with emerging technologies and industry trends.
  • Translate banking industry business processes into data requirements.
  • Manage data migrations across different databases and servers.
  • Validate data transformations and support machine learning models.
  • Define data requirements and mappings in collaboration with business and IT teams.
  • Maintain and test data pipelines for performance validation.
  • Assemble large data sets that meet business requirements.
  • Identify data gaps and align with business and IT needs.
  • Understand the impact of data conversions on operations.
  • Manage complex data cases with accuracy and efficiency.
Leadership Responsibilities :

  • Provide technical direction to the development team.
  • Review and approve code to ensure quality standards.
  • Troubleshoot and resolve technical issues.
  • Foster a culture of collaboration, innovation, and continuous improvement.
  • Optimize data flow for crossfunctional teams.
  • Work closely with onshore data counterparts, product owners, and stakeholders to understand data needs.
  • Collaborate with IT and DevOps teams to align data infrastructure with IT architecture.
  • Implement best practices for data security and privacy.
  • Drive continuous improvement in data engineering.
Candidate Expectations :

  • Design and develop warehouse solutions using Azure Synapse Analytics, ADLS, ADF, Databricks, Power BI, and Azure Analysis Services.
  • Proficient in SSIS, SQL, and query optimization.
  • Experience as a technical lead mentoring data engineers and managing data projects.
  • Experience in an onshoreoffshore model handling challenging scenarios.
  • Lead data architecture and implementation to optimize data warehouse accuracy and usage.
  • Expertise in handling large data sets, building ETL pipelines, and generating insights using Data Science and Analytics.
  • Proficiency in Azure, AWS cloud services, and DevOps/CI/CD frameworks.
  • Ability to transform ambiguous requirements into deliverables.
  • Strong technical and interpersonal skills with excellent communication.
  • Drive automation using Infrastructure as Code (IaC), Terraform, Jenkins, and other CI/CD tools.
  • Help define architecture frameworks, best practices, and processes.
  • Collaborate on data warehouse architecture and technical design.
  • Expertise in Azure Data Factory for building ETL pipelines.
  • Proficient in SQL and relational databases.
  • Proficient in Python for ETL projects.
  • Experience with Databricks is an advantage.
  • Expertise in data lifecycle management, data ingestion, transformation, loading, validation, and performance tuning.
)

  • Data Engineering Lead

    1 week ago

    Thiruvananthapuram, Kerala, India QBrainX Full time

    Job Title: Data Engineering Lead (With Architecture Experience)Experience Level: More than 10 yearsLocation: CoimbatorePosition Type: Full-TimeNo of Opening: 2Immediate Joiner (OR) Who can join us within 15 to 20 days is preferred.Key Responsibilities:Architect and Design Data Solutions:Collaborate with crossfunctional teams to understand business...

  • Senior Data Engineer

    1 week ago

    Thiruvananthapuram, Kerala, India Nissan Motor Full time

    Quality & After Sales team is integral part to Nissan's manufacturing process. While targeting high quality in our vehicles, we work to increase the quality of its sales and service to customers in the purchasing process. The goal is to exceed customer expectations at all contact points.We are looking for Hands-On lead data engineer to build next generation...

  • Senior Data Engineer

    1 week ago

    Thiruvananthapuram, Kerala, India Nissan Motor Full time

    Nissan is a pioneer in Innovation and Technology. With a focus on Mobility, Operational Excellence, Value to our Customers and Electrification of vehicles, you can expect to be part of a very exciting journey here at Nissan. Nissan is going after a massive Digital Transformation backed by leading technologies across the organization globally. We are...

  • Data Science Team Lead

    1 week ago

    Thiruvananthapuram, Kerala, India CONNECTING 2 WORK Full time

    Responsibilities:Team Leadership:Lead and mentor a team of data scientists, providing guidance and supportfor their professional development.Foster a collaborative and innovative team culture that encouragesknowledge sharing and continuous improvement.Project Management: Oversee the planning, execution, and delivery of data science projects tomeet...

  • Senior Data Engineer

    1 week ago

    Thiruvananthapuram, Kerala, India Nissan Motor Full time

    :We are looking for passionate senior ETL engineers, with Talend experience, who can assist in the process of maintaining all the relevant sources of data and ensuring that it is being stored properly. He/she is involved in developing the ETL processes and is involved in designing and preparing the codes that meet the program...

  • Senior Data Engineer

    1 week ago

    Thiruvananthapuram, Kerala, India Nissan Motor Full time

    Description : We are looking for passionate senior ETL engineers, with Talend experience, who can assist in the process of maintaining all the relevant sources of data and ensuring that it is being stored properly. He/she is involved in developing the ETL processes and is involved in designing and preparing the codes that meet the program specifications....

  • PySpark Data Engineer

    1 week ago

    Thiruvananthapuram, Kerala, India Edstem Technologies Full time

    We are seeking a talented and experienced PySpark Data Engineer to join our dynamic team. The ideal candidate will have a strong background in data engineering, a passion for big data technologies, and the ability to work in a fast-paced, collaborative environment. Key Responsibilities:Data Pipeline Development: Design, develop, and maintain scalable data...

  • Senior Data Engineer

    1 week ago

    Thiruvananthapuram, Kerala, India Quantiphi Full time

    Role : Senior Data EngineerExperience Level : 4 to 7 YearsWork location : Trivandrum (Hybrid Only)Required Skills :Bachelor's degree in Computer Science or similar field or equivalent work experience.3+ years of experience on Data Warehousing, Data Engineering or Data Integration projects.Expert with data warehousing concepts, strategies, and tools.Strong...

  • Lead Backend Engineer

    1 week ago

    Thiruvananthapuram, Kerala, India LogicPlum Full time

    Position - Lead Backend EngineerWe are seeking a highly skilled and experiencedLead Backend Engineer to join our team. TheLead Backend Engineer will be responsible for designing and implementing scalable, high-performance software solutions for our clients using Python and Angular. This individual will be a key member of our development team, leading the...

  • Lead Backend Engineer

    1 week ago

    Thiruvananthapuram, Kerala, India LogicPlum Full time

    Position - Lead Backend Engineer We are seeking a highly skilled and experienced Lead Backend Engineer to join our team. The Lead Backend Engineer will be responsible for designing and implementing scalable, high-performance software solutions for our clients using Python and Angular. This individual will be a key member of our development team, leading the...

  • Health Connection Integration Engineer/Lead

    1 week ago

    Thiruvananthapuram, Kerala, India Arting Digital Full time

    Primary Skills :InterSystems Health connect Expertise :Extensive experience and expertise in Intersystems HealthConnect integration technologies, including in-depth knowledge of Health Connect integration engine, tools, and best practices. Hands on expertise in Intersystem healthconnect/ healthshare/ Ensemble, IRIS, cache sql, cache object script. Leadership...

  • System Test Engineers and Leads

    1 week ago

    Thiruvananthapuram, Kerala, India Tata Elxsi Full time

    System Test Engineers and LeadsWe are looking for bright and passionate engineers, senior engineers, and leads who are familiar with automotive testing and automation in the areas listed below:System integration test (SYS.4) and System qualification test (SYS.5)Test cases authoring, Test automation and Test execution at System integration and system...

  • eCockpit Development Engineers and Leads

    1 week ago

    Thiruvananthapuram, Kerala, India Tata Elxsi Full time

    eCockpit Development Engineers and Leads We are looking for bright and passionate engineers, senior engineers and leads who are familiar with automotive development covering the below mentioned skills :- C /C++/ Java SW design, development, integration and testing Understanding of Object Oriented Design and Development Development Operating...

  • Automotive HILS Engineers and Leads

    1 week ago

    Thiruvananthapuram, Kerala, India Tata Elxsi Full time

    Automotive HILS Engineers and Leads We are looking for bright and passionate engineer's senior engineers, and leads who are familiar with automotive testing and automation in the areas listed below:- Design and development of HiL Systems like dSPACE/ NI/ Vector VT etc Development of automation framework HiL prove-out and test execution Take up...

  • Lead Engineer

    1 week ago

    Thiruvananthapuram, Kerala, India Envestnet | Yodlee Full time

    Description Department : Engineering Role : Lead Engineer – Product Development About Envestnet Envestnet, Inc. (NYSE: ENV) is transforming the way financial advice and wellness are delivered. Our mission is to empower advisors and financial service providers with innovative technology, solutions, and intelligence to make financial wellness a...

  • Lead Engineer

    1 week ago

    Thiruvananthapuram, Kerala, India Envestnet Full time

    Description Department : Engineering Role : Lead Engineer – Product Development About Envestnet Envestnet, Inc. (NYSE: ENV) is transforming the way financial advice and wellness are delivered. Our mission is to empower advisors and financial service providers with innovative technology, solutions, and intelligence to make financial wellness a reality...

  • Data Architect

    1 week ago

    Thiruvananthapuram, Kerala, India Nissan Full time

    Nissan is a pioneer in Innovation and Technology. With a focus on Mobility, Operational Excellence, Value to our Customers and Electrification of vehicles, you can expect to be part of a very exciting journey here at Nissan.Nissan is going after a massive Digital Transformation backed by leading technologies across the organization globally. We are committed...

  • Tech Lead

    1 week ago

    Thiruvananthapuram, Kerala, India Nissan Motor Full time

    Tech Lead - Java Job Summary We are seeking a skilled and experienced Tech Lead with expertise in Java development to join our team. As a Tech Lead - Java, you will be responsible for leading a team of developers, guiding them in the design, development, and implementation of Java-based software solutions. You will play a critical role in overseeing...

  • Lead Engineer

    1 week ago

    Thiruvananthapuram, Kerala, India Envestnet Full time

    Department: EngineeringRole: Lead Engineer – Product DevelopmentAbout EnvestnetEnvestnet, Inc (NYSE:ENV) is transforming the way financial advice and wellness are delivered. Our mission is to empower advisors and financial service providers with innovative technology, solutions, and intelligence to make financial wellness a reality for everyone.Since our...

  • Lead Engineer

    1 week ago

    Thiruvananthapuram, Kerala, India Envestnet Full time

    ResponsibilitiesOperate and monitor Envestnet's security tools, including but not limited to anti-virus, WAF, IDS/IPS, PAM, and content filteringReview and make recommendations regarding on-premises datacenter, and cloud infrastructure security settingsInstall, support, and operationalize security software within the global environmentLiaise between the...