Data Engineering Lead

1 week ago


Thiruvananthapuram, Kerala, India QBrainX Full time
Job Title: Data Engineering Lead (With Architecture Experience)

Experience Level: More than 10 years



Location: Coimbatore



Position Type: Full-Time



No of Opening: 2



  • Immediate Joiner (OR) Who can join us within 15 to 20 days is preferred.

Key Responsibilities:



Architect and Design Data Solutions:



  • Collaborate with crossfunctional teams to understand business requirements and design scalable and efficient data solutions.
  • Define data architectures, data models, and data integration strategies to meet business objectives.
  • Provide technical leadership in designing and implementing data pipelines, ETL processes, and data warehousing solutions.

Snowflake Expertise:



  • Leverage your indepth knowledge of Snowflake technologies to build and optimize data warehouses.
  • Develop and maintain Snowflake data models and schemas to support reporting and analytics needs.
  • Familiarity with Snowflake best practices, such as cost analysis, resource allocation, data loading strategies (e.g., bulk loading, incremental loading), and security configurations

Azure and Databricks Proficiency:



  • Utilize Azure cloud services and Databricks platforms to manage and process large datasets efficiently.
  • Build, deploy, and maintain data pipelines on Azure Data Factory, Azure Databricks, and other Azure services.

Data Warehousing and Integration:



  • Implement best practices for data warehousing, ensuring data quality, consistency, and reliability.
  • Create and manage data integration processes, including real-time and batch data movement between systems.

SQL and PL/SQL Mastery:



  • Write complex SQL and PL/SQL queries to extract, transform, and load data effectively.
  • Optimize SQL queries and database performance for high volume data processing.

Performance Tuning and Optimization:



  • Continuously monitor and enhance the performance of data pipelines and data storage systems.
  • Troubleshoot and resolve data-related issues to minimize downtime.

Documentation and Collaboration:



  • Document data engineering processes, data flows, and architectural decisions.
  • Collaborate with data scientists, analysts, and other stakeholders to ensure data availability and usability.

Security and Compliance:



  • Implement data security measures and adhere to compliance standards (e.g., GDPR, HIPAA) to protect sensitive data.

Apart from more than 10 years' experience and the technical skills like Snowflake, Azure Databricks etc.



It is vital to exhibit the following abilities:



  • Initiate and drive data engineering strategies.
  • Assist and engage with Data engineering sales, proposal activities.
  • Develop strong customer relationships for ongoing business.
  • Experienced with the Cloud-based Data Solution Architectures, especially in Snowflake.
  • Experience with client engagement & aligning others to your ideas/solutions.
  • Experience leading a technical team.
  • Ability to clarify/translate customer requirements into Epics/Stories & remove ambiguity.
  • Ability to mentor other Data Engineering team members.

Qualifications:



  • Bachelor's or master's degree in computer science, Information Technology, or related field.
  • Over 10 years of experience in Data Engineering, with a strong focus on architecture.
  • Proven expertise in Snowflake, Azure, and Databricks technologies.
  • Comprehensive knowledge of data warehousing concepts, ETL processes, and data integration techniques.
  • Exceptional SQL and PL/SQL skills.
  • Experience with performance tuning and optimization of data pipelines.
  • Strong problem-solving skills and the ability to work in a fast-paced, collaborative environment.
  • Excellent communication skills to convey technical concepts to non-technical stakeholders.
  • Certifications in relevant technologies (e.g., Snowflake, Azure) are a plus.

  • Lead Data Engineer

    1 week ago


    Thiruvananthapuram, Kerala, India CloudQ IT Services Full time

    Role Overview :The Lead Data Engineer will design, implement, and maintain data solutions on Microsoft Azure and SQL Server platforms. You will lead a team of data engineers, collaborate with stakeholders, and ensure efficient data processing, storage, and retrieval.Technical Responsibilities : Design and maintain scalable data pipelines. Create solutions...


  • Thiruvananthapuram, Kerala, India Nissan Motor Full time

    Quality & After Sales team is integral part to Nissan's manufacturing process. While targeting high quality in our vehicles, we work to increase the quality of its sales and service to customers in the purchasing process. The goal is to exceed customer expectations at all contact points.We are looking for Hands-On lead data engineer to build next generation...


  • Thiruvananthapuram, Kerala, India Nissan Motor Full time

    Nissan is a pioneer in Innovation and Technology. With a focus on Mobility, Operational Excellence, Value to our Customers and Electrification of vehicles, you can expect to be part of a very exciting journey here at Nissan. Nissan is going after a massive Digital Transformation backed by leading technologies across the organization globally. We are...


  • Thiruvananthapuram, Kerala, India CONNECTING 2 WORK Full time

    Responsibilities:Team Leadership:Lead and mentor a team of data scientists, providing guidance and supportfor their professional development.Foster a collaborative and innovative team culture that encouragesknowledge sharing and continuous improvement.Project Management: Oversee the planning, execution, and delivery of data science projects tomeet...

  • Technical Lead

    1 week ago


    Thiruvananthapuram, Kerala, India Quest Global Engineering Solutions Private Limited Full time

    Role and Responsibilities : Lead and mentor a team of software engineers in the design, development, and testing of WiFi software applications. Collaborate with cross-functional teams, including hardware engineers and product managers, to define software requirements and specifications. Architect, design, and implement robust and scalable WiFi software...


  • Thiruvananthapuram, Kerala, India Nissan Motor Full time

    :We are looking for passionate senior ETL engineers, with Talend experience, who can assist in the process of maintaining all the relevant sources of data and ensuring that it is being stored properly. He/she is involved in developing the ETL processes and is involved in designing and preparing the codes that meet the program...


  • Thiruvananthapuram, Kerala, India Nissan Motor Full time

    Description : We are looking for passionate senior ETL engineers, with Talend experience, who can assist in the process of maintaining all the relevant sources of data and ensuring that it is being stored properly. He/she is involved in developing the ETL processes and is involved in designing and preparing the codes that meet the program specifications....


  • Thiruvananthapuram, Kerala, India Edstem Technologies Full time

    We are seeking a talented and experienced PySpark Data Engineer to join our dynamic team. The ideal candidate will have a strong background in data engineering, a passion for big data technologies, and the ability to work in a fast-paced, collaborative environment. Key Responsibilities:Data Pipeline Development: Design, develop, and maintain scalable data...

  • Technical Lead

    1 week ago


    Thiruvananthapuram, Kerala, India Quest Global Engineering Solutions Private Limited Full time

    Job Description & Responsibilities : Design, develop, and test BLEenabled embedded systems Work with other engineers to integrate BLE into existing systems Develop and maintain BLE software and firmware Analyze and troubleshoot BLE problems Work with customers to define and implement BLE requirements Stay uptodate on the latest BLE technologiesRequired...


  • Thiruvananthapuram, Kerala, India Quantiphi Full time

    Role : Senior Data EngineerExperience Level : 4 to 7 YearsWork location : Trivandrum (Hybrid Only)Required Skills :Bachelor's degree in Computer Science or similar field or equivalent work experience.3+ years of experience on Data Warehousing, Data Engineering or Data Integration projects.Expert with data warehousing concepts, strategies, and tools.Strong...


  • Thiruvananthapuram, Kerala, India LogicPlum Full time

    Position - Lead Backend EngineerWe are seeking a highly skilled and experiencedLead Backend Engineer to join our team. TheLead Backend Engineer will be responsible for designing and implementing scalable, high-performance software solutions for our clients using Python and Angular. This individual will be a key member of our development team, leading the...


  • Thiruvananthapuram, Kerala, India LogicPlum Full time

    Position - Lead Backend Engineer We are seeking a highly skilled and experienced Lead Backend Engineer to join our team. The Lead Backend Engineer will be responsible for designing and implementing scalable, high-performance software solutions for our clients using Python and Angular. This individual will be a key member of our development team, leading the...


  • Thiruvananthapuram, Kerala, India Arting Digital Full time

    Primary Skills :InterSystems Health connect Expertise :Extensive experience and expertise in Intersystems HealthConnect integration technologies, including in-depth knowledge of Health Connect integration engine, tools, and best practices. Hands on expertise in Intersystem healthconnect/ healthshare/ Ensemble, IRIS, cache sql, cache object script. Leadership...


  • Thiruvananthapuram, Kerala, India Tata Elxsi Full time

    System Test Engineers and LeadsWe are looking for bright and passionate engineers, senior engineers, and leads who are familiar with automotive testing and automation in the areas listed below:System integration test (SYS.4) and System qualification test (SYS.5)Test cases authoring, Test automation and Test execution at System integration and system...


  • Thiruvananthapuram, Kerala, India Tata Elxsi Full time

    eCockpit Development Engineers and Leads We are looking for bright and passionate engineers, senior engineers and leads who are familiar with automotive development covering the below mentioned skills :- C /C++/ Java SW design, development, integration and testing Understanding of Object Oriented Design and Development Development Operating...


  • Thiruvananthapuram, Kerala, India Tata Elxsi Full time

    Automotive HILS Engineers and Leads We are looking for bright and passionate engineer's senior engineers, and leads who are familiar with automotive testing and automation in the areas listed below:- Design and development of HiL Systems like dSPACE/ NI/ Vector VT etc Development of automation framework HiL prove-out and test execution Take up...

  • Lead Engineer

    1 week ago


    Thiruvananthapuram, Kerala, India Envestnet | Yodlee Full time

    Description Department : Engineering Role : Lead Engineer – Product Development About Envestnet Envestnet, Inc. (NYSE: ENV) is transforming the way financial advice and wellness are delivered. Our mission is to empower advisors and financial service providers with innovative technology, solutions, and intelligence to make financial wellness a...

  • Lead Engineer

    1 week ago


    Thiruvananthapuram, Kerala, India Envestnet Full time

    Description Department : Engineering Role : Lead Engineer – Product Development About Envestnet Envestnet, Inc. (NYSE: ENV) is transforming the way financial advice and wellness are delivered. Our mission is to empower advisors and financial service providers with innovative technology, solutions, and intelligence to make financial wellness a reality...

  • Data Architect

    1 week ago


    Thiruvananthapuram, Kerala, India Nissan Full time

    Nissan is a pioneer in Innovation and Technology. With a focus on Mobility, Operational Excellence, Value to our Customers and Electrification of vehicles, you can expect to be part of a very exciting journey here at Nissan.Nissan is going after a massive Digital Transformation backed by leading technologies across the organization globally. We are committed...

  • Tech Lead

    1 week ago


    Thiruvananthapuram, Kerala, India Nissan Motor Full time

    Tech Lead - Java Job Summary We are seeking a skilled and experienced Tech Lead with expertise in Java development to join our team. As a Tech Lead - Java, you will be responsible for leading a team of developers, guiding them in the design, development, and implementation of Java-based software solutions. You will play a critical role in overseeing...