Lead Data Engineer

1 week ago

TrivandrumThiruvananthapuram, Thiruvananthapuram, India CloudQ IT Services Full time

Role Overview :

The Lead Data Engineer will design, implement, and maintain data solutions on Microsoft Azure and SQL Server platforms. You will lead a team of data engineers, collaborate with stakeholders, and ensure efficient data processing, storage, and retrieval.

Technical Responsibilities :

- Design and maintain scalable data pipelines.

- Create solutions using Azure Data Factory and Databricks for ETL processes.

- Develop solutions in SSIS.

- Analyze and optimize the existing data landscape for efficiency and scalability.

- Collaborate with onshore counterparts to address technical gaps and complex scenarios.

- Monitor and troubleshoot data systems to ensure performance and reliability.

- Apply database management principles to ensure data quality.

- Optimize data processes for speed and efficiency.

- Ensure data architecture supports business needs and governance policies.

- Define and execute data engineering strategies aligned with company goals.

- Integrate data from various sources, ensuring quality and consistency.

- Stay updated with emerging technologies and industry trends.

- Translate banking industry business processes into data requirements.

- Manage data migrations across different databases and servers.

- Validate data transformations and support machine learning models.

- Define data requirements and mappings in collaboration with business and IT teams.

- Maintain and test data pipelines for performance validation.

- Assemble large data sets that meet business requirements.

- Identify data gaps and align with business and IT needs.

- Understand the impact of data conversions on operations.

- Manage complex data cases with accuracy and efficiency.

Leadership Responsibilities :

- Provide technical direction to the development team.

- Review and approve code to ensure quality standards.

- Troubleshoot and resolve technical issues.

- Foster a culture of collaboration, innovation, and continuous improvement.

- Optimize data flow for cross-functional teams.

- Work closely with onshore data counterparts, product owners, and stakeholders to understand data needs.

- Collaborate with IT and DevOps teams to align data infrastructure with IT architecture.

- Implement best practices for data security and privacy.

- Drive continuous improvement in data engineering.

Candidate Expectations :

- Design and develop warehouse solutions using Azure Synapse Analytics, ADLS, ADF, Databricks, Power BI, and Azure Analysis Services.

- Proficient in SSIS, SQL, and query optimization.

- Experience as a technical lead mentoring data engineers and managing data projects.

- Experience in an onshore-offshore model handling challenging scenarios.

- Lead data architecture and implementation to optimize data warehouse accuracy and usage.

- Expertise in handling large data sets, building ETL pipelines, and generating insights using Data Science and Analytics.

- Proficiency in Azure, AWS cloud services, and DevOps/CI/CD frameworks.

- Ability to transform ambiguous requirements into deliverables.

- Strong technical and interpersonal skills with excellent communication.

- Drive automation using Infrastructure as Code (IaC), Terraform, Jenkins, and other CI/CD tools.

- Help define architecture frameworks, best practices, and processes.

- Collaborate on data warehouse architecture and technical design.

- Expertise in Azure Data Factory for building ETL pipelines.

- Proficient in SQL and relational databases.

- Proficient in Python for ETL projects.

- Experience with Databricks is an advantage.

- Expertise in data lifecycle management, data ingestion, transformation, loading, validation, and performance tuning.

(ref:hirist.tech)

  • Ospyn Technologies

    1 week ago

    Trivandrum/Thiruvananthapuram, Thiruvananthapuram, India Ospyn Technologies Pvt. Ltd. Full time

    Work Mode : Work from OfficeJob Type : Full TimeQualification : BTech/ BCA/ MCARequirements :- Lead the design and implementation of a scalable AI based Data analytic application using Python (including python web framework flask/Django).- Hands on experience in developing Machine learning models using Python.- Hands on experience in data analytics using...

  • Ospyn - Lead Data Science Engineer - Machine Learning

    1 month ago

    Trivandrum/Thiruvananthapuram, Thiruvananthapuram, India Ospyn Technologies Pvt Ltd Full time

    Job Description : - Hands on experience in developing Machine learning models using python- Hands on experience in data analytics using python- Hands on experience in computer vision- Good knowledge in Machine learning algorithms and concepts- Develop, test, and deploy python-based applications.- Write clean and maintainable code while following best...

  • Ospyn - Lead Data Science Engineer - Machine Learning

    3 weeks ago

    Trivandrum/Thiruvananthapuram, Thiruvananthapuram, India Ospyn Technologies Pvt Ltd Full time

    Job Description : - Hands on experience in developing Machine learning models using python- Hands on experience in data analytics using python- Hands on experience in computer vision- Good knowledge in Machine learning algorithms and concepts- Develop, test, and deploy python-based applications.- Write clean and maintainable code while following best...

  • Technical Lead

    4 weeks ago

    Trivandrum/Thiruvananthapuram, Thiruvananthapuram, India Excellence and Eminence LLP Full time

    We are looking for Technical Lead - Embedded Zigbee with 9 to 12 Year of Experience for our esteemed client for Trivandrum Location.Key Skills : NFC, Zigbee, RF principles, CThis is an immediate requirement. Please apply if you can join within 30 days or close to 30 days.Roles & and mentor a team of software engineers in the design, development, and testing...

  • Technical Lead

    3 weeks ago

    Trivandrum/Thiruvananthapuram, Thiruvananthapuram, India Excellence and Eminence LLP Full time

    We are looking for Technical Lead - Embedded Zigbee with 9 to 12 Year of Experience for our esteemed client for Trivandrum Location.Key Skills : NFC, Zigbee, RF principles, CThis is an immediate requirement. Please apply if you can join within 30 days or close to 30 days.Roles & and mentor a team of software engineers in the design, development, and testing...

  • Technical Lead

    4 weeks ago

    Trivandrum/Thiruvananthapuram, Thiruvananthapuram, India Excellence and Eminence LLP Full time

    We are looking for Technical Lead -Ultra Wide band (UWB) with 9 to 12 Years of Experience for our esteemed client for Trivandrum Location.Key Skills : UWB, Bluetooth, RTOS, device drivers, C/C++ programming, RF designThis is an immediate requirement. Please apply if you can join within 30 days or close to 30 days.Roles & Responsibilities :Design and develop...

  • Technical Lead

    3 weeks ago

    Trivandrum/Thiruvananthapuram, Thiruvananthapuram, India Excellence and Eminence LLP Full time

    We are looking for Technical Lead -Ultra Wide band (UWB) with 9 to 12 Years of Experience for our esteemed client for Trivandrum Location.Key Skills : UWB, Bluetooth, RTOS, device drivers, C/C++ programming, RF designThis is an immediate requirement. Please apply if you can join within 30 days or close to 30 days.Roles & Responsibilities :Design and develop...

  • Technical Lead

    4 weeks ago

    Trivandrum/Thiruvananthapuram, Thiruvananthapuram, India Excellence and Eminence LLP Full time

    We are looking for Technical Lead - Embedded Zephyr RTOS with 9 to 12 Year of Experience for our esteemed client for Trivandrum Location.Key Skills : Zephyr RTOS, Zephyr OS, Zephyr Kernel, C++/PythonThis is an immediate requirement. Please apply if you can join within 30 days or close to 30 days.Roles & Responsibilities :Lead and mentor a team of software...

  • Technical Lead

    4 weeks ago

    Trivandrum/Thiruvananthapuram, Thiruvananthapuram, India Excellence and Eminence LLP Full time

    We are looking for Technical Lead - NFC with 9 to 12 Year of Experience for our esteemed client for Trivandrum Location.Key Skills : NFC, C, NFC tags, RF principlesThis is an immediate requirement. Please apply if you can join within 30 days or close to 30 days.Roles & Responsibilities :Lead and mentor a team of software engineers in the design, development,...

  • Technical Lead

    3 weeks ago

    Trivandrum/Thiruvananthapuram, Thiruvananthapuram, India Excellence and Eminence LLP Full time

    We are looking for Technical Lead - NFC with 9 to 12 Year of Experience for our esteemed client for Trivandrum Location.Key Skills : NFC, C, NFC tags, RF principlesThis is an immediate requirement. Please apply if you can join within 30 days or close to 30 days.Roles & Responsibilities :Lead and mentor a team of software engineers in the design, development,...

  • Technical Lead

    3 weeks ago

    Trivandrum/Thiruvananthapuram, Thiruvananthapuram, India Excellence and Eminence LLP Full time

    We are looking for Technical Lead - Embedded Zephyr RTOS with 9 to 12 Year of Experience for our esteemed client for Trivandrum Location.Key Skills : Zephyr RTOS, Zephyr OS, Zephyr Kernel, C++/PythonThis is an immediate requirement. Please apply if you can join within 30 days or close to 30 days.Roles & Responsibilities :Lead and mentor a team of software...

  • Technical Lead

    4 weeks ago

    Trivandrum/Thiruvananthapuram, Thiruvananthapuram, India Excellence and Eminence LLP Full time

    Job Description :We are looking for Technical Lead (FuSa) - Middleware with 8 to 12 Yr of Experience for our esteemed client for Trivandrum Location.Key Skills : ISO 26262, Middleware, Linux, IVI/ADAS, ASIL, socket programming, Functional SafetyThis is an immediate requirement. Please apply if you can join within 30 days or close to 30 days.Roles &...

  • Technical Lead

    3 weeks ago

    Trivandrum/Thiruvananthapuram, Thiruvananthapuram, India Excellence and Eminence LLP Full time

    Job Description :We are looking for Technical Lead (FuSa) - Middleware with 8 to 12 Yr of Experience for our esteemed client for Trivandrum Location.Key Skills : ISO 26262, Middleware, Linux, IVI/ADAS, ASIL, socket programming, Functional SafetyThis is an immediate requirement. Please apply if you can join within 30 days or close to 30 days.Roles &...

  • Project Lead

    4 weeks ago

    Trivandrum/Thiruvananthapuram, Thiruvananthapuram, India Excellence and Eminence LLP Full time

    We are looking for Project Lead - Embedded system verification with 5 to 8 Yr of Experience for our esteemed client for Trivandrum Location.Key Skills : HW IP validation, Embedded domain, ARM Cortex A core, Android MiddlewareThis is an immediate requirement. Please apply if you can join within 30 days or close to 30 days.Roles & Responsibilities :Interact...

  • Project Lead

    3 weeks ago

    Trivandrum/Thiruvananthapuram, Thiruvananthapuram, India Excellence and Eminence LLP Full time

    We are looking for Project Lead - Embedded system verification with 5 to 8 Yr of Experience for our esteemed client for Trivandrum Location.Key Skills : HW IP validation, Embedded domain, ARM Cortex A core, Android MiddlewareThis is an immediate requirement. Please apply if you can join within 30 days or close to 30 days.Roles & Responsibilities :Interact...

  • Network Engineer

    4 weeks ago

    Trivandrum/Thiruvananthapuram, Thiruvananthapuram, India Skywalk Global India Private Limited Full time

    Company Overview :Skywalk Global is a dynamic and innovative Technology Company at the forefront of digital transformation. We specialize in reshaping our client's IT landscape by providing a comprehensive suite of services, including Application development, testing, IT consulting, and enterprise solutions. At Skywalk Global, we leverage cutting-edge...

  • Network Engineer

    3 weeks ago

    Trivandrum/Thiruvananthapuram, Thiruvananthapuram, India Skywalk Global India Private Limited Full time

    Company Overview :Skywalk Global is a dynamic and innovative Technology Company at the forefront of digital transformation. We specialize in reshaping our client's IT landscape by providing a comprehensive suite of services, including Application development, testing, IT consulting, and enterprise solutions. At Skywalk Global, we leverage cutting-edge...

  • PostgreSQL DBA Expert

    4 weeks ago

    Trivandrum/Thiruvananthapuram, Thiruvananthapuram, India M P Dominic Company Full time

    Job Description :- Creating database objects such as tables, views, triggers, and indexes etc. - Monitor the performance of the database to identify slowdowns or potential issues and ensure optimum performance. - Identify potential issues in the database to solve them early. - Resolve any production data issues - Give best practice guidance to the...

  • PostgreSQL DBA Expert

    3 weeks ago

    Trivandrum/Thiruvananthapuram, Thiruvananthapuram, India M P Dominic Company Full time

    Job Description :- Creating database objects such as tables, views, triggers, and indexes etc. - Monitor the performance of the database to identify slowdowns or potential issues and ensure optimum performance. - Identify potential issues in the database to solve them early. - Resolve any production data issues - Give best practice guidance to the...

  • Lead Data Engineer

    7 days ago

    Thiruvananthapuram, Kerala, India CloudQ IT Services Full time

    Role Overview :The Lead Data Engineer will design, implement, and maintain data solutions on Microsoft Azure and SQL Server platforms. You will lead a team of data engineers, collaborate with stakeholders, and ensure efficient data processing, storage, and retrieval.Technical Responsibilities : Design and maintain scalable data pipelines. Create solutions...

  • Data Engineering Lead

    7 days ago

    Thiruvananthapuram, Kerala, India QBrainX Full time

    Job Title: Data Engineering Lead (With Architecture Experience)Experience Level: More than 10 yearsLocation: CoimbatorePosition Type: Full-TimeNo of Opening: 2Immediate Joiner (OR) Who can join us within 15 to 20 days is preferred.Key Responsibilities:Architect and Design Data Solutions:Collaborate with crossfunctional teams to understand business...

  • Lead Data Engineer

    1 week ago

    Thiruvananthapuram, India CloudQ IT Services Full time

    Role Overview :The Lead Data Engineer will design, implement, and maintain data solutions on Microsoft Azure and SQL Server platforms. You will lead a team of data engineers, collaborate with stakeholders, and ensure efficient data processing, storage, and retrieval.Technical Responsibilities :- Design and maintain scalable data pipelines.- Create solutions...

  • Senior Data Engineer

    3 weeks ago

    Trivandrum, India Nissan Motor Full time

    Nissan is a pioneer in Innovation and Technology. With a focus on Mobility, Operational Excellence, Value to our Customers and Electrification of vehicles, you can expect to be part of a very exciting journey here at Nissan.Nissan is going after a massive Digital Transformation backed by leading technologies across the organization globally. We are committed...

  • Senior Data Engineer

    4 weeks ago

    Trivandrum, India Nissan Motor Full time

    Nissan is a pioneer in Innovation and Technology. With a focus on Mobility, Operational Excellence, Value to our Customers and Electrification of vehicles, you can expect to be part of a very exciting journey here at Nissan.Nissan is going after a massive Digital Transformation backed by leading technologies across the organization globally. We are committed...

  • Senior Data Engineer

    7 days ago

    Thiruvananthapuram, Kerala, India Nissan Motor Full time

    Quality & After Sales team is integral part to Nissan's manufacturing process. While targeting high quality in our vehicles, we work to increase the quality of its sales and service to customers in the purchasing process. The goal is to exceed customer expectations at all contact points.We are looking for Hands-On lead data engineer to build next generation...

  • Senior Data Engineer

    2 months ago

    Trivandrum, India Quantiphi Full time

    Role : Senior Data Engineer Experience Level : 4 to 7 Years Work location : Trivandrum (Hybrid Only) Required Skills : ● Bachelor’s degree in Computer Science or similar field or equivalent work experience. ● 3+ years of experience on Data Warehousing, Data Engineering or Data Integration projects. ● Expert with data warehousing concepts, strategies,...

  • Senior Data Engineer

    2 months ago

    Trivandrum, India Quantiphi Full time

    Role: Senior Data EngineerExperience Level: 4 to 7 YearsWork location: Trivandrum (Hybrid Only)Required Skills:● Bachelor’s degree in Computer Science or similar field or equivalent work experience.● 3+ years of experience on Data Warehousing, Data Engineering or Data Integration projects.● Expert with data warehousing concepts, strategies, and...

  • Senior Data Engineer

    3 weeks ago

    Trivandrum, India Quantiphi Full time

    Role: Senior Data EngineerExperience Level: 4 to 7 YearsWork location: Trivandrum (Hybrid Only)Required Skills:● Bachelor’s degree in Computer Science or similar field or equivalent work experience.● 3+ years of experience on Data Warehousing, Data Engineering or Data Integration projects.● Expert with data warehousing concepts, strategies, and...

  • Senior Data Engineer

    3 weeks ago

    Trivandrum, India Quantiphi Full time

    Role : Senior Data Engineer Experience Level : 4 to 7 Years Work location : Trivandrum (Hybrid Only) Required Skills : ● Bachelor’s degree in Computer Science or similar field or equivalent work experience. ● 3+ years of experience on Data Warehousing, Data Engineering or Data Integration projects. ● Expert with data warehousing concepts, strategies,...

  • Ospyn Technologies

    2 weeks ago

    Trivandrum/Thiruvananthapuram, India Ospyn Technologies Pvt. Ltd. Full time

    Work Mode : Work from OfficeJob Type : Full TimeQualification : BTech/ BCA/ MCARequirements :- Lead the design and implementation of a scalable AI based Data analytic application using Python (including python web framework flask/Django). - Hands on experience in developing Machine learning models using Python.- Hands on experience in data analytics using...

  • Technical Lead

    1 week ago

    Trivandrum/Thiruvananthapuram, India Excellence and Eminence LLP Full time

    We are seeking a Technical Lead - Embedded Zigbee with 9 to 12 years of hands-on experience for a prestigious client based in Trivandrum.Key Skills:NFCZigbeeRF principlesCThis is a time-sensitive opportunity. If you are capable of commencing work within or around 30 days, we welcome your application.Responsibilities:Lead and guide a team of software...

  • Senior Data Engineer

    2 months ago

    Trivandrum, India Quantiphi Full time

    Role : Senior Data EngineerExperience Level : 4 to 7 YearsWork location : Trivandrum (Hybrid Only)Required Skills :● Bachelor’s degree in Computer Science or similar field or equivalent work experience.● 3+ years of experience on Data Warehousing, Data Engineering or Data Integration projects.● Expert with data warehousing concepts, strategies, and...

  • Senior Data Engineer

    1 week ago

    Thiruvananthapuram, Kerala, India Nissan Motor Full time

    Nissan is a pioneer in Innovation and Technology. With a focus on Mobility, Operational Excellence, Value to our Customers and Electrification of vehicles, you can expect to be part of a very exciting journey here at Nissan. Nissan is going after a massive Digital Transformation backed by leading technologies across the organization globally. We are...

  • Senior Data Engineer

    4 weeks ago

    Thiruvananthapuram, India Nissan Motor Full time

    Nissan is a pioneer in Innovation and Technology. With a focus on Mobility, Operational Excellence, Value to our Customers and Electrification of vehicles, you can expect to be part of a very exciting journey here at Nissan. Nissan is going after a massive Digital Transformation backed by leading technologies across the organization globally. We are...

  • Senior Data Engineer

    3 weeks ago

    thiruvananthapuram, India Nissan Motor Full time

    Nissan is a pioneer in Innovation and Technology. With a focus on Mobility, Operational Excellence, Value to our Customers and Electrification of vehicles, you can expect to be part of a very exciting journey here at Nissan. Nissan is going after a massive Digital Transformation backed by leading technologies across the organization globally. We are...

  • Senior Data Engineer

    3 weeks ago

    Thiruvananthapuram, India Nissan Motor Full time

    Nissan is a pioneer in Innovation and Technology. With a focus on Mobility, Operational Excellence, Value to our Customers and Electrification of vehicles, you can expect to be part of a very exciting journey here at Nissan. Nissan is going after a massive Digital Transformation backed by leading technologies across the organization globally. We are...

  • Senior Data Engineer

    4 weeks ago

    thiruvananthapuram, India Nissan Motor Full time

    Nissan is a pioneer in Innovation and Technology. With a focus on Mobility, Operational Excellence, Value to our Customers and Electrification of vehicles, you can expect to be part of a very exciting journey here at Nissan. Nissan is going after a massive Digital Transformation backed by leading technologies across the organization globally. We are...

  • Ospyn - Lead Data Science Engineer - Machine Learning

    1 month ago

    Trivandrum/Thiruvananthapuram, India Ospyn Technologies Pvt Ltd Full time

    Job Description : - Hands on experience in developing Machine learning models using python- Hands on experience in data analytics using python- Hands on experience in computer vision- Good knowledge in Machine learning algorithms and concepts- Develop, test, and deploy python-based applications.- Write clean and maintainable code while following best...

  • Ospyn - Lead Data Science Engineer - Machine Learning

    3 weeks ago

    Trivandrum/Thiruvananthapuram, India Ospyn Technologies Pvt Ltd Full time

    Job Description : - Hands on experience in developing Machine learning models using python- Hands on experience in data analytics using python- Hands on experience in computer vision- Good knowledge in Machine learning algorithms and concepts- Develop, test, and deploy python-based applications.- Write clean and maintainable code while following best...