Lead Data Engineer

2 weeks ago

Bhubaneswar, India Spikewell Full time
Job Description

Job Title: Lead Data Engineer

Location: Bhubaneswar, India
Job Type: Full-time

 

Spikewell India Pvt. Ltd (a subsidiary of Spikewell LLC, USA) is a rapidly growing Information Technology products and services company. We pioneer in providing innovative, scalable, robust, and secure solutions in the ever-changing technology landscape of Web, Mobile, Cloud, AI/ML, and Blockchain technologies. Spikewell's portfolio includes leading consumer banks, large health care institutions, and rapidly growing AdTech companies. We are constantly pursuing acquiring and retaining the best talent with competitive employment benefits and fostering a supportive work environment.

 

Job Overview:

We are seeking an experienced and a highly skilled Azure Data Engineer with 4+ years of experience to join our Data Engineering team, playing a critical role in supporting and enhancing our client’s Azure Data Lakehouse environment. This role involves developing, maintaining, and optimizing data pipelines using Azure Data Factory, ensuring efficient data ingestion and ETL processes from various upstream sources. Additionally, the role includes data modeling to design and implement models that fulfill both analytical and operational requirements, aligning with business needs and best practices. The team will work closely with our client’s onshore team to manage and organize large datasets, ensuring data quality, integrity, and security while adhering to healthcare regulations and standards. The team will also support data governance through the use of Informatica, implementing policies, managing data catalogs, and maintaining data lineage and metadata. The team members are expected to be available online until at least 11am EST to facilitate seamless communication with the onshore team.

 

Key Responsibilities:

  • Develop, maintain, and optimize data pipelines using Azure Data Factory for efficient data ingestion and ETL processes.
  • Design and implement scalable data models that meet both analytical and operational needs.
  • Manage and organize large datasets to ensure data quality, integrity, and compliance with healthcare regulations.
  • Troubleshoot and resolve data-related issues to enhance system performance and reliability.
  • Assist in managing the data governance platform (Informatica), including data cataloging, metadata management, and data lineage.
  • Implement and enforce data governance policies and procedures.
  • Participate in data quality initiatives to ensure accuracy, integrity, and consistency across datasets.
  • Collaborate with onshore team members, maintaining overlapping working hours as needed for effective communication.

 

Required Skills and Knowledge:

  • 4+ Years of Experience: 4+ years of relevant experience in data engineering is a must.
  • Azure Data Lakehouse Proficiency: Experience with Azure Data Lakehouse architecture for data storage and analytics.
  • Azure Data Factory Expertise: Skilled in developing, maintaining, and optimizing data pipelines using Azure Data Factory for data ingestion and ETL processes..
  • Data Modeling Skills: Ability to design and implement efficient data models that meet analytical and operational requirements..
  • Informatica Experience: Knowledge of using Informatica for data governance, including data cataloging, metadata management, and data lineage.
  • Data Governance Principles: Familiarity with data governance implementation and policy enforcement.
  • Data Quality Management: Experience in maintaining data accuracy, integrity, and consistency across large datasets.
  • Healthcare Data Regulations: Understanding of healthcare industry standards and regulations such as HIPAA to ensure data security and compliance.
  • SQL and Programming Skills: Proficiency in SQL and possibly other programming languages like Python or Scala used in data engineering.
  • Large Dataset Management: Ability to manage and organize large volumes of data efficiently.
  • Data Security Practices: Knowledge of best practices for securing sensitive data within cloud environments.
  • Relevant certification (e.g., Microsoft Certified: Azure Data Engineer Associate) is preferred.

 

Education Requirements:

  • Bachelor’s degree in Computer Science, Information Technology, or a related field, with 4+ years of relevant experience.

 

What We Offer:

  • A chance to work with some of the world’s leading healthcare providers.
  • Competitive salary and benefits package.
  • Opportunities for professional development and certifications.
  • A collaborative and innovative work environment, with a focus on healthcare IT.
  • The opportunity to work on impactful projects that improve patient care and healthcare services.

 

How to Apply:

Please submit your resume and a cover letter detailing your relevant experience to hr@spikewell.com



Requirements
Azure Data Lakehouse Proficiency , Azure Data Factory Expertise, ETL Data Modeling, Data Quality Management, SQL , Python , Scala, Large Dataset Management, HIPAA

  • Lead Data Engineer

    2 weeks ago

    Bhubaneswar, India Spikewell Full time

    Job Title: Lead Data EngineerLocation: Bhubaneswar, IndiaJob Type: Full-time Spikewell India Pvt. Ltd (a subsidiary of Spikewell LLC, USA) is a rapidly growing Information Technology products and services company. We pioneer in providing innovative, scalable, robust, and secure solutions in the ever-changing technology landscape of Web, Mobile, Cloud,...

  • Azure Data Engineer

    3 weeks ago

    Bhubaneswar, India Spikewell Full time

    Job DescriptionJob Title: Azure Data EngineerLocation: Bhubaneswar, IndiaJob Type: Full-time Spikewell India Pvt. Ltd (a subsidiary of Spikewell LLC, USA) is a rapidly growing Information Technology products and services company. We pioneer in providing innovative, scalable, robust, and secure solutions in the ever-changing technology landscape of Web,...

  • Azure Data Engineer

    3 weeks ago

    Bhubaneswar, India Spikewell Full time

    Job Title: Azure Data EngineerLocation: Bhubaneswar, IndiaJob Type: Full-time Spikewell India Pvt. Ltd (a subsidiary of Spikewell LLC, USA) is a rapidly growing Information Technology products and services company. We pioneer in providing innovative, scalable, robust, and secure solutions in the ever-changing technology landscape of Web, Mobile, Cloud,...

  • Lead Network and Security Engineer

    2 weeks ago

    Bhubaneswar, India Spikewell Full time

    Job Title: Lead Network and Security EngineerLocation: Bhubaneswar, IndiaJob Type: Full-timeSpikewell India Pvt. Ltd (a subsidiary of Spikewell LLC, USA) is a rapidly growing Information Technology products and services company. We pioneer in providing innovative, scalable, robust, and secure solutions in the ever-changing technology landscape of Web,...

  • Lead Network and Security Engineer

    2 weeks ago

    Bhubaneswar, India Spikewell Full time

    Job DescriptionJob Title: Lead Network and Security EngineerLocation: Bhubaneswar, IndiaJob Type: Full-timeSpikewell India Pvt. Ltd (a subsidiary of Spikewell LLC, USA) is a rapidly growing Information Technology products and services company. We pioneer in providing innovative, scalable, robust, and secure solutions in the ever-changing technology landscape...

  • Data Engineering

    1 day ago

    Bhubaneswar, India 2coms Full time

    Job DescriptionOur Client: Global Fortune 500 IT solutions company specializing in delivering simple and scalable solutions to address complex business problems. More than 500,000 staff delivers technical and domain expertise across multiple platforms and industries to help enterprise companies drive productivity, efficiency and gain the most out of their...

  • Data Engineering

    1 day ago

    Bhubaneswar, India 2coms Full time

    Our Client: Global Fortune 500 IT solutions company specializing in delivering simple and scalable solutions to address complex business problems. More than 500,000 staff delivers technical and domain expertise across multiple platforms and industries to help enterprise companies drive productivity, efficiency and gain the most out of their technology...

  • Artificial intelligence engineer

    1 month ago

    Bhubaneswar, India Deloitte Full time

    We are looking for Candidates who are having experience as AI/ML and Gen AI Engineer. Experience Required: 10+ years. Location: Bhubaneswar, Odisha Responsibilities: 10+ years of experience in AI-ML/Gen AI (Data Science), with a focus on generative models, including but not limited to GANs (Generative Adversarial Networks), VAEs (Variational...

  • Artificial Intelligence Engineer

    2 months ago

    bhubaneswar, India Deloitte Full time

    We are looking for Candidates who are having experience as AI/ML and Gen AI Engineer. Experience Required: 10+ years. Location: Bhubaneswar, Odisha Responsibilities: 10+ years of experience in AI-ML/Gen AI (Data Science), with a focus on generative models, including but not limited to GANs (Generative Adversarial Networks), VAEs (Variational Autoencoders),...

  • Artificial Intelligence Engineer

    1 month ago

    Bhubaneswar, India Deloitte Full time

    We are looking for Candidates who are having experience as AI/ML and Gen AI Engineer. Experience Required: 10+ years. Location: Bhubaneswar, Odisha Responsibilities: 10+ years of experience in AI-ML/Gen AI (Data Science), with a focus on generative models, including but not limited to GANs (Generative Adversarial Networks), VAEs (Variational...

  • Artificial intelligence engineer

    4 weeks ago

    Bhubaneswar, India Deloitte Full time

    We are looking for Candidates who are having experience as AI/ML and Gen AI Engineer.Experience Required: 10+ years.Location: Bhubaneswar, OdishaResponsibilities:10+ years of experience in AI-ML/Gen AI (Data Science), with a focus on generative models, including but not limited to GANs (Generative Adversarial Networks), VAEs (Variational Autoencoders), and...

  • Artificial Intelligence Engineer

    3 months ago

    bhubaneswar, India Deloitte Full time

    We are looking for Candidates who are having experience as AI/ML and Gen AI Engineer.Experience Required: 10+ years.Location: Bhubaneswar, OdishaResponsibilities:10+ years of experience in AI-ML/Gen AI (Data Science), with a focus on generative models, including but not limited to GANs (Generative Adversarial Networks), VAEs (Variational Autoencoders), and...

  • Artificial Intelligence Engineer

    2 months ago

    bhubaneswar, India Deloitte Full time

    We are looking for Candidates who are having experience as AI/ML and Gen AI Engineer.Experience Required: 10+ years.Location: Bhubaneswar, OdishaResponsibilities:10+ years of experience in AI-ML/Gen AI (Data Science), with a focus on generative models, including but not limited to GANs (Generative Adversarial Networks), VAEs (Variational Autoencoders), and...

  • Artificial Intelligence Engineer

    3 months ago

    Bhubaneswar, India Deloitte Full time

    We are looking for Candidates who are having experience as AI/ML and Gen AI Engineer.Experience Required: 10+ years.Location: Bhubaneswar, OdishaResponsibilities:10+ years of experience in AI-ML/Gen AI (Data Science), with a focus on generative models, including but not limited to GANs (Generative Adversarial Networks), VAEs (Variational Autoencoders), and...

  • Artificial Intelligence Engineer

    3 months ago

    Bhubaneswar, India Deloitte Full time

    We are looking for Candidates who are having experience as AI/ML and Gen AI Engineer. Experience Required: 10+ years. Location: Bhubaneswar, Odisha Responsibilities: 10+ years of experience in AI-ML/Gen AI (Data Science), with a focus on generative models, including but not limited to GANs (Generative Adversarial Networks), VAEs (Variational Autoencoders),...

  • Lead Azure Administrator

    2 weeks ago

    Bhubaneswar, India Spikewell Full time

    Job Title: Lead Azure AdministratorLocation: Bhubaneswar, IndiaJob Type: Full-time Spikewell India Pvt. Ltd (a subsidiary of Spikewell LLC, USA) is a rapidly growing Information Technology products and services company. We pioneer in providing innovative, scalable, robust, and secure solutions in the ever-changing technology landscape of Web, Mobile, Cloud,...

  • Artificial Intelligence Engineer

    1 month ago

    bhubaneswar, India Deloitte Full time

    We are looking for Candidates who are having experience as AI/ML and Gen AI Engineer.Experience Required: 10+ years.Location: Bhubaneswar, OdishaResponsibilities:10+ years of experience in AI-ML/Gen AI (Data Science), with a focus on generative models, including but not limited to GANs (Generative Adversarial Networks), VAEs (Variational Autoencoders), and...

  • Lead Azure Administrator

    2 weeks ago

    Bhubaneswar, India Spikewell Full time

    Job DescriptionJob Title: Lead Azure AdministratorLocation: Bhubaneswar, IndiaJob Type: Full-time Spikewell India Pvt. Ltd (a subsidiary of Spikewell LLC, USA) is a rapidly growing Information Technology products and services company. We pioneer in providing innovative, scalable, robust, and secure solutions in the ever-changing technology landscape of Web,...

  • Senior Data Scientist

    2 months ago

    bhubaneswar, India Deloitte Full time

    Hi, We are looking for Candidates who are having experience as Senior Data Scientist Role.Experience Required: 6+ years.Location: Mumbai, Pune, Bhubaneswar Responsibilities:At-least 6+ years of proven experience as a data scientistExperience in designing solutions utilizing Generative AI,AI and ML components. - Hands-on experience in working with Vertex AI...

  • Azure Network and Security Engineer

    3 weeks ago

    Bhubaneswar, India Spikewell Full time

    Job Title: Azure Network and Security EngineerLocation: Bhubaneswar, IndiaJob Type: Full-timeSpikewell India Pvt. Ltd (a subsidiary of Spikewell LLC, USA) is a rapidly growing Information Technology products and services company. We pioneer in providing innovative, scalable, robust, and secure solutions in the ever-changing technology landscape of Web,...