Data Engineer

1 week ago

Bengaluru, Karnataka, India Cloudwick Technologies India Pvt Ltd Full time

About the Job:

At Cloudwick Technologies India Pvt Ltd, we're seeking a skilled Data Engineer to join our team in Bangalore. As a Data Engineer in our Healthcare Data Engineering team, you'll play a key role in designing, developing, and maintaining ETL processes and data pipelines with Scala/PySpark, ensuring seamless integration of healthcare data formats such as HL7 and FHIR. Your expertise will be vital in collaborating with data scientists, analysts, and healthcare stakeholders to understand data requirements and model Electronic Health Records (EHR) and Electronic Case Report (ECR) for high-quality, compliant data solutions.

A Typical Day:

As a Data Engineer at Cloudwick, you'll be responsible for:

  • ● Designing, developing, and maintaining ETL processes and data pipelines with Scala/PySpark, ensuring seamless integration of healthcare data formats such as HL7 and FHIR.
  • ● Collaborating with data scientists, analysts, and healthcare stakeholders to understand data requirements and model Electronic Health Records (EHR) and Electronic Case Report (ECR) for high-quality, compliant data solutions.
  • ● Optimizing and tuning data pipelines for performance and scalability, ensuring rapid access to critical healthcare information.
  • ● Ensuring data quality and integrity through robust testing and validation processes, adhering to healthcare regulations.
  • ● Implementing data governance and security best practices to protect sensitive patient information.
  • ● Monitoring and troubleshooting data pipelines to ensure continuous data flow, promptly addressing any issues to maintain operational efficiency.
  • ● Staying up-to-date with the latest trends and technologies in data engineering, particularly in the healthcare sector.

Requirements:

To be successful in this role, you'll need:

  • ● B.E/B.Tech, preferably in Computer Science or Engineering.
  • ● 5+ years of experience in handling data and designing ETL pipelines, with mandatory 4+ years of experience writing PySpark code, specifically in healthcare applications.
  • ● Proven experience working on AWS using services like S3, Glue, Redshift, Lambda, IAM, and DynamoDB, focusing on healthcare data management.
  • ● Demonstrated experience in capturing data requirements from product owners and business users within the healthcare domain, particularly around EHR and ECR systems.
  • ● Good to have exposure to data modeling, data analytics, and design in both batch processing and real-time streaming, especially for healthcare applications.
  • ● Solid understanding of data mapping, data processing patterns, distributed computing, and building applications for real-time and batch analytics in a healthcare context, including HL7 and FHIR standards.
  • ● Strong programming skills in design and implementation using Python and PySpark.
  • ● Good exposure to database architecture with Redshift, specifically for healthcare datasets.
  • ● Experience with multiple file formats such as Avro, Parquet, ORC, and JSON, particularly in the context of healthcare data analytics.
  • ● Developing, constructing, testing, and maintaining architectures for data lakes, data pipelines, data warehouses, and large-scale data processing systems on AWS, focusing on healthcare applications.
  • ● Extensive experience using Spark, Scala, PySpark, Python, and SQL to handle complex healthcare data transformations.
  • ● Hands-on experience in using AWS services like S3, Glue, Lambda, Redshift, and IAM for healthcare solutions.
  • ● Experience with client interactions in the healthcare domain, ensuring the delivery of data solutions that meet regulatory standards.
  • ● Proficient in writing complex SQL queries for healthcare data analysis.
  • ● Preferred experience in the healthcare domain, with knowledge of EHR, ECR, and familiarity with HL7 and FHIR standards.
  • ● AWS certifications relevant to data engineering and healthcare solutions are a plus.

Benefits:

At Cloudwick, we offer a comprehensive benefits package, including:

  • ● Competitive salaries and bonuses.
  • ● Flexible working hours.
  • ● Health insurance.
  • ● Life and disability insurance.
  • ● Eligibility for the provident fund.
  • ● Unlimited Paid Time Off (PTO) with a mandatory minimum of 1 week/year.
  • ● Paid vacation days, sick leaves, and holidays.
  • ● Parental leave (maternity, paternity, adoption leave).
  • ● Bereavement leave.
  • ● Certification and training programs.
  • ● Company-sponsored events and outings.
  • ● Recognition and reward programs.
  • ● Provision of laptops, mobile devices, and other necessary equipment.
  • ● Access to software and tools for remote work.
  • ● Team-building activities and retreats.

House Values:

We're committed to building a culture that aligns with our House Values:

  • ● One Team: Prioritize the company, your team, and yourself – in that order. Support your co-workers with empathy and give more than you take to build the ideal Cloudwick community.
  • ● Tough & Persevering: We operate in a large, fast-growing, and competitive space. Embrace challenges with positivity, focus on moving forward, and develop a champion's mindset to overcome obstacles. Always day one.
  • ● Keep Making It Better Always: Continuous improvement is key. Being organized, communicating promptly, taking small tasks seriously, tracking ideas, and paying them forward can make a significant impact over time.
  • ● Think Big, Act Fast: Innovation is boundless, but impact is essential. Strategize bold ideas, set them in motion rapidly, measure, refine, and repeat. Excellent execution sets apart promising companies from proven unicorns.

Work Location- Bangalore Work Mode- Office

  • Data Engineer

    4 weeks ago

    Bengaluru, Karnataka, India NTT DATA Full time

    Job Title: Data EngineerJob Summary:We are seeking a highly skilled Data Engineer to join our team at NTT DATA. As a Data Engineer, you will be responsible for designing, building, and maintaining large-scale data systems and pipelines using Azure data factory and Azure databricks.Key Responsibilities:Design and develop innovative data pipelines using Azure...

  • Data Engineer

    2 weeks ago

    Bengaluru, Karnataka, India NTT DATA Full time

    Job DescriptionData Engineer - Diverse Data Engineering Activities on Azure Data PlatformMain Responsibilities:Design and develop big data processing notebooks using Azure DatabricksLead the data identification, data analysis efforts for data sources and work directly with data owner teamsDevelop data requirements for new data sourcesDesign and development...

  • Senior Data Engineer

    1 week ago

    Bengaluru, Karnataka, India NTT DATA Full time

    Job Description Data Engineer - Cloud Solutions Diverse Data Engineering activities on Azure Data platform. Build & Deliver Data pipeline connecting various enterprise data sources. Develop data mappings to existing data sources. Design and develop big data processing notebooks using Azure Databricks. Scripting and programming using programming languages...

  • Senior Data Engineer

    4 weeks ago

    Bengaluru, Karnataka, India NTT DATA Full time

    Job Title: Senior Data EngineerJob Summary:We are seeking a highly skilled Senior Data Engineer to join our team in Bangalore, India. The successful candidate will have a strong background in AWS cloud services, expertise in SQL and relational databases, and proficiency in Python programming.Key Responsibilities:Design and implement data engineering...

  • Data Visualization Engineer

    3 weeks ago

    Bengaluru, Karnataka, India NTT DATA Full time

    Job Title: Data Visualization EngineerJob Summary:Data Visualization Engineer - NTT DATAData visualization engineers utilize expertise in information visualization and design to create and deploy new platforms and services for visualization initiatives. Visualization specialists build interactive and complex data visualizations and analysis tools. They are...

  • Data Engineer

    1 week ago

    Bengaluru, Karnataka, India NTT DATA Full time

    Job DescriptionReq ID: 301470NTT DATA is seeking a skilled Data Engineer to partner with stakeholders across business units to develop analyses and documentation in a collaborative way.The ideal candidate will have three or more years of experience with Python, SQL, and data visualization/exploration tools, as well as familiarity with the AWS ecosystem.About...

  • Data Engineering Specialist

    2 weeks ago

    Bengaluru, Karnataka, India NTT DATA Full time

    Job SummaryReq ID: 302206NTT DATA is seeking a highly skilled Senior Data Engineer to join our team in Bangalore, India.Job PurposeThe Senior Data Engineer will play a key role within the Data & Analytics team, designing, building, and maintaining systems and infrastructure for processing, collecting, storing, and analyzing large volumes of data.Key...

  • Data Engineer

    3 weeks ago

    Bengaluru, Karnataka, India NTT DATA Services Full time

    About the RoleWe are seeking a highly skilled Data Engineer to join our team at NTT DATA Services. As a Data Engineer, you will be responsible for designing and developing data pipelines utilizing Cloud technologies Azure/AWS/GCP.Key ResponsibilitiesDesign and develop data pipelines using Cloud technologies Azure/AWS/GCPLead a team of Data Engineers and act...

  • Data Engineer

    2 weeks ago

    Bengaluru, Karnataka, India NTT DATA Full time

    Job DescriptionKey Skills and Qualifications:Cloud Platforms: Proficient in AWS.Programming Languages: Expert in SQL and Python.ETL Tools: Experience with ETL tools and frameworks.Requirements:Education: Bachelor's degree in Computer Science, Information Technology, Engineering, or a related field.Skills:Proven experience in using Snowflake for data...

  • Data Systems Engineer

    1 week ago

    Bengaluru, Karnataka, India NTT DATA Full time

    About the RoleNTT DATA is seeking a highly skilled Senior Data Engineer to join our team in Bangalore, India. The ideal candidate will have a strong background in designing, building, and maintaining data systems.Key ResponsibilitiesDesign and develop data warehouses and data models to support business intelligence and analytics.Create and maintain data...

  • Senior Data Engineer

    4 weeks ago

    Bengaluru, Karnataka, India NTT DATA Full time

    Job OpportunityReq ID: 286326 NTT DATA Services is a global leader in IT and business services, committed to helping clients succeed in a rapidly changing world. We are seeking a talented Sr Data Engineer to join our team in Bangalore, India.This role requires a strong background in AWS cloud services, including Lambda, Glue, S3, EMR, SNS, SQS, CloudWatch,...

  • Data Engineer

    4 weeks ago

    Bengaluru, Karnataka, India NTT DATA Services Full time

    Job Title: Data SpecialistWe are seeking a highly skilled Data Specialist to join our team in Bangalore, India. As a Data Specialist, you will be responsible for designing and developing data pipelines utilizing cloud technologies such as Azure, AWS, and GCP.Key Responsibilities:Design and develop data pipelines using cloud technologiesLead a team of data...

  • Data Engineer Lead

    1 week ago

    Bengaluru, Karnataka, India NTT DATA Services Full time

    Data Engineer LeadData Engineers within NTT DATA Services drive the creation of innovative data solutions that benefit our clients. As a Data Engineer Lead, you will be responsible for leading diverse data engineering activities on the Azure Data platform, including the development and delivery of data pipelines connecting various enterprise data sources,...

  • Power BI Data Engineer

    1 week ago

    Bengaluru, Karnataka, India NTT DATA Full time

    About the RoleNTT DATA is seeking a highly skilled Data Engineer for Power BI Development to join our team in India.The ideal candidate will have extensive experience with Power BI reporting development, a solid understanding of relational and distributed database systems, and strong analytical skills.Key Responsibilities:Develop and implement Power BI...

  • Data Engineering Specialist

    2 weeks ago

    Bengaluru, Karnataka, India NTT DATA Full time

    About the JobThis position requires a highly skilled Data Engineer to design, build, and maintain scalable data pipelines using Databricks on AWS. The ideal candidate will have strong experience with Databricks, including Apache Spark development, and proficiency in Python or Scala for Spark job development.Key ResponsibilitiesDesign, build, and maintain...

  • Data Engineer

    1 week ago

    Bengaluru, Karnataka, India NTT DATA Services Full time

    Job DescriptionWe are seeking a highly skilled Data Engineer to join our team at NTT DATA Services.About the Role:The ideal candidate will have a strong background in data engineering, with expertise in designing and implementing automated data pipelines, analyzing complex datasets, and providing actionable insights.Key Responsibilities:Develop and maintain...

  • Data Visualization Engineer

    4 weeks ago

    Bengaluru, Karnataka, India NTT DATA Services Full time

    Job Title: Data Visualization EngineerJob Summary:We are seeking a highly skilled Data Visualization Engineer to join our team at NTT DATA Services. As a Data Visualization Engineer, you will be responsible for designing, developing, and maintaining interactive dashboards and reports using PowerBI.Key Responsibilities:Design and develop interactive...

  • Data Engineering Specialist

    1 week ago

    Bengaluru, Karnataka, India NTT DATA Services Full time

    Job Requirements:NTT DATA Services is seeking a skilled Data Engineer to join our team in Bangalore, India. In this role, you will work closely with the GenAI architect to design and implement automated data pipelines.Key Responsibilities:Analyze and understand source data, preparing and managing data sets for actionable insights.Collaborate with Data...

  • Data Engineer

    4 weeks ago

    Bengaluru, Karnataka, India NTT DATA Services Full time

    About NTT DATANTT DATA is a global leader in business and technology services, serving 75% of the Fortune Global 100. We help clients innovate, optimize, and transform for long-term success. Our diverse experts in over 50 countries and robust partner ecosystem enable us to deliver cutting-edge solutions.Job DescriptionWe are seeking a skilled Data Engineer...

  • Data Engineer

    4 weeks ago

    Bengaluru, Karnataka, India Data Labs - LANDMARK GROUP Full time

    Job Title: Lead Data EngineerLocation: BangaloreJob SummaryWe are seeking a highly skilled Lead Data Engineer to join our team at Data Labs - LANDMARK GROUP. As a Lead Data Engineer, you will be responsible for leading our engineering team in building and deploying cutting-edge analytics products for consumption by different stakeholders.Key...