Senior Data Engineer

1 month ago


sany, India Digital Placement Full time
Responsibilities:Design develop and maintain scalable reliable and secure datapipelines to process large volumes of structured and unstructuredhealthcare data using PySpark and cloudbased databases. Collaboratewith data architects data scientists and analysts to understanddata requirements and implement solutions that meet business andtechnical objectives. Leverage AWS or Azure cloud services for datastorage processing and analytics optimizing cost and performance.Utilize tools like Airflow for workflow management and Kubernetesfor container orchestration to ensure seamless deployment scalingand management of data processing applications. Develop andimplement data ingestion transformation and validation processes toensure data quality consistency and reliability across varioushealthcare datasets. Monitor and troubleshoot data pipelinesproactively identifying and resolving issues to minimize downtimeand ensure optimal performance. Establish and enforce dataengineering best practices ensuring compliance with data privacyand security regulations specific to the healthcare industry.Continuously evaluate and adopt new tools technologies andframeworks to improve the data infrastructure and drive innovation.Mentor and guide junior data engineers fostering a culture ofcollaboration learning and growth within the team. Collaborate withcrossfunctional teams to align data engineering efforts withbroader organizational goals and strategies. Is familiar with SOC 2compliance and its impact on company policies and processes.Understands importance of adhering to SOC 2 requirements andmaintains an effort to dosoRequirements:Bachelor s or master s degree in computer science Engineering or arelated field. 3 years of experience in data engineering with astrong background in Apache Spark and cloudbased databases such asSnowflake. Strong Knowledge in Big Data Technologies PySparkthorough in one or more programming language like Python Provenexperience with AWS or Azure cloud services for data storageprocessing and analytics. Expertise in workflow management toolslike Airflow and container orchestration systems such asKubernetes. Strong knowledge of SQL and NoSQL databases as well asdata modeling and schema design principles. Familiarity withhealthcare data standards terminologies and regulations such asHIPAA and GDPR is highly desirable. Excellent problemsolvingcommunication and collaboration skills with the ability to workeffectively in crossfunctional teams. Demonstrated ability tomanage multiple projects prioritize tasks and meet deadlines in afastpaced environment. A strong desire to learn adapt andcontribute to a rapidly evolving datalandscape.

data,cloud,healthcare,dataengineering,databases,management,processing,aws,analytics,airflow


  • Data engineer

    2 weeks ago


    sany, India HR Aspiration Full time

    Senior Data Engineer Expreine : 3 10Years WorkLocation :Bangalore MandatorySkills : Data engineer AWS Athena AWSGlueRedshiftDatalakeLakehousePythonSQLServer Must HaveExperience: 6 yearsof handson data engineeringexperience Expertise with AWS services: S3Redshift EMR Glue Kinesis DynamoDB Buildingbatch and realtime data pipelines Python SQLcoding for data...

  • Data Engineer

    3 days ago


    Sany, India Expedify Full time

    OverviewExpedify.iois looking for an intelligent and detailoriented Data Engineer tojoin our ever expanding team of data engineering and analytics. Thehire will be responsible for building and optimizing our datapipeline architecture optimizing data flow and suggesting the rightset of tooling for thesame.Ourcandidate will be working directly with the senior...


  • sany, India Tekwissen India Full time

    Overview TekWissen Group isa workforce management provider operating throughout India andseveral other countries worldwide. The client below is a leadingtechnology company offering a range of IT solutions to businessesand organizations enabling them to transform their digital futures Position: SeniorAdvisor Data Engineering Location: Bangalore ...

  • Senior Data Architect

    3 weeks ago


    sany, India Geminisolutions Full time

    Senior Data Architect If you have a passion for all things data aninquisitive mind to learn an eye for detail a commitment to thehighest quality of work and a desire to take on additionalresponsibilities for growth we encourage you to apply for thisposition. Immediateresponsibilities: Understand businessdomain key initiatives and quality criteria Lead...

  • Data Engineer

    1 month ago


    Sany, India BTOSC Infotech Full time

    We are looking for an experienced dataengineer to join our team. You will use various methods totransform raw data into useful data systems. For example you llcreate algorithms and conduct statistical analysis. Overall you llstrive for efficiency by aligning data systems with business goals. To succeed in this data engineering positionyou should have strong...

  • Senior API Engineer

    1 week ago


    Sany, India Artmac Soft LLC Full time

    Who we areArtmac Soft is a technology consulting and serviceorientedIT company dedicated to providing innovative technology solutionsand services to Customers. Job Description: Job Title : Senior API Engineer JobType : FullTime Experience : 210years Location : Remote We are looking for a Senior API Engineer to design createand maintain APIs that drive...

  • Data Engineer

    1 month ago


    sany, India TalentPulse Consultant Full time

    Overview: The role of aData Engineer is crucial in our organization as they areresponsible for developing constructing testing and maintainingarchitectures such as databases and largescale processing systems.They play a key role in optimizing data and building the foundationfor data generation and analytics. Data Engineers work closely withdata scientists to...

  • Senior Data Modeler

    3 weeks ago


    sany, India TFO Full time

    JobSummary We are looking for anexperienced and innovative data modeler to join our team. The idealcandidate has a proven track record in designing and implementingdimensional data modelling solutions and thrives in a dynamicfastpaced work environment. If you possess the education and workexperience required we look forward to discussing this role withyou in...

  • URGENT Hiring

    2 days ago


    Sany, India Intellismith Full time

    AboutIntellismith Intellismith foundedin 2019 is a dynamic HR service and technology startup. Our missionis to tackle Indias employability challenges headon. Currently weoperate two key lines of business: recruiting and outsourcing. Withteams based in Noida Chennai Mumbai and Bangalore we collaboratewith top brands in the BFSI and IT sectors. As we chart...

  • Data Engineer

    1 month ago


    sany, India Bista Univarsal Limited Full time

    Overview: The DataEngineer plays a crucial role in our organization by designingdeveloping and maintaining scalable data architecture for ourdataintensive applications. They work closely with data scientistsanalysts and other stakeholders to ensure efficient data flow andutilization across the organization.KeyResponsibilities: Design andimplement scalable...


  • Sany, India SAM Manpower and Career Services LLP Full time

    Role: Python DataEngineer/DeveloperExp: 3 YearsRelevantLocation: PANIndiaPositions: 1Budget: 15LPANotice: Immediate joinersonlyJD:KeyResponsibilities: Lead the development andmaintenance of our Pythonbased data processing and analyticsinfrastructure. Design and implement robust ETLprocesses integrating data from diverse sources.Develop manage and optimize...


  • sany, India BigShyft Full time

    AboutCompany: Our client is aninnovative startup that specializes in data infrastructuresolutions. With a focus on automation and reliability they empowerorganizations to harness the power of their data effectively.Recently acquired their team is expanding and they are seekingtalented individuals to join us in ourmission.JobDescription: As a DatabricksData...

  • AWS Data Engineer

    1 month ago


    Sany, India TalentPulse Consultant Full time

    Overview:The AWS DataEngineer plays a crucial role in our organization by designing andimplementing scalable reliable and secure data solutions in the AWScloud environment. They are responsible for developing andmaintaining data pipelines optimizing data workflows and ensuringthe quality and integrity of our data. This position is essentialfor leveraging...

  • AWS Data Engineer

    3 weeks ago


    sany, India TalentPulse Consultant Full time

    Overview: The AWS DataEngineer plays a crucial role in our organization by designing andimplementing scalable reliable and secure data solutions in the AWScloud environment. They are responsible for developing andmaintaining data pipelines optimizing data workflows and ensuringthe quality and integrity of our data. This position is essentialfor leveraging...


  • Sany, India eTek IT Services, Inc. Full time

    Role :DataEngineerLocation: CincinnatiOhioExperience:5yearsW2ContractJobDescriptionJobOverview:Weare seeking a skilled Data Engineer with a strong background inmortgage banking to join our IT team. The candidate will beinstrumental in constructing testing and maintaining our mortgagebanking data architecture. This includes optimizing data flow andcollection...


  • sany, India Tekwissen India Full time

    Overview TekWissen Group isa workforce management provider operating throughout India andseveral other countries worldwide. The client below is a leadingtechnology company offering a range of IT solutions to businessesand organizations enabling them to transform their digital futures Position: ConsultantData Engineering Location: Bangalore ...


  • Sany, India Tekwissen India Full time

    Overview TekWissen Group isa workforce management provider operating throughout India andseveral other countries worldwide. The client below is a leadingtechnology company offering a range of IT solutions to businessesand organizations enabling them to transform their digital futures Position: ConsultantData Engineering Location: Bangalore ...


  • Sany, India Qcentum Technologies Full time

    Role : Senior DevOps Engineer (AWS or GCPwithPython) 5years of experience building and maintaining GCP or AWSinfrastructure (VPC EC2 Security Groups IAM CloudFront S3RDS). 5 Years of Python experience(Mandatory). EC2 Load Balancers Autoscaling Group (ASG) CloudFrontCloudWatch. Working experience in Terraformis preferred. Trouble Shooting Experience with...


  • sany, India Qcentum Technologies Full time

    Role : Senior DevOps Engineer (AWS or GCPwithPython) 5years of experience building and maintaining GCP or AWSinfrastructure (VPC EC2 Security Groups IAM CloudFront S3RDS). 5 Years of Python experience(Mandatory). EC2 Load Balancers Autoscaling Group (ASG) CloudFrontCloudWatch. Working experience in Terraformis preferred.Trouble Shooting Experience with...

  • Data Scientist

    4 weeks ago


    sany, India YO HR CONSULTANCY Full time

    Title: Senior DataScientist Experience: 2 to 5years Location:Bangalore KeySkills : Bachelors Degree orhigher in Mathematics Statistics Computer Science Data Science DataEngineering or a related field.2 years ofexperience with the following : Manipulatinganalyzing and interpreting complex data sources to tell a storyfrom data through analyses. Programming...