15h Left Data Engineering Consultant

2 weeks ago

Noida, Uttar Pradesh, India Optum Full time
Job Description

Optum is a global organization that delivers care, aided by technology to help millions of people live healthier lives. The work you do with our team will directly improve health outcomes by connecting people with the care, pharmacy benefits, data and resources they need to feel their best. Here, you will find a culture guided by inclusion, talented peers, comprehensive benefits and career development opportunities. Come make an impact on the communities we serve as you help us advance health optimization on a global scale. Join us to start Caring. Connecting. Growing together.

Primary Responsibilities:

- Ingest data from multiple on-prem and cloud data sources using various tools & capabilities in Azure
- Design and develop Azure Databricks processes using PySpark/Spark-SQL
- Design and develop orchestration jobs using ADF, Databricks Workflow
- Analyzing data engineering processes being developed and act as an SME to troubleshoot performance issues and suggest solutions to improve
- Building test framework for the Databricks notebook jobs for automated testing before code deployment
- Design and build POCs to validate new ideas, tools, and architectures in Azure
- Continuously explore new Azure services and capabilities assess their applicability to business needs
- Prepare case studies and technical write-ups to showcase successful implementations and lessons learned
- Work closely with clients, business stakeholders, and internal teams to gather requirements and translate them into technical solutions using best practices and appropriate architecture
- Contribute to full lifecycle project implementations, from design and development to deployment and monitoring
- Ensure solutions adhere to security, compliance, and governance standards
- Monitor and optimize data pipelines and cloud resources for cost and performance efficiency
- Identifies solutions to non-standard requests and problems
- Mentor and support existing on-prem developers for cloud environment
- Comply with the terms and conditions of the employment contract, company policies and procedures, and any and all directives (such as, but not limited to, transfer and/or re-assignment to different work locations, change in teams and/or work shifts, policies in regards to flexibility of work benefits and/or work environment, alternative work arrangements, and other decisions that may arise due to the changing business environment). The Company may adopt, vary or rescind these policies and directives in its absolute discretion and without any limitation (implied or otherwise) on its ability to do so

Required Qualifications:

- Undergraduate degree or equivalent experience
- 7+ years of overall experience in Data & Analytics engineering
- 5+ years of experience working with Azure, Databricks, and ADF, Data Lake
- 5+ years of experience working with data platform or product using PySpark and Spark-SQL
- Solid experience with CICD tools such as Jenkins, GitHub, Github Actions, Maven etc.
- In-depth understanding of Azure architecture & ability to come up with efficient design & solutions
- Highly proficient in Python and SQL
- Proven excellent communication skills
- Key Skill: Azure Data Engineer - Azure Databricks, Azure Data factory, Python/Pyspark, Terraform

  • 15h Left Systems Engineering Senior Specialist

    4 weeks ago

    Noida, Uttar Pradesh, India NTT Data Full time

    Job DescriptionReq ID:331968NTT DATA strives to hire exceptional, innovative and passionate individuals who want to grow with us. If you want to be part of an inclusive, adaptable, and forward-thinking organization, apply now.We are currently seeking a Systems Engineering Senior Specialist -Patching/Distribution SME to join our team in Noida, Uttar Pradesh...

  • 15h Left Salesforce Devops

    2 weeks ago

    Noida, Uttar Pradesh, India NTT Data Full time

    Job DescriptionNTT DATA strives to hire exceptional, innovative and passionate individuals who want to grow with us. If you want to be part of an inclusive, adaptable, and forward-thinking organization, apply now.We are currently seeking a Salesforce Devops to join our team in Noida, Uttar Pradesh, India.- Design, implement, and maintain CI/CD pipelines for...

  • Data Engineer

    2 weeks ago

    Noida, Uttar Pradesh, India NTT DATA Full time

    Req ID 303115NTT DATA strives to hire exceptional innovative and passionate individuals who want to grow with us If you want to be part of an inclusive adaptable and forward-thinking organization apply now We are currently seeking a Data Engineer to join our team in Noida Uttar Pradesh IN-UP India IN Job Duties As a data engineer you will have a...

  • 15h Left: Senior Infosec Consultant

    1 week ago

    Noida, Uttar Pradesh, India Tsaaro Consulting Full time

    Job DescriptionJob DescriptionAbout UsTsaaros prime focus is on Data Privacy and Security. Our team of specialist data privacy consultants, information security consultants, and penetration testers help and advise our clients to make running a secure business easier, with high efficiency. Everything we do is tailored to the individual organizational...

  • 15h Left: Lead consultant

    1 day ago

    Noida, Uttar Pradesh, India Genpact Full time

    Job DescriptionReady to build the future with AIAt Genpact, we don't just keep up with technology-we set the pace. AI and digital innovation are redefining industries, and we're leading the charge. Genpact's AI Gigafactory, our industry-first accelerator, is an example of how we're scaling advanced technology solutions to help global enterprises work...

  • Industry Consulting Senior Consultant

    4 weeks ago

    Noida, Uttar Pradesh, India NTT DATA Full time

    Req ID 298525NTT DATA strives to hire exceptional innovative and passionate individuals who want to grow with us If you want to be part of an inclusive adaptable and forward-thinking organization apply now We are currently seeking a Industry Consulting Senior Consultant to join our team in Noida Uttar Pradesh IN-UP India IN ECM DeveloperAs a ECM...

  • 15h Left: Data Science

    4 hours ago

    Noida, Uttar Pradesh, India Iris Software Inc. Full time

    Job DescriptionWhy Join IrisAre you ready to do the best work of your career at one of Indias Top 25 Best Workplaces in IT industry Do you want to grow in an award-winning culture that truly values your talent and ambitionsJoin Iris Software one of the fastest-growing IT services companies where you own and shape your success story.About UsAt Iris Software,...

  • 15h Left Mainframe Developer-life Insurance Domain

    6 days ago

    Noida, Uttar Pradesh, India NTT DATA Full time

    Req ID 340058 NTT DATA strives to hire exceptional innovative and passionate individuals who want to grow with us If you want to be part of an inclusive adaptable and forward-thinking organization apply now We are currently seeking a Mainframe Developer-Life Insurance domain to join our team in Noida Uttar Pradesh IN-UP India IN 7 years ...

  • 15h Left: Senior Engineer

    2 weeks ago

    Noida, Uttar Pradesh, India Arcadis Full time

    Applying your skills knowledge and insight to oversee the delivery of projects on time meeting both quality and budgetary targets whilst striving to exceed client expectations Providing Technical Support and expertise within Asset Management Life Cycle ranging from Technical Project Specification to use off phase and asset optimisation and...

  • Delivery Ism Security Analysis Advisor 15h Left

    4 weeks ago

    Noida, Uttar Pradesh, India NTT DATA Full time

    Req ID 285586NTT DATA Services strives to hire exceptional innovative and passionate individuals who want to grow with us If you want to be part of an inclusive adaptable and forward-thinking organization apply now We are currently seeking a Delivery ISM Security Analysis Advisor to join our team in Noida Uttar Pradesh IN-UP India IN The...