Lead Data Analytics Engineer

2 weeks ago


Delhi, Delhi, India Prudential plc Full time
Job Summary

:


We are seeking a highly skilled Senior Data Engineer with over 8 years of hands-on experience in Spark, Azure components, and Databricks within the insurance industry.

The ideal candidate will possess a deep understanding of data modelling, proficiency in the modern data stack, familiarity with machine learning, a proactive approach to staying updated on cutting-edge technologies, and a proven track record of collaborating with diverse stakeholders in an agile environment.

Build pipelines to ingest a wide variety of data from multiple sources within the organization and from external sources.
Optimize existing pipelinesTesting data structures to ensure that they are fit for use for data analysts and scientists.
Prepare and maintain environments for secure prototyping, development, testing and data manipulation for data scientists.
Design and implement effective data storage solutions and models.
Assist data models and AI/ML deployment.
Assess database implementation procedures to ensure they comply with internal and external regulations.
Prepare accurate database design and architecture reports for management and executive teams.
Oversee the migration of data from legacy systems to new solutions on Cloud infrastructure.
Monitor the system performance by performing regular tests, troubleshooting, and integrating new features.

Automate low value tasksExperience with at least one major Cloud Infrastructure provider (Azure/AWS/GCP)Experience building data pipelines using batch processing with Apache Spark (Spark SQL, DataSet / Dataframe API) or Hive query language (HQL)Knowledge of Big Data ETL processing toolsExperience in Data Modelling, Data mapping for Data Warehouse and Data Marts solutionsExperience with Hive and Hadoop file formats (Avro / Parquet / ORC)Basic knowledge of scripting (shell / bash)Experience of working with multiple data sources including relational databases (SQL Server / Oracle / DB2 / Netezza), NoSQL / document databases, flat filesUnderstanding of CICD tools such as Jenkins, JIRA, Bitbucket, Artifactory, Bamboo and Azure Dev-ops.

DevOps practices using Git version controlAn interest in staying up to date with industry standards and technological advancements that will improve the quality of your outputs.

Ability to debug, fine tune and optimize large scale data processing jobsHighly capable in Python or ScalaSQLDataBricksKnowledge inAzure Data FactoryGoogle Big QueryAzure DevOpsBitBucket or GitHubMachine learningMLFlowKnowledge of life insurance industry preferred.



  • Delhi, Delhi, India Fluidata Analytics Full time

    About Fluidata-Fluidata Analytics is a modern data and analytics consultancy firm. Our team of experts provides end-to-end data engineering and analytics solutions to clients by using cutting-edge data technology and methodologies.Key Responsibilities:Design, develop, and optimize data infrastructure and pipelines.Participate in data modeling, ETL processes,...


  • Delhi, Delhi, India Lapis Data Analytics Full time

    Company DescriptionLapis Data Analytics is a dynamic and innovative data engineering company founded in 2020 and located in Chennai. Our primary focus is on designing, building, and maintaining robust data pipelines that convert raw data into actionable insights. With a team of seasoned experts and cutting-edge technology, we deliver customized data...

  • Operations Specialist

    2 weeks ago


    Delhi, Delhi, India Data Engineer Academy Full time

    Job Title: Operations AnalystLocation : RemoteCompany Overview:Data Engineering Academy is a pioneering force in data engineering education, founded by FAANG data engineers with extensive industry expertise. Our platform provides comprehensive programs tailored to empower aspiring data engineers, equipping them with the skills and confidence necessary to...


  • Delhi, Delhi, India Fluidata Analytics Full time

    Lead Software EngineerLocation – India, RemoteExperience – 10+ years.Notice period – Immediate to 30 days.Start date: 1st July 2024.About Fluidata- Fluidata Analytics is a modern data and analytics consultancy firm.Our team of experts provide end-to-end data engineering and analytics solutions to clients by using cutting-edge data technology and...

  • Operations Specialist

    2 weeks ago


    Delhi, Delhi, India Data Engineer Academy Full time

    Job Title: Operations AnalystLocation : RemoteCompany Overview:Data Engineering Academy is a pioneering force in data engineering education, founded by FAANG data engineers with extensive industry expertise. Our platform provides comprehensive programs tailored to empower aspiring data engineers, equipping them with the skills and confidence necessary to...

  • Data Engineer

    2 weeks ago


    Delhi, Delhi, India LatentView Analytics Full time

    As a Senior Data Engineer, you will collect, aggregate, store, and reconcile data in support of apparel (GBS) business decisions. You will design and build data pipelines, data streams, data service APIs, data generators, and other end-user information portals and insight tools.Job Responsibility:Plan, build, and implement data solutions based on Data...

  • Lead Data Engineer

    2 weeks ago


    Delhi, Delhi, India Akivna Technologies Pvt. Ltd. Full time

    Company DescriptionAkivna Technologies Pvt. Ltd. is an IT company based in Gurugram. We specialize in Data Engineering, Data Science, Data Analytics, DevOps, and Product Development. Our team is passionate about technology and we strive to deliver innovative and high-quality solutions to our clients.Job Description:We are seeking a skilled and experienced...

  • Data Engineer

    2 weeks ago


    Delhi, Delhi, India Everstream Analytics Full time

    Data EngineerTotal years of experience is 3 yrs to 5 yrs.Immediate to 1 month notice period.Location Viman Nagar, Pune. Maharashtra.Please mention below details while applying Total years of experience Current CTC Expected CTC Notice period Current location Any educational gap?Any employment gap?Interested candidates please share resumes at is the JD ...

  • Senior Lead Engineer

    2 weeks ago


    Delhi, Delhi, India NTT DATA Full time

    Job DescriptionReq ID:282068NTT DATA Services strives to hire exceptional, innovative and passionate individuals who want to grow with us. If you want to be part of an inclusive, adaptable, and forward-thinking organization, apply now.We are currently seeking a Senior Lead Engineer to join our team in Delhi, Delhi (IN-DL), India (IN)."Strongly prefer...


  • Delhi, Delhi, India Safeguard Global Full time

    Looking for a Job That Fits Your Life, anywhere in the World?Ever fancied a role where work molds around your life, no matter where in the globe you are? Welcome to Safeguard Global We're all about making work fit into your world, wherever that may beAbout Us:At Safeguard Global, we're not your average company. Sure, we handle global solutions for over 1500+...

  • Lead Data Engineer

    2 weeks ago


    Delhi, Delhi, India Orion Innovation Full time

    As a Lead Data Engineer, you will play a crucial role in designing, developing, and maintaining our data infrastructure. You will lead a team of data engineers to ensure the successful delivery of projects and contribute to the overall data strategy. The ideal candidate will have extensive experience in cloud-based data technologies, particularly in Azure,...

  • Lead Engineer

    2 weeks ago


    Delhi, Delhi, India NTT DATA Full time

    Job DescriptionReq ID:282070NTT DATA Services strives to hire exceptional, innovative and passionate individuals who want to grow with us. If you want to be part of an inclusive, adaptable, and forward-thinking organization, apply now.We are currently seeking a Lead Engineer to join our team in Delhi, Delhi (IN-DL), India (IN)."RPA Consultant (C)Once You Are...

  • Lead data engineer

    2 weeks ago


    Delhi, Delhi, India USEReady Full time

    Userady is currently seeking a Lead Data Engineer for locations in Bangalore, Mohali, and GurugramJob Description:Mentor a team of developers to create and maintain high-quality, scalable, and secure data pipelines and analytics applications on the Databricks platform.Collaborate closely with data engineers and business stakeholders to understand their...

  • Lead Engineer

    2 weeks ago


    Delhi, Delhi, India NTT DATA Services Full time

    Req ID: NTT DATA Services strives to hire exceptional, innovative and passionate individuals who want to grow with us. If you want to be part of an inclusive, adaptable, and forward-thinking organization, apply now. We are currently seeking a Lead Engineer to join our team in Delhi, Delhi (IN-DL), India (IN). "RPA Consultant (C) Once You Are Here, You Will:...

  • Senior Lead Engineer

    2 weeks ago


    Delhi, Delhi, India NTT DATA Services Full time

    Req ID: NTT DATA Services strives to hire exceptional, innovative and passionate individuals who want to grow with us. If you want to be part of an inclusive, adaptable, and forward-thinking organization, apply now.We are currently seeking a Senior Lead Engineer to join our team in Delhi, Delhi (IN-DL), India (IN)."Strongly prefer MuleSoft Developer –...

  • Lead Data Engineer

    2 weeks ago


    Delhi, Delhi, India Helius Technologies Full time

    Work Location: HyderabadWork Mode : 5 days Work from OfficeWork Timings : 9 am to 6 pmClient: Singapore basedJob Type: 1 year renewable contract (Long Term)Kindly revert with below details in addition to updated resume.Full Name as per the Passport or Aadhar Card :Current SalaryExp SalaryNotice period (availability)Reason for ChangeOk for 1 year renewable...

  • Data Modeller

    2 weeks ago


    Delhi, Delhi, India TransOrg Analytics Full time

    What are we looking for? Bachelor in Computer Science, Engineering, Statistics, Maths or related quantitative degree. 45 years of relevant experience in data modeling. Proficiency in data modeling tools such as ERwin, ER/Studio, or similar. Strong knowledge of SQL and NoSQL databases. Handson experience with cloud platforms like AWS, Azure, or Google Cloud....


  • Delhi, Delhi, India Boston Consulting Group Full time

    Who We AreBoston Consulting Group partners with leaders in business and society to tackle their most important challenges and capture their greatest opportunities. BCG was the pioneer in business strategy when it was founded in 1963. Today, we work closely with clients to embrace a transformational approach aimed at benefiting all stakeholders—empowering...

  • Data Lead Engineer

    2 weeks ago


    Delhi, Delhi, India Squareroot Consulting Pvt Ltd Full time

    Job Description : We are seeking a highly skilled and motivated Data Lead with expertise in Spark, Scala, Kafka, Big Data, and Batch Processing. As a Data Lead, you will play a key role in leading and managing the end-to-end data processing pipeline, ensuring the reliability, scalability, and efficiency of our data systems.Experience : 6+ YearsLocation :...


  • Delhi, Delhi, India Cloud4C Services Full time

    The Data Analytics Technical Manager is responsible for leading a team of data professionals in the development, deployment, and management of data analytics solutions on various public cloud platforms such as Azure, Google Cloud Platform (GCP), Oracle Cloud Infrastructure (OCI), Amazon Web Services (AWS) and Open Source This role involves leveraging open...