Big Data Engineer Lead

4 days ago


Gurgaon, Haryana, India Axis Max Life Insurance Limited Full time
Job Summary

We are seeking a skilled AWS Big Data Engineer to join our dynamic team at Axis Max Life Insurance Limited. In this role, you will be responsible for designing, implementing, and maintaining scalable data pipelines and infrastructure on the AWS cloud platform.

The ideal candidate will have extensive experience with AWS services, particularly in the realm of big data processing and analytics. You will work closely with cross-functional teams to support data-driven decision-making and focus on delivering business objectives while improving efficiency and ensuring high service quality.

Key Responsibilities
  • Architect, design, develop, and maintain large-scale data pipelines that can handle large datasets from multiple sources.
  • Expertise in real-time data replication and batch processing of data using distributed computing platforms like Spark, Kafka, etc.
  • Optimize performance of data processing jobs and ensure system scalability and reliability.
  • Collaborate with DevOps teams to manage infrastructure, including cloud environments like AWS.
  • Collaborate with data scientists, analysts, and business stakeholders to develop tools and platforms that enable advanced analytics and reporting.
  • Lead and mentor junior data engineers, providing guidance on best practices, code reviews, and technical solutions.
  • Evaluate and implement new frameworks, tools for data engineering.
  • Strong analytical and problem-solving skills with attention to detail.
  • Maintain a healthy working relationship with business partners/users and other departments.
Technical Competencies/Skills Required
  • Hands-on experience with AWS services such as S3, DMS, Lambda, EMR, Glue, Redshift, RDS (Postgres) Athena, Kinesis, etc.
  • Expertise in data modelling and knowledge of modern file and table formats.
  • Expertise in data replication tool like Qlik Replicate, AWS DMS.
  • Proficiency in programming languages such as Python, PySpark, SQL/PLSQL for implementing data pipelines and ETL processes.
  • Experience data architecting or deploying Cloud/Virtualization solutions (like Data Lake, EDW, Mart) in enterprise.
  • Knowledge of modern data stack and keeping the technology stack refreshed.
  • Knowledge of DevOps to perform CI/CD for data pipelines.
  • Knowledge of Data Observability, automated data lineage and metadata management would be an added advantage.
  • Cloud/hybrid cloud solution for data strategy for Data lake, BI and Analytics.
  • Set-up logging, monitoring, alerting, dashboards for cloud solution and data solution.
  • Experience with data warehousing concepts.
Estimated Salary: $120,000 - $150,000 per yearAbout Us

Axis Max Life Insurance Limited is a leading insurance company that provides innovative solutions to customers. We are committed to delivering exceptional service and products to our clients.

Location

Please note that the location for this position is not specified.



  • Gurgaon, Haryana, India HUNTINGCUBE RECRUITMENT SOLUTIONS PRIVATE LIMITED Full time

    Job Description: Senior Big Data Engineer LeadHUNTINGCUBE RECRUITMENT SOLUTIONS PRIVATE LIMITED is a cutting-edge technology company that values innovation, collaboration, and excellence. Our team is passionate about leveraging data science to drive business growth and transform industries.About the Role:We are looking for a seasoned Senior Big Data Engineer...


  • Gurgaon, Haryana, India Gemini Solutions Private Limited Full time

    We are looking for a talented Data Engineer with expertise in big data/Databricks environment and data engineering to join our team at Gemini Solutions Private Limited.In this role, you will design and implement efficient data ingestion pipelines from Oracle Fusion Cloud to Databricks, leveraging your knowledge of Oracle Fusion ecosystem and data-extracting...

  • Big Data Engineer

    3 weeks ago


    Gurgaon, Haryana, India IGT Solutions Full time

    Data Engineer Position:We're seeking a highly skilled Big Data Engineer to join our data engineering team. The ideal candidate will have over 8 years of hands-on experience designing, architecting, and implementing robust ETL pipelines using technologies such as Python, PySpark, PLSQL, Snowflake, and AWS.Main Responsibilities:Design and develop...

  • AWS Big Data Engineer

    15 hours ago


    Gurgaon, Haryana, India Axis Max Life Insurance Limited Full time

    Job DescriptionWe are seeking a skilled AWS Big Data Engineer to lead the design, implementation, and maintenance of scalable data pipelines and infrastructure on the AWS cloud platform. This role involves working closely with cross-functional teams to support data-driven decision-making and focus on delivering business objectives while improving efficiency...


  • Gurgaon, Haryana, India Myananta Technologies Full time

    Myananta Technologies is a leading technology firm based in Gurugram, India.We are seeking an experienced Data Engineer to join our team and help us drive innovation in big data analytics.About the Role:We are looking for a highly skilled individual with expertise in Hadoop, Spark, Hive, and Airflow. The successful candidate will have extensive experience in...

  • Data Architect

    4 weeks ago


    Gurgaon, Haryana, India Impetus Full time

    Job SummaryWe are seeking a skilled Data Architect - Big Data Engineer to join our team at Impetus. As a key member of our data engineering team, you will design, develop, and implement efficient ETL pipelines using big data technologies.About the RoleDevelop scalable and secure data pipelines using Hadoop, Hive, and PySpark.Collaborate with cross-functional...


  • Gurgaon, Haryana, India DEUTSCHE TELEKOM DIGITAL LABS PRIVATE LIMITED Full time

    About our Ideal Candidate:">We are looking for a motivated and experienced data engineer who can lead our team in delivering high-quality big data solutions. The ideal candidate should have a strong background in big data engineering, excellent problem-solving skills, and the ability to work effectively in a collaborative environment.

  • Big Data Architect

    3 weeks ago


    Gurgaon, Haryana, India DEUTSCHE TELEKOM DIGITAL LABS PRIVATE LIMITED Full time

    Job Title: Big Data ArchitectWe are seeking an experienced Big Data Architect to join our team at Deutsche Telekom Digital Labs Private Limited. As a Senior Hadoop Engineer, you will design and implement scalable big data solutions using Hadoop-based technologies along with AWS. Your primary responsibilities include designing and implementing various big...


  • Gurgaon, Haryana, India Max life insurance co ltd Full time

    Job Description: Max Life Insurance Co Ltd is seeking an experienced Senior Big Data Engineer to lead the development and maintenance of our big data infrastructure on the AWS cloud platform. In this role, you will be responsible for architecting, designing, and implementing scalable data pipelines and infrastructure that support data-driven decision-making...


  • Gurgaon, Haryana, India BayOne Solutions Full time

    Are you a seasoned data engineer looking for a new challenge? BayOne Solutions is seeking an experienced Cloud Data Engineer to join our team. With a strong background in modern data engineering, data warehousing, and data lakes technologies on cloud platforms like Azure, AWS, and GCP, this role is perfect for those who want to work with cutting-edge...


  • Gurgaon, Haryana, India Rapture Staffing Full time

    Data Engineering PositionAbout the Role:We are seeking an experienced data engineer to develop and implement efficient data architectures and pipelines. The ideal candidate will have a strong background in ETL tools, big data technologies, and cloud platforms.Responsibilities:Design and implement data architectures and pipelines that meet business...

  • Big Data Developer

    2 weeks ago


    Gurgaon, Haryana, India Material Full time

    Job Description: We are looking for a highly skilled Big Data Developer to join our team at Material. The ideal candidate will have extensive experience with big data technologies such as Hadoop, Spark, and Hive, as well as programming languages like Java, Python, and Scala.As a Big Data Developer, you will be responsible for designing and developing big...


  • Gurgaon, Haryana, India Falcon Full time

    About the RoleFalcon is looking for an experienced Big Data Engineer to join our team in Gurgaon, India. As a key member of our engineering team, you will be responsible for designing and developing scalable data pipelines using open source tools. You will collaborate with product and engineering teams to design a platform for data modelling and machine...

  • Big Data Architect

    3 weeks ago


    Gurgaon, Haryana, India DEUTSCHE TELEKOM DIGITAL LABS PRIVATE LIMITED Full time

    Job SummaryWe are seeking a highly skilled Data Engineer to join our team at Deutsche Telekom Digital Labs Private Limited. The successful candidate will be responsible for designing and implementing big data solutions using Hadoop-based technologies, including AWS.About the RoleDesign and implement various big data platform components, including batch...

  • Big Data Specialist

    3 weeks ago


    Gurgaon, Haryana, India Aptita Consulting Partners Full time

    About Aptita Consulting PartnersWe are a leading consulting firm that specializes in delivering high-quality data engineering and analytics solutions to our clients. Our team of experts has a deep understanding of the latest technologies and trends in the field.Job DescriptionWe are seeking a Senior Data Engineer to join our team. As a Senior Data Engineer,...


  • Gurgaon, Haryana, India SMARTWORK IT SERVICES Full time

    Job Overview:At SMARTWORK IT SERVICES, we are looking for a highly skilled Big Data Solutions Architect to lead our team in designing and implementing cutting-edge data processing solutions using Google Cloud Platform (GCP) technologies. As a key member of our team, you will be responsible for selecting and integrating big data tools and frameworks,...

  • Data Engineering Lead

    1 month ago


    Gurgaon, Haryana, India NAB Full time

    NAB is seeking an experienced Data Engineer to join our team.Job Title: Data Engineering LeadSalary:$120,000 - $160,000 per annumAbout the Role:We are looking for a skilled Data Engineer to lead our data engineering efforts. The successful candidate will have a strong background in SQL, Python, and experience with source code control (GitHub) and Jenkins....


  • Gurgaon, Haryana, India Impetus Full time

    Job Title: Senior Big Data EngineerOverview:Impetus is a leading technology firm seeking a skilled Senior Big Data Engineer to join our team. The ideal candidate will have hands-on experience with Big Data technologies, including pySpark, Hadoop, and Hive.Salary Estimate:We are offering a competitive salary of $140,000 - $160,000 per annum, commensurate with...


  • Gurgaon, Haryana, India Snap Find Full time

    At Snap Find, we are seeking an exceptional Data Engineer to join our team. As a key member of our data engineering group, you will play a critical role in designing, implementing, and optimizing scalable and efficient data architectures and pipelines.We offer a competitive compensation package with an estimated salary range of $120,000 - $180,000 per year,...


  • Gurgaon, Haryana, India BayOne Solutions Full time

    Job Title: Senior Cloud Data Engineer for Big Data SolutionsAbout BayOne SolutionsBayOne Solutions is a 12-year-old software consulting organization based in Pleasanton, California, USA. We specialize in providing talent and solutions, with a passion for diversity in tech.Job OverviewWe are seeking an experienced Senior Cloud Data Engineer to join our team....