Big Data Engineer for Scalable Data Solutions

1 day ago

Gurgaon, Haryana, India Axis Max Life Insurance Limited Full time

We are seeking an experienced Big Data Engineer to join our team at Axis Max Life Insurance Limited.

The estimated salary for this role is approximately $180,000 per annum, depending on the location and candidate qualifications.

About the Role:

This senior position involves designing, implementing, and maintaining large-scale data pipelines and infrastructure on AWS cloud platform. The ideal candidate will have extensive experience with AWS services, particularly in the realm of big data processing and analytics.

Key Responsibilities:

  • Architect, design, develop, and maintain large-scale data pipelines that can handle large datasets from multiple sources.
  • Expertise in real-time data replication and batch processing of data using distributed computing platforms like Spark, Kafka, etc.
  • Optimize performance of data processing jobs and ensure system scalability and reliability.
  • Collaborate with DevOps teams to manage infrastructure, including cloud environments like AWS
  • Collaborate with data scientists, analysts, and business stakeholders to develop tools and platforms that enable advanced analytics and reporting.
  • Lead and mentor junior data engineers, providing guidance on best practices, code reviews, and technical solutions.
  • Evaluating and implementing new frameworks, tools for data engineering
  • Strong analytical and problem-solving skills with attention to detail.
  • To maintain a healthy working relationship with the business partners/users and other MLI departments
  • Responsible for overall performance, cost, and delivery of technology solutions

Required Skills and Qualifications:

  • Hands-on experience with AWS services such as S3, DMS, Lambda, EMR, Glue, Redshift,RDS (Postgres) Athena, Kinesics, etc.
  • Expertise in data modeling and knowledge of modern file and table formats.
  • Expertise in data replication tool like Qlik replicate, AWS DMS
  • Proficiency in programming languages such as Python, PySpark, SQL/PLSQL for implementing data pipelines and ETL processes.
  • Experience data architecting or deploying Cloud/Virtualization solutions (Like Data Lake, EDW, Mart ) in enterprise
  • Knowledge of modern data stack and keeping the technology stack refreshed.
  • Knowledge of DevOps to perform CI/CD for data pipelines.
  • Knowledge of Data Observability, automated data lineage and metadata management would be an added advantage.

Benefits and Others:

Our company offers a dynamic work environment, opportunities for growth and development, and a competitive salary package. If you are a motivated and skilled professional looking to take your career to the next level, we encourage you to apply.

  • Senior Cloud Data Engineer for Big Data Solutions

    1 month ago

    Gurgaon, Haryana, India BayOne Solutions Full time

    Job Title: Senior Cloud Data Engineer for Big Data SolutionsAbout BayOne SolutionsBayOne Solutions is a 12-year-old software consulting organization based in Pleasanton, California, USA. We specialize in providing talent and solutions, with a passion for diversity in tech.Job OverviewWe are seeking an experienced Senior Cloud Data Engineer to join our team....

  • Data Engineering Expert

    2 weeks ago

    Gurgaon, Haryana, India ProcDNA Full time

    About ProcDNAWe are a global consulting firm that fuses design thinking with cutting-edge technology to create innovative Commercial Analytics and Technology solutions for our clients. With a passionate team of 200+ across 6 offices, we are committed to growth and learning together.Job Description:We are seeking an experienced Data Engineer to build and...

  • Data Engineering Expert

    12 hours ago

    Gurgaon, Haryana, India Publicis Sapient Full time

    Job SummaryWe are seeking a seasoned Senior Associate Data Engineer with expertise in cloud architecture and big data solutions to join our team. This is an exciting opportunity to leverage your technical skills and experience to design, implement, and maintain scalable data engineering solutions.About the RoleThe ideal candidate will have a strong...

  • Big Data Solutions Developer

    12 hours ago

    Gurgaon, Haryana, India Newnovation Full time

    Job Description: Newnovation is seeking a Data Engineer to join our team. The ideal candidate will have a strong background in data processing, cloud-based solutions, and big data technologies.About the Role: As a Data Engineer at Newnovation, you will be responsible for designing, building, and optimizing scalable data pipelines and architectures. You will...

  • Data Architect

    1 week ago

    Gurgaon, Haryana, India Impetus Full time

    Job SummaryWe are seeking a skilled Data Architect - Big Data Engineer to join our team at Impetus. As a key member of our data engineering team, you will design, develop, and implement efficient ETL pipelines using big data technologies.About the RoleDevelop scalable and secure data pipelines using Hadoop, Hive, and PySpark.Collaborate with cross-functional...

  • Data Engineer for Big Data Analytics

    2 weeks ago

    Gurgaon, Haryana, India Myananta Technologies Full time

    Myananta Technologies is a leading technology firm based in Gurugram, India.We are seeking an experienced Data Engineer to join our team and help us drive innovation in big data analytics.About the Role:We are looking for a highly skilled individual with expertise in Hadoop, Spark, Hive, and Airflow. The successful candidate will have extensive experience in...

  • Senior Big Data Engineer

    3 weeks ago

    Gurgaon, Haryana, India Arrixa Full time

    Arrixa is seeking an experienced Senior Big Data Engineer to lead the design and implementation of our big data solutions on Azure Databricks. This role requires a strong background in big data technologies, including Apache Spark, and experience working with large-scale data processing pipelines.About ArrixaArrixa is a leading provider of innovative...

  • Cloud Data Engineer for Azure and Big Data

    2 weeks ago

    Gurgaon, Haryana, India BayOne Solutions Full time

    Are you a seasoned data engineer looking for a new challenge? BayOne Solutions is seeking an experienced Cloud Data Engineer to join our team. With a strong background in modern data engineering, data warehousing, and data lakes technologies on cloud platforms like Azure, AWS, and GCP, this role is perfect for those who want to work with cutting-edge...

  • Data Engineer

    4 weeks ago

    Gurgaon, Haryana, India exl Full time

    Job DescriptionWe are seeking a skilled Data Engineer to join our team as a Big Data Architect. This is an exciting opportunity to work with cutting-edge technology and contribute to the design and implementation of large-scale data processing systems.About EXLEXL (NASDAQ:EXLS) is a leading operations management and analytics company that helps businesses...

  • Senior Big Data Solutions Architect

    1 month ago

    Gurgaon, Haryana, India SMARTWORK IT SERVICES Full time

    Job Title: Senior Big Data Solutions ArchitectJob Summary:We are seeking a skilled Senior Big Data Solutions Architect to join our team at SMARTWORK IT SERVICES. As a Senior Big Data Solutions Architect, you will be responsible for designing and implementing scalable big data solutions to meet the ever-growing needs of our clients.Key...

  • Big Data Architect

    12 hours ago

    Gurgaon, Haryana, India DEUTSCHE TELEKOM DIGITAL LABS PRIVATE LIMITED Full time

    Job SummaryWe are seeking a highly skilled Data Engineer to join our team at Deutsche Telekom Digital Labs Private Limited. The successful candidate will be responsible for designing and implementing big data solutions using Hadoop-based technologies, including AWS.About the RoleDesign and implement various big data platform components, including batch...

  • Cloud Architect Engineer for Big Data Solutions

    3 weeks ago

    Gurgaon, Haryana, India Nielsen Full time

    Are you a talented software engineer looking to make an impact in the media industry? We have an exciting opportunity for a Cloud Architect Engineer for Big Data Solutions at Nielsen, a global leader in providing powerful insights that drive client decisions and deliver extraordinary results.About UsWe are passionate about our work to power a better media...

  • Senior Data Engineer

    2 weeks ago

    Gurgaon, Haryana, India Spectral Consultants – Search & Recruitment firm Full time

    Job OverviewSpectral Consultants is seeking an experienced Big Data Developer to join our team.About the RoleWe are looking for a skilled professional with expertise in building scalable and efficient data pipelines using Big Data technologies such as Hive, Spark, Hadoop, and MapReduce.Key ResponsibilitiesDesign, implement, and optimize large-scale data...

  • Big Data Solutions Developer

    3 weeks ago

    Gurgaon, Haryana, India Aays Full time

    About UsAays is a cutting-edge company at the forefront of innovation, dedicated to harnessing the power of data to drive business growth.Salary and BenefitsWe offer an attractive salary range of $120,000 - $180,000 per annum, along with a comprehensive benefits package that includes health insurance, retirement plans, and generous paid time off.Job...

  • Senior Big Data Developer

    12 hours ago

    Gurgaon, Haryana, India Steerlean Consulting Services Pvt Ltd. Full time

    Job Description: Steerlean Consulting Services Pvt Ltd. is seeking an experienced Sr. Big Data Developer to join our team. The successful candidate will design, build, and maintain scalable data pipelines and systems to support analytics and business intelligence.In this role, you will work closely with data scientists, analysts, and other engineers to...

  • Senior Data Engineering Director

    4 weeks ago

    Gurgaon, Haryana, India Publicis Groupe Full time

    Job DescriptionOverview:We are seeking a highly skilled Senior Data Engineering Director to lead the development of scalable solutions at Publicis Groupe. As a key member of our team, you will be responsible for analyzing business requirements and partnering with product owners to build efficient and reliable data systems.About You:You have 3+ years'...

  • Data Engineer

    1 week ago

    Gurgaon, Haryana, India Huntsmen and barons Full time

    About Huntsmen and BaronsHuntsmen and Barons is a forward-thinking organization that requires skilled professionals to drive its growth. Our team works tirelessly to deliver exceptional results, and we're looking for a talented Data Engineer to join our ranks.Salary: $120,000 - $180,000 per yearJob DescriptionWe're seeking an experienced Data Engineer to...

  • Senior Big Data Developer

    2 weeks ago

    Gurgaon, Haryana, India NITS Solutions Full time

    Position Overview :We are seeking an Associate Big Data Engineer to join our team at NITS Solutions. The ideal candidate will have hands-on experience with Python, SQL, and POSTGRESQL, as well as a basic understanding of Pandas, Pyspark, and ETL processes.Key Responsibilities :Understand business needs and apply analytical concepts to generate actionable...

  • Data Engineer with Big Data Expertise Wanted

    2 weeks ago

    Gurgaon, Haryana, India AIDA projektai, MB Full time

    Job Type: Full-TimeWork Arrangement: HybridOnboarding: 1 month in the officeAfter Onboarding: 50% office visits per monthUrgency: Super UrgentLocation: GurgaonAbout This Role:We are seeking a highly skilled data engineer to join our team. The ideal candidate will have strong expertise in working with big data and hands-on experience in managing and deploying...

  • Big Data Innovator for Cloud-Based Solutions

    2 weeks ago

    Gurgaon, Haryana, India NCR Voyix Full time

    About NCR Voyix CorporationNCR Voyix is a leading global technology company that empowers businesses to connect, interact, and transact with their customers. With operations in over 100 countries, NCR Voyix provides innovative solutions and comprehensive support services to retail and restaurant organizations.Job SummaryWe are seeking a highly skilled Senior...