Senior Data Engineer

6 days ago

Bengaluru, Karnataka, India beBeeDataEngineer Full time ₹ 15,00,000 - ₹ 28,00,000

Job Summary:

We are seeking a Senior Data Engineer with expertise in Apache Spark to join our team. As a Senior Data Engineer, you will be responsible for designing and developing scalable data processing solutions using AWS EMR and Apache Spark.

About the Role:

This is an exciting opportunity to work with a talented team of data engineers and scientists to drive business growth through data-driven insights. You will be responsible for architecting and developing large-scale data processing systems using Spark and EMR, optimizing job performance and cost efficiency, and collaborating with cross-functional teams to integrate Spark solutions with broader data ecosystems.

Key Responsibilities:

  • Design and develop scalable data processing solutions using AWS EMR and Apache Spark
  • Optimize and tune Spark jobs for performance and cost efficiency on EMR clusters
  • Collaborate with data engineering and analytics teams to integrate Spark solutions with broader data ecosystems
  • Implement best practices for cluster management, data partitioning, and job execution

Required Skills and Qualifications:

To be successful in this role, you will need:

  • 5+ years of experience in big data technologies with hands-on expertise in AWS EMR and Apache Spark
  • Proficiency in Spark Core, Spark SQL, and Spark Streaming for large-scale data processing
  • Strong experience with data formats (Parquet, Avro, JSON) and data storage solutions (Amazon S3, HDFS)
  • Solid understanding of distributed systems architecture and cluster resource management (YARN)
  • Familiarity with AWS services (S3, IAM, Lambda, Glue, Redshift, Athena)
  • Experience in scripting and programming languages such as Python, Scala, and Java
  • Knowledge of containerization and orchestration (Docker, Kubernetes) is a plus
  • AWS Certified Solutions Architect Associate/Professional or equivalent certification
  • B.Tech, BE, BCA, MCA, M. Tech or equivalent technical degree from a reputed college

What We Offer:

We offer a competitive salary and benefits package, as well as opportunities for professional growth and development. If you are passionate about working with big data and want to be part of a dynamic team, please submit your application.

Note:

Candidates must have the right to work in the location where the position is based.

  • Data Senior Engineer

    2 weeks ago

    Bengaluru, Karnataka, India NTT DATA Full time US$ 80,000 - US$ 1,20,000 per year

    Req ID: 337669NTT DATA strives to hire exceptional, innovative and passionate individuals who want to grow with us. If you want to be part of an inclusive, adaptable, and forward-thinking organization, apply now. We are currently seeking a Data Senior Engineer to join our team in Bangalore, Karnātaka (IN-KA), India (IN). Job Duties: 8+ years of experience...

  • Data Senior Engineer

    2 weeks ago

    Bengaluru, Karnataka, India NTT DATA North America Full time US$ 1,00,000 - US$ 1,50,000 per year

    Req ID: NTT DATA strives to hire exceptional, innovative and passionate individuals who want to grow with us. If you want to be part of an inclusive, adaptable, and forward-thinking organization, apply now.We are currently seeking a Data Senior Engineer to join our team in Bangalore, Karnātaka (IN-KA), India (IN).Job Duties: 8+ years of experience in a Data...

  • Senior, Data Engineer

    2 weeks ago

    Bengaluru, Karnataka, India NTT DATA Full time US$ 1,04,000 - US$ 1,30,878 per year

    Make an impact with NTT DATAJoin a company that is pushing the boundaries of what is possible. We are renowned for our technical excellence and leading innovations, and for making a difference to our clients and society. Our workplace embraces diversity and inclusion – it's a place where you can grow, belong and thrive.Your day at NTT DATAThe Manager,...

  • Senior Associate Data Engineer

    2 weeks ago

    Bengaluru, Karnataka, India NTT DATA, Inc. Full time

    Job DescriptionMake an impact with NTT DATAJoin a company that is pushing the boundaries of what is possible. We are renowned for our technical excellence and leading innovations, and for making a difference to our clients and society. Our workplace embraces diversity and inclusion its a place where you can grow, belong and thrive.Your day at NTT DATAThe...

  • Data Engineer

    2 weeks ago

    Bengaluru, Karnataka, India Data Analytics Full time ₹ 15,00,000 - ₹ 20,00,000 per year

    Get to Know the Team Grab has been expanding into multiple lines of businesses. The Grab Data Warehouse team builds business intelligence systems using data from all business lines to provide insights to key stakeholders across the company. Get to Know the Role We are looking for a Lead Data Engineer to lead the design and enhancement of our data...

  • Senior Data Engineer

    2 weeks ago

    Bengaluru, Karnataka, India beBeeData Full time ₹ 1,04,000 - ₹ 1,30,878

    Job Title: Senior Data Engineer About the RoleThis is an exciting opportunity to join our team as a senior data engineer. We are looking for a highly skilled and experienced professional who can design, develop, and implement large-scale data processing systems.

  • Senior Data Engineer

    1 week ago

    Bengaluru, Karnataka, India beBeeDataEngineering Full time ₹ 15,00,000 - ₹ 25,00,000

    Data Engineering Role OverviewWe are seeking a senior data engineer to drive business strategies through robust data pipelines.Develop and refine intricate ETL pipelines for processing high volumes of data.Maintain data precision, coherence, and system performance.Collaborate with cross-functional teams for impactful solutions.Implement top-notch practices...

  • Data Engineer

    5 days ago

    Bengaluru, Karnataka, India NTT DATA, Inc. Full time ₹ 1,04,000 - ₹ 1,30,878 per year

    Req ID:321800We are currently seeking a Data Engineer (Talend &Pyspark) to join our team in Bangalore, Karntaka (IN-KA), India (IN)."Job Duties: Key Responsibilities: Design and implement tailored data solutions to meet customer needs and use cases, spanning from streaming to data lakes, analytics, and beyond within a dynamically evolving technical...

  • Senior Data Engineer

    1 week ago

    Bengaluru, Karnataka, India eClerx Full time

    Job Title: Senior Data Engineering Lead (Databricks) Next Step: If this role excites you and matches your expertise, kindly fill out the Google Form with the required details so we can reach out to you and make the process seamless: Role Overview: We are seeking a highly experienced Senior Data Engineering Lead with a strong focus on Databricks and...

  • Senior Data Engineer

    1 week ago

    Bengaluru, Karnataka, India eClerx Full time

    Job Title: Senior Data Engineering Lead (Databricks) Next Step:If this role excites you and matches your expertise, kindly fill out the Google Form with the required details so we can reach out to you and make the process seamless:https://forms.gle/Z6qWwcGUHf7rtiFaARole Overview:We are seeking a highly experienced Senior Data Engineering Lead with a strong...