Senior Data Processing Specialist

2 weeks ago

Bengaluru, Karnataka, India beBeeData Full time ₹ 1,04,000 - ₹ 1,30,878
Big Data Engineer

The role of a Big Data Engineer is to design, build and maintain large-scale data processing systems. Our ideal candidate will have hands-on experience with AWS EMR and Apache Spark, as well as a strong understanding of distributed systems architecture and cluster resource management.

Key Responsibilities:

  • Design and implement scalable data processing solutions using AWS EMR and Apache Spark.
  • Optimize and tune Spark jobs for performance and cost efficiency on EMR clusters.
  • Monitor, troubleshoot, and resolve issues related to EMR and Spark workloads.
  • Collaborate with data engineering and analytics teams to integrate Spark solutions with broader data ecosystems.

Required Skills:

  • 5+ years of experience in big data technologies with hands-on expertise in AWS EMR and Apache Spark.
  • Proficiency in Spark Core, Spark SQL, and Spark Streaming for large-scale data processing.
  • Strong experience with data formats (Parquet, Avro, JSON) and data storage solutions (Amazon S3, HDFS).
  • Solid understanding of distributed systems architecture and cluster resource management (YARN).
  • Experience in scripting and programming languages such as Python, Scala, and Java.
  • Knowledge of containerization and orchestration (Docker, Kubernetes) is a plus.

Preferred Qualifications:

  • AWS Certified Solutions Architect Associate/Professional
  • AWS Certified Data Analytics Specialty
Why This Role Matters

This role plays a critical part in enabling our business to make data-driven decisions. As a Big Data Engineer, you will have the opportunity to design and implement cutting-edge data processing solutions that drive business growth and innovation.

  • Senior Data Integration Specialist

    2 weeks ago

    Bengaluru, Karnataka, India beBeeData Full time US$ 1,20,000 - US$ 1,50,000

    Job Title: Senior Data Integration SpecialistWe are seeking a highly skilled and experienced Senior Data Integration Specialist to join our team.Job Description:The successful candidate will be responsible for managing and maintaining large-scale data integration processes, ensuring seamless data flow between various systems. They will work closely with...

  • Data Processing Specialist

    7 days ago

    Bengaluru, Karnataka, India beBeeETL Full time ₹ 12,00,000 - ₹ 20,00,000

    Data Processing SpecialistWe are seeking an experienced Data Processing Specialist to join our team. This is a key role in ensuring high-quality data processing through effective ETL strategies.Key Responsibilities:Develop and implement comprehensive ETL testing plans to identify and report defects in the data processing pipeline.Collaborate with...

  • Senior Process Specialist

    5 days ago

    Bengaluru, Karnataka, India beBeeProcess Full time ₹ 15,00,000 - ₹ 25,00,000

    Job Title: Senior Process SpecialistAbout the Role:We are seeking an experienced Senior Process Specialist to join our team. In this role, you will be responsible for analyzing regional business requirements and adapting end-to-end business processes to ensure seamless integration with global SAP S/4HANA systems.Key Responsibilities:Analyze business...

  • Senior Data Management Specialist

    2 weeks ago

    Bengaluru, Karnataka, India beBeeDataManagement Full time ₹ 20,00,000 - ₹ 30,00,000

    Job Title:Senior Data Management SpecialistJob Description:We are seeking a highly experienced Senior Data Management Specialist to oversee and optimize our Master Data Management (MDM) technology framework for Business Partner data domain. This role involves designing, implementing, and maintaining robust MDM technology to ensure data integrity,...

  • Data Processing Specialist

    1 week ago

    Bengaluru, Karnataka, India beBeeDataManagement Full time ₹ 9,00,000 - ₹ 12,00,000

    Job Title: Data Processing SpecialistThe Data Processing Specialist plays a multifaceted role encompassing various aspects of data processing, quality assurance, communication and administrative tasks.Delivers superior customer service to clients through multiple communication channels. Investigates and responds to client inquiries, complaints, concerns and...

  • Systems Integration Senior Specialist

    2 weeks ago

    Bengaluru, Karnataka, India NTT DATA Full time

    Req ID 323499NTT DATA strives to hire exceptional innovative and passionate individuals who want to grow with us If you want to be part of an inclusive adaptable and forward-thinking organization apply now We are currently seeking a Systems Integration Senior Specialist to join our team in BANGALORE Karnxc4x81taka IN-KA India IN General...

  • Quality and performance Senior Specialist

    2 weeks ago

    Bengaluru, Karnataka, India NTT Data Full time

    Job DescriptionNTT DATA strives to hire exceptional, innovative and passionate individuals who want to grow with us. If you want to be part of an inclusive, adaptable, and forward-thinking organization, apply now.We are currently seeking a Quality and performance Senior Specialist to join our team in Bengaluru, Karntaka (IN-KA), India (IN).-...

  • ERP Senior Specialist

    3 days ago

    Bengaluru, Karnataka, India NTT DATA Full time ₹ 20,00,000 - ₹ 25,00,000 per year

    Req ID: 339664NTT DATA strives to hire exceptional, innovative and passionate individuals who want to grow with us. If you want to be part of an inclusive, adaptable, and forward-thinking organization, apply now. We are currently seeking a ERP Senior Specialist to join our team in Bangalore, Karnātaka (IN-KA), India (IN). Job Duties: Identify gaps in...

  • Security Analysis Senior Specialist

    3 weeks ago

    Bengaluru, Karnataka, India NTT Data Full time

    Job DescriptionNTT DATA strives to hire exceptional, innovative and passionate individuals who want to grow with us. If you want to be part of an inclusive, adaptable, and forward-thinking organization, apply now.We are currently seeking a Security Analysis Senior Specialist to join our team in Bengaluru, Karntaka (IN-KA), India (IN).Job TitleInformation...

  • Senior Data Integration Specialist

    1 week ago

    Bengaluru, Karnataka, India beBeeDataIntegration Full time ₹ 15,00,000 - ₹ 25,00,000

    Senior Data Integration SpecialistWe are seeking a highly skilled Senior Data Integration Specialist to join our team. In this role, you will be responsible for designing and implementing data integration solutions that meet the needs of our clients.Required Skills:Extensive experience in data integration technologies, including ETL/ELT methodologiesStrong...