Big Data Analytics Specialist

2 weeks ago


Bengaluru, Karnataka, India beBeeDataEngineer Full time ₹ 15,00,000 - ₹ 25,00,000
Job Description">

Objective :

">

We are seeking a skilled Big Data Engineer to design, develop and maintain robust data processing applications using Apache Spark with Scala.

">

Key Responsibilities :

">

  • ">
  • Design and develop scalable data processing applications using Apache Spark with Scala.">
  • Implement and manage complex data workflows.">
  • Conduct deep performance optimization and memory tuning for Spark jobs.">
  • Work proficiently with Apache Hive for data warehousing and HDFS for distributed storage.">
  • Write comprehensive unit tests using ScalaTest and adhere to best practices for building scalable and reliable data pipelines.">
  • Utilize working knowledge of CI/CD pipelines, GitHub, Maven, and Nexus for continuous integration, delivery, and version control.">
">

Qualifications :

">

  • ">
  • 6+ years of experience working on Big Data platforms.">
  • Strong hands-on experience with Apache Spark using Scala, Hive, and HDFS.">
  • Proficiency in Oozie workflows, ScalaTest, and Spark performance tuning.">
  • Deep understanding of Spark UI, YARN logs, and debugging distributed jobs.">
  • Familiarity with Agile/Scrum methodologies.">
  • Experience working with enterprise-level distributed data systems.">
">

What You'll Do :

">

Spark Development : Design, develop and maintain robust and scalable data processing applications using Apache Spark with Scala.

">

Data Orchestration : Implement and manage complex data workflows using

">

Tuning : Conduct deep performance optimization and memory tuning for Spark jobs, leveraging your understanding of Spark UI and YARN logs for effective debugging of distributed jobs.

">

Benefits :

">

Opportunities :

">

  • ">
  • Ability to write unit tests.">
  • Follow best practices for scalable data pipelines.">
">

Requirements :

">

  • ">
  • Strong problem-solving and analytical skills.">
  • Hands-on performance optimization and memory tuning for Spark jobs.">
  • Familiarity with Agile/Scrum methodologies.">
":
  • Big Data Specialist

    1 week ago


    Bengaluru, Karnataka, India beBeeData Full time ₹ 8,00,000 - ₹ 15,00,000

    Job Title: Big Data SpecialistExperience:2+ years of experience in big data development.The ideal candidate will have expertise in:Big Data DevelopmentAdvanced AnalyticsCloud ComputingProgramming Skills (Python, Java)As a big data specialist, you will be responsible for designing and developing large-scale data processing systems. Your focus will be on...

  • Big Data Specialist

    2 weeks ago


    Bengaluru, Karnataka, India beBeeData Full time ₹ 12,00,000 - ₹ 15,00,000

    Big Data SpecialistGreetings from our team!We are seeking an experienced Big Data Specialist to join our team. As a key member, you will play a critical role in driving business growth through data-driven insights.This is an exceptional opportunity for a motivated and talented individual who thrives in a fast-paced environment. Our ideal candidate will have...

  • Big Data Specialist

    1 week ago


    Bengaluru, Karnataka, India beBeeData Full time ₹ 15,00,000 - ₹ 25,00,000

    Big Data SpecialistWe are seeking a highly skilled professional to develop and maintain large-scale data systems.Key Responsibilities:Design, implement, and deploy data processing pipelines.Develop and maintain ETL processes for big data technologies.Collaborate with cross-functional teams to ensure data quality and integrity.Ensure data security and...


  • Bengaluru, Karnataka, India beBeeCloud Full time US$ 90,000 - US$ 1,20,000

    Job Title: Big Data Operations SpecialistKey Responsibilities:Design and implement large-scale data pipelines to process and analyze big data.Collaborate with cross-functional teams to develop and maintain data infrastructure, ensuring high availability and performance.Required Skills and Qualifications:Good experience in working with NoSQL systems, such as...


  • Bengaluru, Karnataka, India beBeeDataAnalytics Full time ₹ 1,50,00,000 - ₹ 2,50,00,000

    **Job Title:** Data Analytics SpecialistWe are seeking a skilled Data Analytics Specialist to join our team. As a Data Analytics Specialist, you will be responsible for working with large datasets to extract insights and inform business decisions.**Required Skills and Qualifications: **Strong experience in data engineering, including data warehousing and ETL...


  • Bengaluru, Karnataka, India beBeeBusiness Full time US$ 1,50,000 - US$ 1,75,000

    About UsWe are a global organization with best-in-class infrastructure and development facilities spread across the globe.Business Intelligence DeveloperStrong experience in developing ETL solutions using SnapLogic (7+ years)Ability to engage with multiple technical teams and collaborate effectivelyEffective communication skills (technical and...

  • Big Data Specialist

    1 week ago


    Bengaluru, Karnataka, India beBeeDataEngineer Full time ₹ 15,00,000 - ₹ 20,00,000

    Data Engineer PositionJob Summary:We are seeking a skilled Big Data Specialist to join our team of experts. The ideal candidate will be responsible for designing, developing, and maintaining scalable data platforms and architectures to support our analytics and business intelligence needs.About Us:We believe in harnessing the power of technology to drive...

  • Big Data Specialist

    6 days ago


    Bengaluru, Karnataka, India beBeeData Full time ₹ 40,00,000 - ₹ 50,00,000

    Job Title: Big Data SpecialistOur organization seeks an experienced and skilled data engineer to develop, implement, and maintain scalable big data solutions utilizing cutting-edge technologies.Key Responsibilities:Design, create, and optimize data pipelines using cloud-based platforms and distributed computing systems.Collect, transform, and load large...

  • Data Architect

    1 week ago


    Bengaluru, Karnataka, India beBeeDataEngineer Full time ₹ 1,04,000 - ₹ 1,30,878

    Big Data Engineer RoleAt the core of our organization, we are seeking a skilled Big Data Engineer to spearhead the design, implementation, and maintenance of scalable big data infrastructure. This role demands a strong understanding of distributed systems, data processing, and analytics.Key Responsibilities:Design, develop, and deploy large-scale big data...

  • Big Data Specialist

    1 week ago


    Bengaluru, Karnataka, India beBeeDataEngineering Full time ₹ 18,00,000 - ₹ 2,02,50,000

    Job Opportunity: Big Data SpecialistAbout the Role:The ideal candidate will have experience working with large-scale data systems, designing and implementing efficient data pipelines, and ensuring seamless integration of data sources.Responsibilities:Design, develop, and maintain scalable big data processing systems using Python and PySparkCollaborate with...