Senior Big Data Professional

5 days ago

Vizag, Andhra Pradesh, India beBeeData Full time ₹ 18,00,000 - ₹ 22,00,000

Job Title: Big Data Engineer

We are seeking a skilled Big Data Engineer to join our team. The ideal candidate will have expertise in Scala, Spark, Python, NiFi, and Apache Kafka.

Key Responsibilities:

  • Design, develop, and optimize large-scale data pipelines and distributed data processing systems.
  • Work extensively with Scala, Spark (PySpark), and Python for data processing and transformation.
  • Develop and integrate streaming solutions using Apache Kafka and orchestration tools like NiFi / Airflow.
  • Write efficient queries and perform data analysis using Jupyter Notebooks and SQL.
  • Collaborate with cross-functional teams to design scalable cloud-based data architectures.
  • Ensure delivery of high-quality code through code reviews, performance tuning, and best practices.
  • Build monitoring and alerting systems leveraging Splunk or equivalent tools.
  • Participate in CI/CD workflows using Git, Jenkins, and other DevOps tools.
  • Contribute to product development with a focus on scalability, maintainability, and performance.

Mandatory Skills:

  • Scala: Minimum 3+ years of hands-on experience.
  • Strong expertise in Spark (PySpark) and Python.
  • Hands-on experience with Apache Kafka.
  • Knowledge of NiFi / Airflow for orchestration.
  • Strong experience in Distributed Data Systems (5+ years).
  • Proficiency in SQL and query optimization.
  • Good understanding of Cloud Architecture.

Preferred Skills:

  • Exposure to messaging technologies like Apache Kafka or equivalent.
  • Experience in designing intuitive, responsive UIs for data analytics visualization.
  • Familiarity with Splunk or other monitoring/alerting solutions.
  • Hands-on experience with CI/CD tools (Git, Jenkins).
  • Strong grasp of software engineering concepts, data modeling, and optimization techniques.

  • Cloud Professional

    10 hours ago

    Vizag, Andhra Pradesh, India beBeeCloud Full time ₹ 18,00,000 - ₹ 25,00,000

    Job Title: Cloud and Big Data ArchitectAre you a skilled cloud professional seeking a challenging role that combines big data management with expertise in Azure?This is a full-time hybrid position for a Digital & Data Solutions team, offering flexibility for remote work.The ideal candidate will have hands-on experience in Azure, proficiency in Big Data...

  • Senior Big Data Specialist

    5 days ago

    Vizag, Andhra Pradesh, India beBeeData Full time ₹ 80,00,000 - ₹ 1,50,00,000

    Big Data Job OpportunityGreetings from a leading organization!Key Highlights:6-12 years of experience in Big DataStrong expertise in PySpark and HiveJob Responsibilities:We are seeking a skilled Big Data professional to work on data ingestion, processing, and analysis. The ideal candidate should have experience in working with disparate data sources and...

  • Big Data Specialist

    3 days ago

    Vizag, Andhra Pradesh, India beBeeBigData Full time ₹ 15,00,000 - ₹ 25,00,000

    Senior Big Data SpecialistAs a key contributor to our product engineering team, you will design, develop and maintain large-scale data pipelines for ingestion, transformation and storage.This role requires strong expertise in SQL query optimization, stored procedures and complex joins. Proficiency in programming languages like Python, Java or Scala is also...

  • Senior Big Data Specialist

    16 hours ago

    Vizag, Andhra Pradesh, India beBeeDataEngineer Full time ₹ 1,80,00,000 - ₹ 2,50,00,000

    Job Title: Data EngineerWe are seeking an experienced Data Engineer to join our team. The successful candidate will have a strong background in big data technologies and relational databases, as well as software development skills.Key Responsibilities:Designing, implementing and managing large-scale distributed data systemsMonitoring performance and...

  • Big Data Specialist

    5 days ago

    Vizag, Andhra Pradesh, India beBeeData Full time ₹ 15,00,000 - ₹ 25,00,000

    Job Title: Big Data SpecialistAbout the Role:We are seeking a skilled Big Data Specialist to join our team. As a key member of our data analytics group, you will be responsible for designing and implementing large-scale data systems using Apache Trino (PrestoSQL).Responsibilities:Design and implement high-performance data architectures using Trino in...

  • Big Data Hadoop Developer

    10 hours ago

    Vizag, Andhra Pradesh, India beBeeHadoop Full time ₹ 15,00,000 - ₹ 20,00,000

    Job Title: Big Data Hadoop DeveloperWe are seeking a highly skilled Big Data Hadoop Developer to join our team. The ideal candidate will have extensive experience in working with Big Data technologies to drive business outcomes.The role involves designing, developing, and optimizing complex data processing systems using Scala, Spark, Hive, and Hadoop. Key...

  • Big Data Architect

    4 days ago

    Vizag, Andhra Pradesh, India beBeeDataEngineer Full time ₹ 1,50,00,000 - ₹ 2,00,00,000

    Unlock the Power of Big Data with ScalabilityJob Title:A Data Engineer is required to design and develop scalable big data architectures that drive business growth.The ideal candidate will have experience with Pipeline Development and a good understanding of Data Integration, Data Quality Tools, and Agile Methodologies.You will work closely with...

  • Senior Data Professional: Data Management Lead

    2 days ago

    Vizag, Andhra Pradesh, India beBeeDataManagement Full time ₹ 2,00,00,000 - ₹ 2,50,00,000

    We are seeking a senior data professional to lead our data management efforts. This is a unique opportunity for an experienced individual to join our team and drive innovation in data transformation.As a Data Management Lead, you will be responsible for designing, developing, and deploying data management and storage related modules.You will oversee data...

  • Senior Big Data Engineer

    7 days ago

    Vizag, Andhra Pradesh, India beBeeDataEngineering Full time ₹ 22,00,000 - ₹ 27,00,000

    Technical Lead for AzureWe are seeking an experienced and strategic Engineering Manager with expertise in Big Data platforms, Microsoft Azure, and Databricks. The ideal candidate will lead a team of data engineers to design and deliver scalable data pipelines and analytics platforms.Lead, mentor, and grow a team of data engineers working on large-scale...

  • Senior Data Specialist

    7 days ago

    Vizag, Andhra Pradesh, India beBeeDataEngineer Full time ₹ 1,50,00,000 - ₹ 2,00,00,000

    Job Title: Senior Data EngineerWe are seeking a skilled professional to help implement an application for a large retailer. The ideal candidate will have hands-on coding expertise in Python and Pyspark, as well as experience with Telemetry, Big Data, and backend engineering.Required Skills and Qualifications:5+ years of experience as a Data EngineerExpertise...