Senior Big Data Developer

3 days ago

Rajkot, Gujarat, India beBeeData Full time ₹ 20,00,000 - ₹ 30,00,000
Job Title: Big Data Engineer

We are seeking a skilled Big Data Engineer to join our data engineering team. The ideal candidate will have strong expertise in Scala, Spark, Python, NiFi, and Apache Kafka.

Key Responsibilities:

  • Design, develop, and optimize large-scale data pipelines and distributed data processing systems.
  • Work extensively with Scala, Spark (PySpark), and Python for data processing and transformation.
  • Develop and integrate streaming solutions using Apache Kafka and orchestration tools like NiFi / Airflow.
  • Write efficient queries and perform data analysis using Jupyter Notebooks and SQL.
  • Collaborate with cross-functional teams to design scalable cloud-based data architectures.
  • Ensure delivery of high-quality code through code reviews, performance tuning, and best practices.
  • Build monitoring and alerting systems leveraging Splunk or equivalent tools.
  • Participate in CI/CD workflows using Git, Jenkins, and other DevOps tools.

Mandatory Skills:

  • Scala – Minimum 3+ years of hands-on experience.
  • Strong expertise in Spark (PySpark) and Python.
  • Hands-on experience with Apache Kafka.
  • Knowledge of NiFi / Airflow for orchestration.
  • Strong experience in Distributed Data Systems (5+ years).
  • Proficiency in SQL and query optimization.
  • Good understanding of Cloud Architecture.

Preferred Skills:

  • Exposure to messaging technologies like Apache Kafka or equivalent.
  • Experience in designing intuitive, responsive UIs for data analytics visualization.
  • Familiarity with Splunk or other monitoring/alerting solutions.
  • Hands-on experience with CI/CD tools (Git, Jenkins).
  • Strong grasp of software engineering concepts, data modeling, and optimization techniques.

What We Offer:

A dynamic work environment with opportunities for growth and development.

  • Senior Big Data Engineer

    3 days ago

    Rajkot, Gujarat, India beBeeBigDataEngineer Full time ₹ 75,00,000 - ₹ 1,50,00,000

    Senior Big Data EngineerWe are seeking a highly skilled Senior Big Data Engineer to join our team. The successful candidate will be responsible for designing, building, and maintaining large-scale data systems.

  • Senior Big Data Expert

    5 days ago

    Rajkot, Gujarat, India beBeeDataDriven Full time ₹ 15,00,000 - ₹ 25,00,000

    Job Title:Data ArchitectAbout the Role:We are looking for an experienced Data Architect to lead our Big Data initiatives.Key Responsibilities:Design and Implement Big Data SolutionsLead a team of engineers in developing and maintaining large-scale data processing systemsCollaborate with cross-functional teams to drive business growth through data-driven...

  • Senior Big Data Architect

    5 days ago

    Rajkot, Gujarat, India beBeeDataEngineer Full time ₹ 15,00,000 - ₹ 25,00,000

    Job Title: Azure Data EngineerThe role of the data engineer involves working with large datasets and designing efficient systems to store, process, and retrieve data.About the Role: As a data engineer, you will be responsible for architecting, building, testing, and deploying large-scale data processing systems. You will work closely with cross-functional...

  • Senior ETL Developer

    2 days ago

    Rajkot, Gujarat, India beBeeETLDATA Full time ₹ 15,00,000 - ₹ 25,00,000

    Job Title: Senior ETL DeveloperAs a senior ETL developer, you will be responsible for designing, developing, and testing ETL architecture, transformation jobs, and workflow schedules.The ideal candidate should have expertise in Hive, Spark, big data technologies, SQL (advanced scripting and optimization), data warehousing principles, and dimensional...

  • Big Data Architect

    4 days ago

    Rajkot, Gujarat, India beBeeDataEngineer Full time ₹ 35,00,000 - ₹ 45,00,000

    Job Title:Data Engineer SpecialistDescription:This is a challenging role requiring a strong technical background and experience in designing and implementing data architectures. We are looking for an individual who can lead multiple data engagements, interface with stakeholders, and take complete responsibility for the successful delivery of allocated...

  • Big Data Developer

    2 days ago

    Rajkot, Gujarat, India beBeeDataEngineering Full time ₹ 1,50,00,000 - ₹ 2,50,00,000

    Data Engineering Role OverviewThis position is ideal for a skilled data engineer who can drive data-driven decision making across the organization.The successful candidate will design and implement efficient CI/CD pipelines using GitHub Actions or similar tools to streamline code integration and deployment.They will maintain robust GitHub branch protection...

  • Senior Data Analytics Specialist

    3 days ago

    Rajkot, Gujarat, India beBeeDataAnalytics Full time ₹ 15,00,000 - ₹ 25,00,000

    Senior Data Analytics SpecialistWe are seeking a skilled Senior Data Analytics Specialist to join our team.As a key member of our data analytics team, you will be responsible for designing and implementing complex algorithms that provide valuable insights into our data. You will work closely with our data science team to develop innovative solutions that...

  • Highly Skilled Big Data Specialist

    4 days ago

    Rajkot, Gujarat, India beBeeDataScientist Full time ₹ 20,00,000 - ₹ 25,00,000

    Job OverviewSenior Data EngineerAs a senior data engineer, you will design and develop large-scale data architectures using Azure Databricks, PySpark, and Apache Spark.

  • Senior Data Engineer Position

    2 days ago

    Rajkot, Gujarat, India beBeeDataEngineer Full time ₹ 1,50,00,000 - ₹ 2,50,00,000

    Job Title: Senior Data ArchitectJob Summary:An experienced senior data engineer is required to design and implement scalable, high-performance data pipelines using AWS cloud services and Databricks.Key Responsibilities:Design, develop, and maintain large-scale data pipelines and workflows using AWS (S3, Redshift, Glue, EMR, Lambda, Kinesis, Athena) and...

  • Data Engineer

    2 days ago

    Rajkot, Gujarat, India beBeeDataEngineer Full time ₹ 3,00,00,000 - ₹ 6,00,00,000

    Job Title: Data EngineerWe are seeking a skilled data engineer to design, develop and maintain large-scale data processing systems.The ideal candidate will have a strong background in big data technologies such as PySpark, Hive, Spark, and HBase. Experience with data ingestion from disparate sources onto the big data platform is highly desirable.We require...