Big Data Specialist

4 days ago

Bhavnagar, Gujarat, India beBeeDataEngineer Full time ₹ 15,00,000 - ₹ 25,00,000

Job Title: Data Engineering Specialist

Location: Flexible nationwide remote or hybrid, choice of the candidate.

Experience: 7–10 Years (Minimum 3+ years in Scala)

Notice Period: Immediate to 30 Days

Mode of Work: Hybrid

We are looking for a highly skilled Big Data Engineer with strong expertise in Scala, Spark, Python, NiFi, and Apache Kafka. The ideal candidate will have a proven track record in building, scaling, and optimizing big data pipelines, and hands-on experience in distributed data systems and cloud-based solutions.

Key Responsibilities:

  • Design, develop, and optimize large-scale data pipelines and distributed data processing systems.
  • Work extensively with Scala, Spark (PySpark), and Python for data processing and transformation.
  • Develop and integrate streaming solutions using Apache Kafka and orchestration tools like NiFi / Airflow.
  • Write efficient queries and perform data analysis using Jupyter Notebooks and SQL.
  • Collaborate with cross-functional teams to design scalable cloud-based data architectures.
  • Ensure delivery of high-quality code through code reviews, performance tuning, and best practices.
  • Build monitoring and alerting systems leveraging Splunk or equivalent tools.
  • Participate in CI/CD workflows using Git, Jenkins, and other DevOps tools.
  • Contribute to product development with a focus on scalability, maintainability, and performance.

Mandatory Skills:

  • Scala – Minimum 3+ years of hands-on experience.
  • Strong expertise in Spark (PySpark) and Python.
  • Hands-on experience with Apache Kafka.
  • Knowledge of NiFi / Airflow for orchestration.
  • Strong experience in Distributed Data Systems (5+ years).
  • Proficiency in SQL and query optimization.
  • Good understanding of Cloud Architecture.

Preferred Skills:

  • Exposure to messaging technologies like Apache Kafka or equivalent.
  • Experience in designing intuitive, responsive UIs for data analytics visualization.
  • Familiarity with Splunk or other monitoring/alerting solutions.
  • Hands-on experience with CI/CD tools (Git, Jenkins).
  • Strong grasp of software engineering concepts, data modeling, and optimization techniques.

  • Big Data Specialist

    3 days ago

    Bhavnagar, Gujarat, India beBeeClustering Full time ₹ 12,00,000 - ₹ 15,00,000

    Job Title: Big Data SpecialistWe are seeking an experienced professional with a strong background in big data administration to lead our team.Design, build, and manage complex big data architectures to ensure high performance and uptime.Migrate large datasets between different platforms while minimizing downtime.Perform performance tuning and optimization of...

  • Data Scientist with Big Data Expertise

    4 days ago

    Bhavnagar, Gujarat, India beBeeData Full time ₹ 2,00,00,000 - ₹ 2,50,00,000

    Job Title: Data Scientist with Big Data ExpertiseWe are seeking a skilled and experienced data scientist to join our team.The ideal candidate will have expertise in big data, including data ingestion from disparate sources onto big data platforms.Key Skills:PySparkHiveBenefits:A chance to work on exciting big data projectsA collaborative and dynamic work...

  • Advanced Big Data Engineer

    3 hours ago

    Bhavnagar, Gujarat, India beBeeData Full time ₹ 15,00,000 - ₹ 20,12,000

    Job DescriptionWe are seeking a seasoned Big Data Developer to drive the design, implementation, and maintenance of large-scale data processing systems.The ideal candidate will have 2+ years of experience in Big Data development with expertise in Scala, AWS, and Python or Java.Design and implement scalable data processing systems using Big Data...

  • Senior Big Data Strategist

    2 hours ago

    Bhavnagar, Gujarat, India beBeeDataStrategist Full time ₹ 18,00,000 - ₹ 25,00,000

    Job TitleA senior big data professional with expertise in Hadoop and Scala is required to spearhead our organization's data strategy.The ideal candidate will have hands-on experience working with big data tools, a strong understanding of SQL and object-oriented programming concepts.Technical Requirements:Extensive knowledge of Scala, Spark, Hive, and Hadoop...

  • Chief Data Architect – Big Data Platforms

    6 days ago

    Bhavnagar, Gujarat, India beBeeBigDataLeader Full time ₹ 1,50,00,000 - ₹ 2,50,00,000

    Lead Big Data Engineering TeamWe are seeking an experienced Lead to spearhead a team of data engineers working on large-scale distributed data systems. The ideal candidate will have deep expertise in Big Data platforms and cloud technologies.Key Responsibilities:Grow and lead a team of data engineers to design, develop, and deliver scalable data pipelines...

  • Data Engineer for Big Data Solutions

    4 days ago

    Bhavnagar, Gujarat, India beBeeInformatica Full time ₹ 1,00,00,000 - ₹ 1,50,00,000

    Job DescriptionThe ideal candidate will have a proven track record of designing and developing scalable ETL workflows using Informatica BDM/DEI.They will integrate data from structured and unstructured sources, including big data platforms, and apply strong data warehousing concepts to ensure efficient data modeling and transformation.Collaboration with data...

  • Mastering Big Data Solutions

    6 days ago

    Bhavnagar, Gujarat, India beBeeDataEngineer Full time ₹ 15,00,000 - ₹ 20,00,000

    We are seeking a skilled Senior Data Engineer with hands-on expertise in Python and Pyspark to help implement a cutting-edge application for a prominent retailer. Key Responsibilities:Design, develop, and maintain large-scale data systems using Python and Pyspark.Collaborate with cross-functional teams to integrate data streams from various sources.Analyze...

  • Big Data Platform Architect

    4 days ago

    Bhavnagar, Gujarat, India beBeeDataLeader Full time ₹ 25,00,000 - ₹ 35,00,000

    Job DescriptionSigmoid empowers enterprises to make smarter, data-driven decisions by blending advanced data engineering with AI consulting. We collaborate with leading organizations across sectors such as retail, finance, life sciences, and manufacturing to solve complex business challenges. Our global team specializes in cloud data modernization,...

  • Senior Big Data Solutions Architect

    6 days ago

    Bhavnagar, Gujarat, India beBeeDataEngineer Full time ₹ 15,00,000 - ₹ 25,00,000

    Big Data ArchitectWe are seeking a skilled Big Data Architect to lead our data-driven initiatives and design scalable data pipelines. This role involves collaborating with data scientists and business stakeholders to deliver high-quality solutions.Key Responsibilities:Design, build, and optimize data pipelines and ETL workflows using Apache Spark, Python,...

  • Strategic Data Architect

    4 days ago

    Bhavnagar, Gujarat, India beBeeData Full time ₹ 15,00,000 - ₹ 25,00,000

    Big Data Specialist RoleWe are seeking a highly skilled professional to fill the position of Big Data Specialist. In this role, you will be responsible for designing and implementing robust data pipelines that handle high-volume financial data.Key Responsibilities:Design, develop, and manage end-to-end data pipelines for stocks, crypto, and other financial...