Big Data Solutions Specialist

4 days ago

India beBeeDataEngineering Full time ₹ 1,04,000 - ₹ 1,30,878

Job Title: Big Data Engineer

Location: Bangalore, Chennai, Gurgaon, Pune, Mumbai.

Experience: 7–10 Years (Minimum 3+ years in Scala)

Notice Period: Immediate to 30 Days

Mode of Work: Hybrid

We are seeking a highly skilled professional with expertise in data engineering and architecture. The ideal candidate will have hands-on experience in building, scaling, and optimizing big data pipelines, and strong understanding of distributed data systems and cloud-based solutions.

The selected individual will be responsible for:

- Designing, developing, and optimizing large-scale data pipelines and distributed data processing systems.

- Working extensively with Scala, Spark (PySpark), and Python for data processing and transformation.

- Developing and integrating streaming solutions using Apache Kafka and orchestration tools like NiFi / Airflow.

- Writing efficient queries and performing data analysis using Jupyter Notebooks and SQL.

- Collaborating with cross-functional teams to design scalable cloud-based data architectures.

- Ensuring delivery of high-quality code through code reviews, performance tuning, and best practices.

- Building monitoring and alerting systems leveraging Splunk or equivalent tools.

- Participating in CI/CD workflows using Git, Jenkins, and other DevOps tools.

Mandatory Skills:

  • Scala – Minimum 3+ years of hands-on experience.
  • Strong expertise in Spark (PySpark) and Python.
  • Hands-on experience with Apache Kafka.
  • Knowledge of NiFi / Airflow for orchestration.
  • Strong experience in Distributed Data Systems (5+ years).
  • Proficiency in SQL and query optimization.
  • Good understanding of Cloud Architecture.

Preferred Skills:

  • Exposure to messaging technologies like Apache Kafka or equivalent.
  • Experience in designing intuitive, responsive UIs for data analytics visualization.
  • Familiarity with Splunk or other monitoring/alerting solutions.
  • Hands-on experience with CI/CD tools (Git, Jenkins).
  • Strong grasp of software engineering concepts, data modeling, and optimization techniques.

  • Big Data Developer

    4 weeks ago

    India DigiHelic Solutions Pvt. Ltd. Full time

    Job descriptionKey Responsibilities:Big Data Architecture: Design, develop, and maintain scalable and distributed data architectures capable of processing large volumes of data.Data Storage Solutions: Implement and optimize data storage solutions using technologies such as Hadoop, Spark, and PySpark.PySpark Development: Develop and implement efficient ETL...

  • Big Data

    4 weeks ago

    India Technomech Placements Full time

    Job Title Big Data DeveloperExperience 4 to 10 yearsLocation Pune Bangalore Gurgaon Develop optimize and maintain big data solutions Work with Hadoop Spark Hive and other big data technologies Design and implement scalable data pipelines Collaborate with cross-functional teams for data-driven solutions Strong programming skills in Java Scala...

  • Big Data Solutions Architect

    2 days ago

    India beBeeData Full time ₹ 15,00,000 - ₹ 25,00,000

    Job OverviewThe Scala Big Data Engineer will design, develop and optimize data pipelines and ETL workflows. They will work with Apache Hadoop, Airflow, Kubernetes and Containers to streamline data processing.Key Responsibilities:Design and develop data pipelines and ETL workflowsWork with Apache Hadoop, Airflow, Kubernetes and Containers to streamline data...

  • Big Data Analyst

    2 days ago

    India beBeeData Full time ₹ 20,00,000 - ₹ 25,00,000

    Job OpportunityWe are looking for a skilled professional to join our team as a Data Analytics Specialist.About the Role:This is an exciting opportunity to work with large-scale data processing and drive business growth through data-driven insights.Main Responsibilities:Design and implement solutions for problems arising out of big data processing.Collaborate...

  • Cloud Data Architect

    7 days ago

    India beBeeDataEngineer Full time ₹ 2,00,00,000 - ₹ 2,50,00,000

    Job OverviewWe are seeking a seasoned Engineering Manager to lead our data engineering team in designing and delivering scalable data pipelines and analytics platforms.This role will oversee the development of end-to-end data solutions using Azure Data Services and Databricks, collaborating with cross-functional teams to understand requirements and deliver...

  • Chief Big Data Solutions Architect

    4 days ago

    India beBeeDataEngineer Full time ₹ 1,60,00,000 - ₹ 2,40,00,000

    Big Data Developer Opportunities">As a Senior Data Developer, you will be responsible for designing and developing high-performance data pipelines in distributed data processing platforms. You will work with a team of product and program managers, engineering leaders, and business leaders to build data architectures and platforms that support business...

  • Big Data Engineer

    3 weeks ago

    India Amazon Music Full time

    Job DescriptionDESCRIPTIONProfit Intelligence team in Amazon Retail is seeking a seasoned and talented Senior Data Engineer to join the Historical Contribution Profit (HCP) team. HCP is a fast growing team with a mandate to build tools to automate profit-and-loss forecasting and planning for the Physical Consumer business. We are building the next generation...

  • Big Data Revolutionist

    2 days ago

    India beBeeData Full time ₹ 20,00,000 - ₹ 25,00,000

    The Travel Industry is Evolving. Be a Part of It.In today's digital age, the travel industry is witnessing a paradigm shift. The traditional approach to booking travel arrangements is being revolutionized by innovative technologies and forward-thinking companies. As a Data Engineer, you will play a crucial role in this transformation.Job DescriptionWe are...

  • Big Data Java Developer

    2 days ago

    India ClearTrail Technologies Full time

    At ClearTrail, work is more than 'just a job'. Our calling is to develop solutions that empower those dedicated to keep their people, places and communities safe.For over 23 years, law enforcement & federal agencies across the globe have trusted ClearTrail as their committed partner in safeguarding nations & enriching lives. We are envisioning the future of...

  • Scala/Big Data Developer

    2 days ago

    India Idyllic Services Full time

    Job Title: Big Data Engineer – Scala Location: Experience: 7–10 Years (Minimum 3+ years in Scala)Immediate to 30 Days Mode of Work: Hybrid &##Click the link below to learn more about the role and take the AI Interview to begin your application journey: We are looking for a highly skilled Big Data Engineer (Scala) with strong expertise in Scala,...