Big Data Solutions Specialist

5 days ago

Bikaner, Rajasthan, India beBeeDataEngineering Full time ₹ 1,50,00,000 - ₹ 2,50,00,000

Job Title: Data Engineer

 

Overview:

We are seeking a highly skilled data engineer with expertise in Scala, Spark, Python, NiFi, and Apache Kafka to join our team. The ideal candidate will have a proven track record in building, scaling, and optimizing big data pipelines, and hands-on experience in distributed data systems and cloud-based solutions.

 

Responsibilities:

- Design, develop, and optimize large-scale data pipelines and distributed data processing systems.

- Work extensively with Scala, Spark (PySpark), and Python for data processing and transformation.

- Develop and integrate streaming solutions using Apache Kafka and orchestration tools like NiFi / Airflow.

- Write efficient queries and perform data analysis using Jupyter Notebooks and SQL.

- Collaborate with cross-functional teams to design scalable cloud-based data architectures.

- Ensure delivery of high-quality code through code reviews, performance tuning, and best practices.

- Build monitoring and alerting systems leveraging Splunk or equivalent tools.

- Participate in CI/CD workflows using Git, Jenkins, and other DevOps tools.

 

Mandatory Skills:

- Scala – Minimum 3+ years of hands-on experience.

- Strong expertise in Spark (PySpark) and Python.

- Hands-on experience with Apache Kafka.

- Knowledge of NiFi / Airflow for orchestration.

- Strong experience in Distributed Data Systems (5+ years).

- Proficiency in SQL and query optimization.

- Good understanding of Cloud Architecture.

 

Preferred Skills:

- Exposure to messaging technologies like Apache Kafka or equivalent.

- Experience in designing intuitive, responsive UIs for data analytics visualization.

- Familiarity with Splunk or other monitoring/alerting solutions.

- Hands-on experience with CI/CD tools (Git, Jenkins).

- Strong grasp of software engineering concepts, data modeling, and optimization techniques.

],

  • Big Data Specialist

    5 days ago

    Bikaner, Rajasthan, India beBeeData Full time ₹ 18,00,000 - ₹ 24,00,000

    Big Data SpecialistWe are seeking a highly skilled and experienced Big Data specialist to lead our organization's data-driven initiatives. The successful candidate will have a strong background in handling large datasets, implementing data warehousing solutions, and developing insights that drive business growth.Key Responsibilities:Design and implement big...

  • Big Data Solutions Architect

    5 hours ago

    Bikaner, Rajasthan, India beBeeBigData Full time ₹ 15,00,000 - ₹ 25,00,000

    Job Overview:We are seeking a seasoned professional to design, develop, and deploy big data solutions using Scala, Python, Java, and AWS.Work collaboratively with cross-functional teams to gather requirements and implement scalable data pipelines.Analyze large datasets to gain valuable insights and inform business decisions.Key Responsibilities:Our ideal...

  • Big Data Integration Specialist

    4 days ago

    Bikaner, Rajasthan, India beBeeETL Full time ₹ 15,00,000 - ₹ 25,00,000

    Big Data Integration SpecialistWe are seeking a highly skilled Big Data Integration specialist to join our team in Bangalore/Kochi. As an ETL tester, you will be responsible for designing and executing test cases to validate Databricks tables across various layers.Main Responsibilities:Design and execute comprehensive test cases to ensure data...

  • Big Data Cloud Solutions Expert

    7 hours ago

    Bikaner, Rajasthan, India beBeeCloudArchitect Full time ₹ 18,00,000 - ₹ 30,00,000

    Job Title: Cloud and Big Data ArchitectWe seek skilled professionals with a strong focus on designing and implementing scalable Big Data architectures on cloud environments.This is a full-time hybrid role, offering flexibility for remote work.Key Responsibilities:Design and implement scalable Big Data architectures on cloud environmentsEnsure data governance...

  • Big Data Architect

    5 days ago

    Bikaner, Rajasthan, India beBeeTechnicalLead Full time ₹ 1,50,00,000 - ₹ 2,50,00,000

    Technical LeadWe are seeking a highly skilled Technical Lead to build a scalable and extensible big data platform. This individual will be responsible for designing, developing, and evolving distributed components using big data technologies.Key Responsibilities:Align with key client initiativesInterface daily with customers across leading Fortune 500...

  • Big Data Solutions Architect

    12 hours ago

    Bikaner, Rajasthan, India beBeeDataEngineer Full time ₹ 1,50,00,000 - ₹ 2,50,00,000

    Data Engineering ExpertiseJoin a dynamic team of professionals driving business transformation through cutting-edge technology solutions.At our company, we harness the power of data to drive strategic decision-making and propel growth. Our ideal candidate possesses extensive experience leading data engineering teams, fostering collaboration across...

  • Big Data Engineering Lead

    6 days ago

    Bikaner, Rajasthan, India beBeeDataEngineer Full time ₹ 1,51,53,000 - ₹ 2,21,79,000

    Transforming data into business outcomes requires a unique blend of technical expertise and innovative thinking. At BrightEdge, we're on the lookout for a seasoned Data Engineer to join our Professional Services team. This is an exceptional opportunity to leverage your skills in designing, building, and maintaining high-performance data pipelines that...

  • Big Data Systems Developer

    6 days ago

    Bikaner, Rajasthan, India beBeeDataEngineering Full time ₹ 1,42,23,444 - ₹ 2,51,49,127

    Job Title: Data EngineerJob Description: We are seeking an experienced Data Engineer to join our team. The successful candidate will be responsible for designing, building, and maintaining large-scale data processing systems using Apache Spark and other related technologies.Required Skills:Proficiency in Python programming language with experience in...

  • Senior Data Solutions Developer

    6 hours ago

    Bikaner, Rajasthan, India beBeeDataEngineer Full time ₹ 15,00,000 - ₹ 25,00,000

    Job Title: Data EngineerAbout the Role:Maintain architecture principles, guidelines and standards for data warehousing.Develop software code in one or more languages such as Java and Python.Implement solution in areas like big data, data analytics, and GCP services.Key Responsibilities:Design and implement solutions using Google Cloud Platform Data...

  • Data Scientist/ml Engineer

    5 days ago

    Bikaner, Rajasthan, India Quant-data Full time

    ???? We're Hiring: Machine Learning Engineer / Data Engineer (Remote | Full-Time) Build AI-powered credit decisioning systems on Microsoft AzureWe're looking for a Machine Learning Engineer / Data Engineer with 5+ years of experience to join our AI-driven credit lending platform team.In this role, you'll design and deploy scalable ML solutions that power...