Highly Skilled Data Engineer Wanted

4 days ago

Cochin, Kerala, India beBeeData Full time ₹ 1,50,00,000 - ₹ 2,50,00,000
Big Data Engineer Opportunity

We are seeking a highly skilled data engineer to join our team. The ideal candidate will have expertise in Scala, Spark, Python, NiFi, and Apache Kafka, as well as experience in building, scaling, and optimizing big data pipelines.

The successful candidate will be responsible for designing, developing, and optimizing large-scale data pipelines and distributed data processing systems. They will work extensively with Scala, Spark (PySpark), and Python for data processing and transformation, and develop and integrate streaming solutions using Apache Kafka and orchestration tools like NiFi / Airflow.

Key Responsibilities:

  • Data Pipeline Development: Design, develop, and optimize large-scale data pipelines and distributed data processing systems.
  • Programming Skills: Work extensively with Scala, Spark (PySpark), and Python for data processing and transformation.
  • Streaming Solutions: Develop and integrate streaming solutions using Apache Kafka and orchestration tools like NiFi / Airflow.
  • Query Optimization: Write efficient queries and perform data analysis using Jupyter Notebooks and SQL.
  • Team Collaboration: Collaborate with cross-functional teams to design scalable cloud-based data architectures.
  • Code Quality: Ensure delivery of high-quality code through code reviews, performance tuning, and best practices.
  • Monitoring and Alerting: Build monitoring and alerting systems leveraging Splunk or equivalent tools.
  • CI/CD: Participate in CI/CD workflows using Git, Jenkins, and other DevOps tools.
  • Product Development: Contribute to product development with a focus on scalability, maintainability, and performance.

Mandatory Skills:

  • Scala: Minimum 3+ years of hands-on experience.
  • Spark and Python: Strong expertise in Spark (PySpark) and Python.
  • Apache Kafka: Hands-on experience with Apache Kafka.
  • NiFi/Airflow: Knowledge of NiFi / Airflow for orchestration.
  • Distributed Data Systems: Strong experience in Distributed Data Systems (5+ years).
  • SQL: Proficiency in SQL and query optimization.
  • Cloud Architecture: Good understanding of Cloud Architecture.

Preferred Skills:

  • Messaging Technologies: Exposure to messaging technologies like Apache Kafka or equivalent.
  • Data Analytics Visualization: Experience in designing intuitive, responsive UIs for data analytics visualization.
  • Monitoring and Alerting Tools: Familiarity with Splunk or other monitoring/alerting solutions.
  • CI/CD Tools: Hands-on experience with CI/CD tools (Git, Jenkins).
  • Software Engineering Concepts: Strong grasp of software engineering concepts, data modeling, and optimization techniques.

  • Highly Skilled Data Engineer Wanted

    2 days ago

    Cochin, Kerala, India beBeeDataEngineer Full time ₹ 23,00,000

    Senior Data Engineer Job SummaryWe are seeking an experienced Senior Data Engineer to lead the development of a scalable data ingestion framework while ensuring high data quality and validation.The ideal candidate will have at least 7 years of relevant experience in data engineering with a strong emphasis on analytical platform development. They should be...

  • Highly Skilled Data Engineer

    1 week ago

    Cochin, Kerala, India beBeeDataEngineering Full time ₹ 1,50,00,000 - ₹ 2,50,00,000

    Job Overview:We are seeking a highly skilled Data Engineering professional to join our team as a Senior Data Engineer. This key role involves designing, developing, and maintaining large-scale data processing systems. The ideal candidate will have extensive experience with distributed data processing systems, including Python, Pyspark, Azure Data Bricks,...

  • Highly Skilled Data Engineer Wanted

    2 weeks ago

    Cochin, Kerala, India beBeeData Full time ₹ 1,50,00,000 - ₹ 2,50,00,000

    Senior Data Engineer Job DescriptionWe are seeking an experienced Senior Data Engineer to join our organization.The ideal candidate will have a minimum of 4+ years of experience in data engineering and will be proficient in building scalable real-time and batch processing workflows using cloud-based technologies.The successful candidate will also have...

  • Highly Skilled Cloud Data Professional Wanted

    2 weeks ago

    Cochin, Kerala, India beBeeDataEngineer Full time ₹ 1,50,00,000 - ₹ 2,50,00,000

    Job Title: Cloud Data EngineerWe are seeking a highly skilled Cloud Data Engineer to join our team. The ideal candidate will have experience in designing, developing, and maintaining batch and streaming data pipelines using cloud-based technologies.The successful candidate will be responsible for:Designing and implementing scalable data pipelines using...

  • Highly Skilled Data Analyst Wanted

    4 days ago

    Cochin, Kerala, India beBeeAnalytics Full time ₹ 9,00,000 - ₹ 12,00,000

    Job Opportunity: Advanced Analytics SpecialistWe are seeking a highly skilled Advanced Analytics Specialist to join our team. As an Advanced Analytics Specialist, you will be responsible for designing and implementing advanced analytics solutions, developing and deploying machine learning models, and extracting insights from complex data sets.Key...

  • Highly Skilled Data Innovator Wanted

    2 weeks ago

    Cochin, Kerala, India beBeeDataScientist Full time ₹ 1,50,00,000 - ₹ 2,00,00,000

    Lead Data InnovatorAt our organization, we're looking for a highly skilled Senior Data Scientist to spearhead data-driven projects. As a key member of our team, you will be responsible for driving innovation and developing cutting-edge solutions that leverage Machine Learning and Generative AI.This role requires a deep understanding of complex business...

  • Highly Skilled Data Analyst Wanted

    1 week ago

    Cochin, Kerala, India beBeeDataAnalyst Full time ₹ 5,00,000 - ₹ 10,00,000

    Data SpecialistAre you a detail-oriented professional with a passion for working with data? We are looking for someone to join our team as a Data Specialist.This role involves collaborating with our talented engineers who are pushing the boundaries of data science and automation. You will play an integral part in ensuring that our clients receive...

  • Highly Skilled Network Engineer Wanted

    1 week ago

    Cochin, Kerala, India beBeeWireless Full time ₹ 18,00,000 - ₹ 25,20,000

    About Us:We are a global technology consulting and digital solutions company that enables enterprises to reimagine business models and accelerate innovation through digital technologies.Our team of entrepreneurial professionals across the globe caters to over 700 clients with our extensive domain and technology expertise to help drive superior competitive...

  • Highly Skilled Unreal Engine Developer Wanted

    2 weeks ago

    Cochin, Kerala, India beBeeUnreal Full time ₹ 12,00,000 - ₹ 15,00,000

    About this positionWe are seeking a highly skilled Senior Unreal Engine Developer to drive the development of gameplay and mechanics for our project. As a senior, you will lead the programming team, ensure high-quality code, and contribute to the overall direction of the project.Key Responsibilities:Collaborate with game designers, artists, and other...

  • Highly Skilled PhD Peer Reviewer Wanted

    1 week ago

    Cochin, Kerala, India beBeeEngineering Full time ₹ 50,00,000 - ₹ 75,00,000

    Highly Skilled PhD Peer Reviewer WantedAs a prestigious academic institution, we are seeking a highly skilled PhD Peer Reviewer to join our esteemed team of experts.Key Responsibilities:Assess Novelty: Evaluate whether the manuscript is original and adds new knowledge or insights to the field of study.Evaluate Study Design and Methodology: Check whether the...