Big Data Engineering Expert

1 day ago

Belgaum, Karnataka, India beBeeData Full time ₹ 20,00,000 - ₹ 25,00,000
Job Overview

A Senior Data Engineer leads a team of big data engineers, working closely with stakeholders and team members to understand their requirements and develop architectures that meet their needs.

This role involves developing data pipelines for new sources, data transformations within the data lake, implementing GraphQL, working with NoSQL databases, CI/CD, and data delivery as per business requirements.

The Senior Data Engineer provides technical leadership and guidance to the team, supporting the data engineering team in setting up the data lake on cloud and implementing standardized data models.

Key Responsibilities:
  • Build pipelines to bring in a wide variety of data from multiple sources within the organization and external sources.
  • Collaborate with cross-functional teams to source data and make it available for downstream consumption.
  • Work with the team to provide an effective solution design to meet business needs.
  • Ensure regular communication with key stakeholders, understanding any key concerns or risks/issues.
  • Manage dependencies and escalate critical issues to the sponsor and/or head of data engineering.
  • Ensure timely delivery, quality, and value of initiative are achieved.
  • Develop an appropriate communications plan for initiative execution and delivery.
  • Ensure final handover to business-as-usual processes and conduct post-implementation reviews.
Requirements:
  • Excellent problem analysis skills.
  • Experience with at least one cloud infra provider (Azure/AWS).
  • Expertise in building data pipelines using batch processing with Apache Spark or Hive query language.
  • Knowledge of streaming data pipeline technologies, including Apache Flink and Delta Lake.
  • Understanding of NOSQL databases and experience with Cosmos DB, RESTful APIs, and GraphQL.
  • Experience with big data ETL processing tools, data modeling, and data mapping.
  • Basic knowledge of scripting (shell/bash) and experience with multiple data sources.
  • Understanding of CI/CD tools, such as Jenkins, JIRA, Bitbucket, Artifactory, Bamboo, and Azure Dev-ops.
  • Basic understanding of DevOps practices and Git version control.
What We're Looking For:

Team players with excellent problem-solving skills, who are experienced in cloud infrastructure, big data engineering, and related technologies.

  • Senior Big Data Engineer

    2 days ago

    Belgaum, Karnataka, India beBeeDataEngineer Full time ₹ 1,80,00,000 - ₹ 2,50,00,000

    Senior Big Data EngineerSkillful and experienced big data engineer sought after to design, build, deploy, and maintain large-scale data processing systems using cloud-based technologies. Key responsibilities include development of high-performance data pipelines, optimization of existing codebases, and implementation of data warehousing concepts.Required...

  • Chief Big Data Solutions Architect

    2 days ago

    Belgaum, Karnataka, India beBeeData Full time US$ 1,00,000 - US$ 1,50,000

    Big Data Engineer">Transform online content into tangible business results by processing massive amounts of data to provide actionable insights to clients.Design, build and maintain high-performance data pipelines that process terabytes of data. Work on optimizing existing systems, identifying and resolving performance bottlenecks, and implementing solutions...

  • Senior Big Data Solutions Architect

    2 days ago

    Belgaum, Karnataka, India beBeeData Full time ₹ 1,50,00,000 - ₹ 2,50,00,000

    Job DescriptionWe are seeking a skilled Data Engineer to design, develop, and maintain data pipelines and ETL processes on Databricks. The ideal candidate will lead the architecture and implementation of scalable, secure, and high-performance data solutions.The Data Engineer will collaborate with business stakeholders, data scientists, and analysts to gather...

  • Data Engineer

    3 weeks ago

    Belgaum, Karnataka, India Petrofac Full time

    Petrofac is a leading international service provider to the energy industry, with a diverse client portfolio including many of the world's leading energy companies.We design, build, manage, and maintain infrastructure for our clients. We recruit, reward, and develop our people based on merit, regardless of race, nationality, religion, gender, age, sexual...

  • Data engineer

    2 hours ago

    Belgaum, Karnataka, India RiDiK Full time

    We're looking for a Data Engineer to support our team in India. This role offers the opportunity to work on meaningful projects, collaborate with talented colleagues, and contribute to the success of a growing company. If you're someone who takes initiative, values continuous learning, and thrives in a collaborative setting, we'd love to hear from you.Job...

  • Data Expert

    3 days ago

    Belgaum, Karnataka, India beBeeMachineLearning Full time ₹ 20,00,000 - ₹ 25,00,000

    About this role:We are seeking a seasoned expert to design, build, and deploy AI-driven solutions using the Azure ecosystem.Key responsibilities include developing end-to-end ML pipelines for data prep, training, validation, and deployment, as well as applying LLMs & GenAI for NLP, predictive modeling, and analytics.Additionally, the ideal candidate will be...

  • Senior Data Technologist

    2 days ago

    Belgaum, Karnataka, India beBeeData Full time ₹ 18,00,000 - ₹ 20,00,000

    **Job Title:** Senior Data EngineerWe are seeking a highly skilled and experienced Senior Data Engineer to join our team. The ideal candidate will have hands-on expertise in Python and Pyspark, with a strong background in Telemetry, Big Data, and backend engineering.**Required Skills & Qualifications:**5+ years of experience as a Data EngineerExpertise in...

  • Senior Data Integration Specialist

    14 hours ago

    Belgaum, Karnataka, India beBeeData Full time ₹ 18,00,000 - ₹ 30,00,000

    Job OpportunityWe are seeking a seasoned professional to design and develop scalable data integration solutions utilizing Informatica BDM/DEI.The ideal candidate will possess extensive experience in ETL pipeline design, development, and optimization, as well as expertise in big data technologies such as Hive, Spark, and SQL.Key responsibilities...

  • Data Engineering Specialist

    2 days ago

    Belgaum, Karnataka, India beBeeDataEngineer Full time ₹ 40,00,000 - ₹ 60,00,000

    Data Engineering ExpertOur organization is seeking a skilled Data Engineer to join our team and support data-driven initiatives. As a key member of the team, you will play a vital role in building scalable pipelines, working with streaming data, and collaborating with data scientists and business stakeholders to deliver high-quality solutions.The role...

  • SAP Engineering Expert

    2 days ago

    Belgaum, Karnataka, India beBeeExpert Full time ₹ 80,00,000 - ₹ 1,50,00,000

    About UsWe are a leading provider of AI, Data and Quality Engineering solutions. Our Global Delivery Model allows us to expand our reach across North America, the United Kingdom, and an offshore development centre in India.Our Vision:To be an expert in AI, Data, Cloud and Quality Engineering transformations, bold in our thinking and authentic in our...