Chief Data Engineer

4 days ago

Pune, Maharashtra, India beBeeDataEngineering Full time ₹ 1,50,00,000 - ₹ 2,50,00,000

Real-Time Data Engineering

This is a challenging and rewarding role that involves designing and implementing scalable, real-time data processing systems in Kafka. As part of our team, you will be responsible for building and maintaining complex data pipelines, ensuring high availability and scalability.

The ideal candidate will have extensive experience with Apache Kafka and real-time architecture, as well as strong knowledge of Kafka Streams, Kafka Connect, Spark Streaming, Schema Registry, Flink and Beam.

  • Main Responsibilities:
  • Design and implement scalable, real-time data processing systems in Kafka.
  • Configure, deploy, and maintain Kafka clusters to ensure high availability and scalability.
  • Integrate Kafka with other data processing tools and platforms.
  • Collaborate with cross-functional teams to understand data requirements and design solutions that meet business needs.
  • Implement security measures to protect Kafka clusters and data streams.
  • Monitor Kafka performance and troubleshoot issues to ensure optimal performance.
  • Provide technical guidance and support to development operations teams.

Requirements:

  • Extensive experience with Apache Kafka and real-time architecture.
  • Strong knowledge of Kafka Streams, Kafka Connect, Spark Streaming, Schema Registry, Flink and Beam.
  • Experience with cloud platforms such as GCP Pub/Sub.
  • Excellent problem-solving skills.

Benefits:

  • Paid training and certifications.
  • Opportunities for professional growth and development.
  • A dynamic and collaborative work environment.

  • Data Operations Engineer

    11 hours ago

    Pune, Maharashtra, India Mars Data Insights Full time ₹ 1,04,000 - ₹ 1,30,878 per year

    Title: Data Operations Engineer & RUN SupportSkills:Data Operations Engineering, data manipulation, Python, Talend, GCP, Bigquery, DataIku, ITSM/ticketing tools, Helix, Jira, task management, data pipelines,  RUN Service, data infrastructure, data quality Job Location:Pune Job Type:Fulltime/Hybrid Work Experience:5+ years We are seeking a highly...

  • Data Engineer

    10 hours ago

    Pune, Maharashtra, India Luxoft Full time ₹ 15,00,000 - ₹ 20,00,000 per year

    Project description Are you passionate about leveraging the latest technologies for strategic change? Do you enjoy problem solving in clever ways? Are you organized enough to drive change across complex data systems? If so, you could be the right person for this role. As an experienced data engineer, you will join a global data analytics team in our Group...

  • Chief Data Engineer

    6 days ago

    Pune, Maharashtra, India beBeeData Full time ₹ 14,00,000 - ₹ 20,10,000

    Job Opportunity:The Data Engineering team plays a strategic role in creating value and enhancing quality and efficiency across multiple countries.As a seasoned data engineer with 2-4 years of experience, you will design, develop, and maintain scalable data pipelines and software systems using Google Cloud Platform services such as BigQuery, Dataproc, Data...

  • Chief Engineer Manager

    2 days ago

    Pune, Maharashtra, India beBeeEngineering Full time ₹ 1,80,00,000 - ₹ 2,50,00,000

    Job Title: Chief Engineer ManagerOverviewThe ideal candidate will lead the design and engineering of modular systems for gas distribution, process skids, and fluid systems.This role requires strong technical expertise and leadership skills to build the engineering team's capability.Lead the design and engineering of modular gas and liquid systems.Support the...

  • Head of Data Engineering

    4 weeks ago

    Pune, Maharashtra, India SPIRO Full time

    Job Title: Head of Data EngineeringDepartment: Data EngineeringReporting To: Chief Technology Officer (CTO)Role OverviewSpiro is seeking an exceptional Head of Data Engineering to lead, design, and scale our next-generation data infrastructure. You will oversee the development of robust, scalable data pipelines, architect our big data platforms, and ensure...

  • Head of Data Engineering

    2 weeks ago

    Pune, Maharashtra, India SPIRO Full time

    Job Title: Head of Data Engineering Department: Data Engineering Reporting To: Chief Technology Officer (CTO) Role Overview Spiro is seeking an exceptional Head of Data Engineering to lead, design, and scale our next-generation data infrastructure. You will oversee the development of robust, scalable data pipelines, architect our big data platforms, and...

  • Chief Data Engineering Specialist

    1 day ago

    Pune, Maharashtra, India beBeeDataEngineer Full time ₹ 20,00,000 - ₹ 25,00,000

    Senior Data Engineer Job OpportunityWe are seeking a seasoned Senior Data Engineer to join our team. This is a contractual role that offers the chance to work on integration, development, and support within a newly implemented Fabric Data & Analytics Platform. The ideal candidate will have expertise in building and managing ETL pipelines (Azure Data Factory,...

  • Chief Data Engineering Specialist

    3 days ago

    Pune, Maharashtra, India beBeeDataEngineer Full time ₹ 1,20,00,000 - ₹ 2,00,00,000

    Job Title: Data Engineer – AzureAt our organization, we are seeking a skilled Data Engineer with expertise in the Azure Data Platform to design, develop, and optimize large-scale data pipelines and analytics solutions.

  • Chief Data Strategy Officer

    3 days ago

    Pune, Maharashtra, India beBeeData Full time ₹ 36,00,000 - ₹ 42,00,000

    Chief Data Office Lead PositionThe ideal candidate will possess a deep understanding of data governance, data controls, data lineage, and associated methodologies.A key responsibility includes developing and implementing the organisation's data records management strategy aligned with business objectives and regulatory requirements.Additional...

  • Chief Data Privacy Specialist

    3 days ago

    Pune, Maharashtra, India beBeePrivacy Full time ₹ 90,00,000 - ₹ 1,50,00,000

    Job Summary:The selected candidate will assist in implementing global and local data privacy frameworks as a key member of the Privacy Team.This role requires providing hands-on privacy guidance, training, and advice to stakeholders. It also involves conducting comprehensive risk assessments, impact evaluations, and managing data subject rights requests.Key...