Senior Real-Time Data Engineering Consultant

2 weeks ago

Pune, Maharashtra, India beBeeDataengineering Full time US$ 90,000 - US$ 1,35,000

Job Overview

">We are seeking a highly skilled professional to join our team and play a key role in designing, implementing, and maintaining a real-time data streaming platform hosted in AWS and Confluent Cloud Infrastructure.">

Key Responsibilities

">
  • ">
  • Development & Build: Builddirect robust, scalable real-time data streaming platforms leveraging AWS and Confluent Cloud Infrastructure.">
  • AWS Services: Strong knowledge of AWS services, particularly those relevant to stream processing and serverless components like Lambda Functions.">
  • Performance Monitoring: Continuously monitor and troubleshoot streaming platform performance issues to ensure optimal functionality.">
  • Collaboration: Work closely with cross-functional teams to onboard various data products into the streaming platform and support existing implementations.">
  • Version Control: Manage code using Git, ensuring best practices in version control are followed.">
  • Infrastructure as Code (IaC): Apply expertise in Terraform for efficient infrastructure management.">
  • CI/CD Practices: Implement robust CI/CD pipelines using GitHub Actions to automate deployment workflows.">
">

Mandatory Skillsets

">
  • ">
  • Strong proficiency in AWS services, including IAM Roles, Access Control RBAC, S3, Containerized Lambda Functions, VPC, Security Groups, RDS, MemoryDB, NACL, CloudWatch, DNS, Network Load Balancer, Directory Services and Identity Federation, AWS Tagging Configuration, Certificate Management, etc.">
  • Strong understanding of Docker, including containerisation and image creation.
">Excellent programming skills in Python and Go, capable of writing efficient scripts.">Familiarity with Git concepts for version control.">Deep knowledge of Infrastructure as Code principles, particularly Terraform.">Experience with CI/CD tools, specifically GitHub Actions.">Understanding of security best practices, including knowledge of Snyk, Sonar Cloud, and Code Scene.">">

Why Choose This Role?

">

Join our organization as a specialist who will be responsible for developing and deploying a cutting-edge data streaming platform. You will work on the design, implementation, and maintenance of this platform, utilizing your expertise in cloud-based infrastructure, AWS services, and other related technologies.

">

Requirements

">

This position requires a unique blend of technical skills and industry knowledge. As a key member of our team, you must have:

">
  • ">
  • Hands-on experience with AWS and Confluent Cloud Infrastructure.">
  • Proficiency in coding languages such as Python and Go.">
  • Expertise in containerization and orchestration using Docker and Kubernetes.">
  • Knowledge of infrastructure as code (IaC) using Terraform.">
  • Experience with CI/CD tools like GitHub Actions.">
  • Understanding of security best practices.">
">

What We Offer

">

As a valued member of our team, you will receive:

">
  • ">
  • Competitive salary.">
  • Opportunities for professional growth and development.">
  • A dynamic and collaborative work environment.">
  • Access to cutting-edge technology and tools.">
">

Keyword: DataEngineering Specialist

  • Data Engineer

    2 weeks ago

    Pune, Maharashtra, India Data Axle Full time ₹ 15,00,000 - ₹ 28,00,000 per year

    About Data Axle:Data Axle Inc. has been an industry leader in data, marketing solutions, sales and research for 50 years in the US. Data Axle has set a strategic global centre of excellence in Pune. This centre delivers mission critical data services to its global customers powered by its proprietary cloud-based technology platform and leveraging proprietary...

  • Cloud Solution Delivery Senior Consultant

    2 weeks ago

    Pune, Maharashtra, India NTT Data Full time

    Job DescriptionNTT DATA strives to hire exceptional, innovative and passionate individuals who want to grow with us. If you want to be part of an inclusive, adaptable, and forward-thinking organization, apply now.We are currently seeking a Cloud Solution Delivery Senior Consultant to join our team in Pune, Mahrshtra (IN-MH), India (IN).AWS DevOps EngineerJob...

  • Construction Engineer-Consultant-Electrical-Construction Engineering

    6 days ago

    Pune, Maharashtra, India Tata Consultant Engineering Limited Full time ₹ 8,00,000 - ₹ 12,00,000 per year

    About UsTata Consulting Engineers Limited (TCE) is the largest Indian private sector engineering and project consultancy and an emerging global leader in integrated engineering solutions. With more than 60 years of engineering excellence, TCE has a presence in over 64 countries and over 12000 completed projects, the company operates in 3 core Industry...

  • Cloud Solution Delivery Senior Consultant

    2 weeks ago

    Pune, Maharashtra, India NTT DATA Full time US$ 1,04,000 - US$ 1,30,878 per year

    Req ID: 339869NTT DATA strives to hire exceptional, innovative and passionate individuals who want to grow with us. If you want to be part of an inclusive, adaptable, and forward-thinking organization, apply now. We are currently seeking a Cloud Solution Delivery Senior Consultant to join our team in Pune, Mahārāshtra (IN-MH), India (IN). AWS DevOps...

  • Urgent Search) Functional Consultant Senior Consultant

    2 weeks ago

    Pune, Maharashtra, India NTT DATA Full time

    Req ID 290788NTT DATA Services strives to hire exceptional innovative and passionate individuals who want to grow with us If you want to be part of an inclusive adaptable and forward-thinking organization apply now We are currently seeking a Functional Consultant Senior Consultant to join our team in Pune Mah xc4 x81r xc4 x81shtra IN-MH India IN ...

  • Digital Solution Consultant Senior Consultant

    2 weeks ago

    Pune, Maharashtra, India NTT DATA Full time

    Req ID 292031NTT DATA Services strives to hire exceptional innovative and passionate individuals who want to grow with us If you want to be part of an inclusive adaptable and forward-thinking organization apply now We are currently seeking a Digital Solution Consultant Senior Consultant to join our team in Pune Madhya Pradesh IN-MP India IN Why...

  • Senior Data Engineer

    3 weeks ago

    Pune, Maharashtra, India True Talents Full time

    Job Title : Senior Data EngineerLocation : Pune / NoidaExperience : 4 - 8 YearsEmployment Type : Full-timeNotice Period : Up to 30 DaysAbout the Role :We are looking for an experienced Senior Data Engineer to design, build, and optimize scalable data pipelines and data platforms. The ideal candidate should have strong expertise in modern data...

  • Senior Data Engineer

    4 weeks ago

    Pune, Maharashtra, India Artefact Full time

    Data Engineer Artefact IndiaLocation : PuneWork Mode : HybridNotice : IMMEDIATE/30days/Serving Notice Onlyis a new generation of data service providers specialising in data consulting and data-driven digital marketing. It is dedicated to transforming data into business impact across the entire value chain of organisations. We are proud to say we're enjoying...

  • Data & Analytics Consulting Sr. Manager

    2 weeks ago

    Pune, Maharashtra, India NTT DATA Full time

    Req ID 291802NTT DATA Services strives to hire exceptional innovative and passionate individuals who want to grow with us If you want to be part of an inclusive adaptable and forward-thinking organization apply now We are currently seeking a Data Analytics Consulting Sr Manager to join our team in Pune Mah xc4 x81r xc4 x81shtra IN-MH India IN ...

  • Industry Consulting Snr. Consultant

    2 weeks ago

    Pune, Maharashtra, India NTT Data Full time

    Job DescriptionNTT DATA strives to hire exceptional, innovative and passionate individuals who want to grow with us. If you want to be part of an inclusive, adaptable, and forward-thinking organization, apply now.We are currently seeking a Industry Consulting Snr. Consultant to join our team in Pune, Mahrshtra (IN-MH), India (IN).You bring systems design...