Senior Big Data Engineer

2 weeks ago

Bengaluru, Karnataka, India beBeeBigData Full time ₹ 1,80,00,000 - ₹ 2,50,00,000
Senior Big Data Engineer - AWS Scalability Expert

We are seeking an exceptional Senior Big Data Engineer with in-depth knowledge of AWS Cloud Services and Big Data technologies to lead the design, development, and optimization of scalable data engineering solutions.

Key Responsibilities:

  • Data Architecture Design: Develop and implement highly efficient Big Data architectures leveraging AWS services for large-scale, complex data processing.
  • Data Pipeline Development: Build and maintain data pipelines using Spark (Scala) for both structured and unstructured datasets.
  • Cloud Service Management: Architect and operationalize data engineering and analytics platforms (AWS preferred) including EMR, Glue, Kinesis, DynamoDB, Athena, CloudFormation, API Gateway, and S3.
  • Streaming Solutions: Work on real-time streaming solutions using Kafka and AWS Kinesis.
  • Machine Learning Deployment: Implement and manage AWS services for ML model deployment, scheduling, and monitoring.
  • Quality Assurance: Analyze source system data and data flows to ensure high-quality, reliable data delivery for business needs.
  • Technical Leadership: Collaborate with cross-functional teams to provide technical leadership, mentor team members, and strengthen the data engineering capability.
  • Troubleshooting: Troubleshoot and resolve complex technical issues, ensuring scalability, performance, and security of data solutions.

Mandatory Skills & Qualifications:

  • Solid hands-on experience in Big Data Technologies (AWS, Scala, Hadoop, and Spark)
  • Proven expertise in Spark with Scala
  • Hands-on experience with: AWS services (EMR, Glue, Lambda, S3, CloudFormation, API Gateway, Athena, Lake Formation)

  • Big Data Engineers/Senior Engineers

    4 days ago

    Bengaluru, Karnataka, India Peoplelogic Full time ₹ 15,00,000 - ₹ 25,00,000 per year

    Role: Big Data Engineers/Senior Engineers About the Role:We are seeking highly skilled Big Data Engineers/Senior Engineers with a strong background inbuilding and supporting big data solutions. The ideal candidate will have expertise in big datatechnologies, data pipeline development, and performance optimization within a collaborativeand agile...

  • Senior Big Data Engineer

    2 weeks ago

    Bengaluru, Karnataka, India Guide&Bridge Full time US$ 1,50,000 - US$ 2,00,000 per year

    Job Title: Senior Big Data EngineerExperience Required: 3+ YearsAbout the RoleWe are looking for an experiencedSenior Big Data Engineerto design, build, and optimize large-scale data pipelines and platforms. The ideal candidate will have strong expertise in distributed data processing, cloud-based data solutions, and a proven ability to work with complex...

  • Senior Cloud Engineer

    2 weeks ago

    Bengaluru, Karnataka, India beBeeCloud Full time ₹ 9,00,000 - ₹ 12,00,000

    **Job Title:** Senior Cloud Engineer - Big Data Specialist**Job Description:** We are seeking an experienced Senior Cloud Engineer to join our team. As a cloud expert, you will be responsible for designing and implementing scalable big data solutions using Google Cloud Platform (GCP).We need a candidate with extensive production experience in GCP and a...

  • Big Data Engineer

    2 weeks ago

    Bengaluru, Karnataka, India 4Bell Technology Full time

    Job Description :Core Responsibilities :- Design, build, and maintain robust data pipelines (batch or streaming) that process and transform data from diverse sources.- Ensure data quality, reliability, and availability across the pipeline lifecycle.- Collaborate with product managers, architects, and engineering leads to define technical strategy.-...

  • Senior Big Data Engineer

    2 weeks ago

    Bengaluru, Karnataka, India beBeeData Full time ₹ 1,50,00,000 - ₹ 2,00,00,000

    About the Role We are seeking experienced professionals to join our team as Senior Data Engineers. In this role, you will be responsible for designing and developing efficient data pipelines using big data tools and AWS services. Key Responsibilities: Data Pipeline Development: Design and develop efficient data pipelines as per business requirements while...

  • Big Data Engineer – Spark

    3 weeks ago

    Bengaluru, Karnataka, India POWER IT SERVICES Full time

    Big Data Engineer – Spark & Analytics Job Description • Gather operational intel on business processes and policies from multiple sources • Prepare periodical and ad-hoc reports using operational data • Develop semantic core to align data with business processes • Support operations team's work streams for data processing, analysis and reporting...

  • Big Data Engineer – Spark

    2 weeks ago

    Bengaluru, Karnataka, India POWER IT SERVICES Full time

    Big Data Engineer – Spark & AnalyticsJob Description• Gather operational intel on business processes and policies from multiple sources• Prepare periodical and ad-hoc reports using operational data• Develop semantic core to align data with business processes• Support operations team's work streams for data processing, analysis and reporting•...

  • Big Data Engineer

    3 weeks ago

    Bengaluru, Karnataka, India Coders Brain Full time

    Job DescriptionRoles and Responsibilities:- Develop scalable infrastructure and platform to collect, analyze and process large amounts of structured and unstructured data with real-time data interpretation.- Work closely across an array of various teams and organizations in the company (including partners, customers)Basic Qualifications:- Bachelor's degree...

  • Big Data Engineer

    2 weeks ago

    Bengaluru, Karnataka, India The IT Firm Full time ₹ 1,50,000 - ₹ 28,00,000 per year

    Role OverviewAs a Big Data Engineer, you will be responsible for building and maintaining scalable data pipelines and architectures that support data analytics, reporting, and real-time processing. You will collaborate with data scientists, business analysts, and software engineers to design robust solutions that drive data-driven decisions.Mandatory Skill...

  • Big Data Engineer

    2 weeks ago

    Bengaluru, Karnataka, India IT Firm Full time

    Role Overview :As a Big Data Engineer, you will be responsible for building and maintaining scalable data pipelines and architectures that support data analytics, reporting, and real-time processing. You will collaborate with data scientists, business analysts, and software engineers to design robust solutions that drive data-driven decisions.Mandatory Skill...