Data Engineering Expert for Cloud Architecture

19 hours ago

Pune, Maharashtra, India beBeeDataEngineer Full time ₹ 1,50,000 - ₹ 28,00,000

**Job Overview:**

We are seeking a highly skilled Data Engineering Expert to join our team and lead the development of cloud-based data architectures. The ideal candidate will have extensive experience in designing, building, and maintaining scalable data pipelines using AWS services.

Key Responsibilities:

  • Design and implement data integration frameworks using AWS services such as S3, EC2, EMR, and Lambda.
  • Develop and maintain Spark jobs using Scala for new project requirements and enhance existing ones.
  • Ensure optimal performance of spark jobs through tuning and stress testing.
  • Create new data pipelines using Apache Airflow or AWS Lambda.
  • Responsible for database design, logical design, physical design, star schema, and snowflake schema.
  • Analyze data processing, integration, modeling, and reporting requirements and define data loading strategies considering volume, data types, frequency, and analytics specifications.
  • Ensure an optimal balance between cost and performance.

Required Skills and Qualifications:

  • Overall 7-9 years of IT experience.
  • 5+ years of AWS-related projects.
  • Associate Level and Professional Level AWS Certification is a plus.
  • In-depth knowledge of AWS Services: S3, EC2, EMR, Serverless, Athena, AWS Glue, Lambda, Step Functions.
  • Cloud Databases: AWS Aurora, Singlestore, RedShift, Snowflake.
  • Big Data: Hadoop, Hive, Spark, YARN.
  • Programming Language: Scala, Python, Shell Scripts, PySpark.
  • Operating System: Any flavor of Linux, Windows.
  • Strong SQL skills.
  • Orchestration Tools: Apache Airflow.

Benefits:

  • Opportunity to work on cutting-edge cloud-based data architectures.
  • Collaborative and dynamic work environment.
  • Ongoing training and certification programs.

Others:

  • Bachelor's degree in computer science, engineering, or related field (Master's degree is a plus).
  • Demonstrated continued learning through technical certifications or related methods.
  • Minimum 5 years of experience on cloud-related projects.

  • Cloud Data Engineering Expert

    5 days ago

    Pune, Maharashtra, India beBeeDataEngineering Full time ₹ 2,00,00,000 - ₹ 2,50,00,000

    GCP Data Engineering LeadWe are seeking a highly experienced professional to join our team in this key role.Key Responsibilities:Prepare detailed designs aligned with high-level architecture provided by project leadsBuild and deploy data processing systems based on design specificationsApply optimized development approaches using GCP BigQuery and Airflow for...

  • Delivery Solution Architect – IIoT, Cloud Data

    2 weeks ago

    Pune, Maharashtra, India Capgemini Engineering Full time

    Role – Delivery Solution Architect – IIoT, Cloud Data & AI Analytics Job description We are seeking a highly skilled and experienced Delivery Solution Architect with deep expertise in Industrial IoT (IIoT), Cloud Data Platforms, and AI/Analytics to lead the design and delivery of smart factory solutions under the Industry 4.0 paradigm. This role will...

  • Delivery Solution Architect – IIoT, Cloud Data

    2 days ago

    Pune, Maharashtra, India Capgemini Engineering Full time US$ 90,000 - US$ 1,20,000 per year

    Role – Delivery Solution Architect – IIoT, Cloud Data & AI AnalyticsJob descriptionWe are seeking a highly skilled and experienced Delivery Solution Architect with deep expertise in Industrial IoT (IIoT), Cloud Data Platforms, and AI/Analytics to lead the design and delivery of smart factory solutions under the Industry 4.0 paradigm. This role will be...

  • Delivery Solution Architect – IIoT, Cloud Data

    2 days ago

    Pune, Maharashtra, India Capgemini Engineering Full time

    Role – Delivery Solution Architect – IIoT, Cloud Data & AI AnalyticsJob descriptionWe are seeking a highly skilled and experienced Delivery Solution Architect with deep expertise in Industrial IoT (IIoT), Cloud Data Platforms, and AI/Analytics to lead the design and delivery of smart factory solutions under the Industry 4.0 paradigm. This role will be...

  • Cloud Architecture Expert

    6 days ago

    Pune, Maharashtra, India beBeeCloud Full time US$ 7,80,000 - US$ 15,30,000

    Job OverviewWe are seeking a highly skilled cloud architecture expert to design, implement, and maintain scalable, resilient, and secure cloud-native architectures.Key Responsibilities:Design and implement composable architecture solutions using serverless computing and API-driven approaches.Develop and maintain secure, efficient, and reliable cloud...

  • Cloud Architectural Leader

    5 days ago

    Pune, Maharashtra, India beBeeTechnicalExpert Full time ₹ 40,00,000 - ₹ 50,00,000

    Key Position ResponsibilitiesWe are seeking a Senior Technical Expert with expertise in designing and implementing cloud-native architectures, scalable workflows, and robust APIs to ensure seamless system integration and data flow.The ideal candidate will have a strong background in software architecture, cloud computing, and DevOps best practices. They will...

  • Cloud Architecture Specialist

    3 days ago

    Pune, Maharashtra, India beBeeDevOps Full time ₹ 1,50,00,000 - ₹ 2,00,00,000

    Cloud Architect Role SummaryThe Cloud Architect role is a senior position requiring extensive experience in DevOps, infrastructure, or cloud architecture. This individual will be responsible for designing and building end-to-end DevOps pipelines using native cloud services and third-party tools. They will also define foundational architecture setups across...

  • Cloud Architectural Expert

    3 days ago

    Pune, Maharashtra, India beBeeTechnical Full time ₹ 15,00,000 - ₹ 20,00,000

    Cloud Architectural ExpertWe are seeking a seasoned Cloud Architectural Expert to drive impactful projects in our dynamic environment. As a key member of our cross-functional team, you will design, develop, and maintain scalable cloud-based services using Spring Boot and Microservices architecture.Key Responsibilities:Design and implement secure, scalable,...

  • Data Architecture Expert

    11 hours ago

    Pune, Maharashtra, India beBeeDataArchitectureExpert Full time ₹ 1,80,00,000 - ₹ 2,50,00,000

    Job DescriptionWe're seeking a seasoned Data Architecture Expert to join our team. As a key member, you'll lead the design and implementation of distributed data solutions for our clients.This is an exciting opportunity to work on cutting-edge projects, collaborate with top professionals, and drive business growth.Required Skills & QualificationsDistributed...

  • Cloud Architecture Professional

    16 hours ago

    Pune, Maharashtra, India beBeeCloud Full time ₹ 18,63,000 - ₹ 21,47,000

    **Cloud Architect Advisory Job Overview:**Our team is seeking a skilled professional to strengthen our Cloud Architecture & Advisory capabilities.We are looking for a self-driven and customer-obsessed expert who can present detailed service offerings and value propositions of RISE with SAP S/4HANA Cloud Private Edition to clients.The ideal candidate will...