Cloud Data Engineer

2 days ago

Kanpur, Uttar Pradesh, India beBeeDataEngineer Full time ₹ 20,00,000 - ₹ 25,00,000

Job Title: Cloud Data Engineer

  • Lead the analysis of existing technology landscapes to identify areas for improvement and assess new requirements.
  • Develop high-performance Spark jobs using Scala to meet project demands, focusing on scalability and reliability.
  • Enhance existing Spark jobs to accommodate ongoing product enhancements, with a focus on performance optimization and cost efficiency.
  • Design and implement data pipelines using AWS Lambda or Apache Airflow for newly developed or enhanced Spark jobs, ensuring seamless integration with cloud infrastructure.
  • Contribute to database design processes, including logical and physical design, star schema, and snowflake schema development, ensuring optimal data management.
  • Define data loading strategies considering volume, data types, frequency, and analytics specifications, ensuring data quality and integrity.
  • Ensure optimal cost and performance balance in data processing and integration, leveraging cloud-based services and tools.
  • Prepare comprehensive project documentation, adhering to quality guidelines and schedules, and collaborating closely with project managers for successful project delivery.
  • Manage build phases, ensuring code quality and adherence to cloud architecture while resolving complex design and development issues.

Requirements:

  • A minimum of 7-9 years of IT experience, with at least 5+ years of experience working with AWS-related projects.
  • Associate Level and Professional Level AWS Certification (good to have).
  • Expertise in required AWS Services: S3, EC2, EMR, Serverless, Athena, AWS Glue, Lambda, Step Functions.
  • Cloud Databases: AWS Aurora, Singlestore, RedShift, Snowflake.
  • Big Data: Hadoop, Hive, Spark, YARN.
  • Programming Language: Scala, Python, Shell Scripts, PySpark.
  • Operating System: Any flavor of Linux, Windows.
  • Strong SQL skills are essential.
  • Orchestration Tools: Apache Airflow.
  • Ability to quickly adapt to new AWS Services or Big Data Technologies as needed.

Preferred Qualifications:

  • Bachelor's degree in Computer Science, Engineering, or related field (Master's degree is a plus).
  • Demonstrated commitment to continued learning through technical certifications or other methods.
  • Minimum 5 years of experience working on Cloud-related projects.

Key Characteristics:

  • Hold strong technical knowledge and experience.
  • Ability to research and delve into various technical fields.
  • Self-motivated and focused on delivering outcomes for a fast-growing team and organization.
  • Effective communication skills through speaking, writing, and client presentations.
  • Ability to consult, write, and present persuasively.
  • Experience working in a self-organized and cross-functional team.
  • Capacity to iterate based on new information, peer reviews, and feedback.

  • Cloud Data Engineer Specialist

    2 days ago

    Kanpur, Uttar Pradesh, India beBeeDataEngineering Full time ₹ 15,00,000 - ₹ 25,00,000

    Job Description">As a data engineering professional, you will be responsible for designing and developing scalable data pipelines and ETL processes using GCP services. Your role will involve collaborating with cross-functional teams to understand data requirements and deliver high-quality data solutions.Key responsibilities include implementing data...

  • Expert Cloud Data Engineer

    1 week ago

    Kanpur, Uttar Pradesh, India beBeeDataEngineering Full time ₹ 2,00,00,000 - ₹ 2,40,00,000

    Cloud Data Engineering Expert WantedWe are seeking a seasoned cloud data engineering expert to design and build large-scale data platforms using modern data engineering tools and best practices.Key Responsibilities:Design and develop robust data pipelines for ingestion, transformation, and analytics using industry-standard tools and technologies.Collaborate...

  • Cloud Data Engineering Specialist

    7 days ago

    Kanpur, Uttar Pradesh, India beBeeDataEngineering Full time ₹ 15,00,000 - ₹ 20,00,000

    Job OpportunityWe are seeking a highly skilled professional to fill the role of Cloud Data Engineering Specialist. As a key member of our data engineering team, you will be responsible for designing, implementing, and maintaining large-scale data processing systems using Azure Data Factory (ADF), Azure Database Services (ADB), PySpark, and SQL.Main...

  • Senior Data Engineer

    6 days ago

    Kanpur, Uttar Pradesh, India beBeeCloud Full time ₹ 15,00,000 - ₹ 21,50,000

    Job Overview">At our company, we're seeking a seasoned and proficient Senior Data Engineer with substantial experience in cloud technologies.The ideal candidate will play a crucial role in designing, implementing, and optimizing data pipelines to ensure seamless integration with cloud platforms.Responsibilities include developing scalable and efficient data...

  • Cloud Data Engineering Professional

    6 days ago

    Kanpur, Uttar Pradesh, India beBeeDataEngineering Full time ₹ 2,00,00,000 - ₹ 2,50,00,000

    Job Title: Cloud Data Engineering ProfessionalAbout the Role:We are seeking a highly skilled Cloud Data Engineering Professional to join our team.The ideal candidate will have extensive experience in designing, developing, and deploying end-to-end data pipelines on cloud infrastructure using services such as Amazon S3, AWS Glue, AWS Lambda, and Amazon...

  • GCP Cloud Data Engineer Position

    5 days ago

    Kanpur, Uttar Pradesh, India beBeeDataEngineer Full time US$ 1,25,000 - US$ 1,75,000

    Cloud Data Engineering OpportunityJob DescriptionWe are seeking an experienced data professional to join our team in designing, developing and maintaining large-scale cloud-based data processing systems.The ideal candidate will have 3-7 years of experience in working with GCP services, including Google Cloud Storage, BigQuery, Dataflow, and more.Proficiency...

  • Cloud-Native Data Engineering Leader

    4 days ago

    Kanpur, Uttar Pradesh, India beBeeDataEngineering Full time ₹ 2,00,00,000 - ₹ 2,50,00,000

    Job DescriptionWe are seeking a seasoned data engineering leader to oversee the development and implementation of scalable data warehouse solutions. The ideal candidate will have a proven track record of building cloud-native data-intensive applications on Amazon Web Services (AWS).This is an exceptional opportunity for a highly skilled data engineer who can...

  • Cloud Engineering Specialist

    2 days ago

    Kanpur, Uttar Pradesh, India beBeeCloudEngineering Full time ₹ 15,00,000 - ₹ 22,00,000

    Cloud Engineering SpecialistWe are seeking a highly skilled Cloud Engineer to spearhead our cloud engineering efforts. This individual will play a pivotal role in designing and implementing scalable data pipelines using Google Cloud Platform (GCP) technologies.

  • Cloud Data Architect

    2 days ago

    Kanpur, Uttar Pradesh, India beBeeDataEngineer Full time ₹ 15,00,000 - ₹ 25,00,000

    Cloud Data ArchitectWe are seeking a Cloud Data Architect to design and develop scalable data pipelines and ETL solutions in a cloud environment using AWS services. This individual will collaborate with cross-functional teams to support data-driven initiatives. Key Responsibilities: Build and maintain complex data architectures on AWS, utilizing its suite...

  • Cloud Data Architect

    2 days ago

    Kanpur, Uttar Pradesh, India beBeeCloudDataEngineer Full time US$ 1,50,000 - US$ 2,00,000

    Job Title: Cloud Data ArchitectLemongrass is a software-enabled services provider, synonymous with SAP on Cloud, focused on delivering superior, highly automated Managed Services to Enterprise customers.We are seeking an experienced Cloud Data Engineer with a strong background in AWS, Azure, and GCP. The ideal candidate will have extensive experience with...