Senior Cloud Data Engineer

2 days ago

Thiruvananthapuram, Kerala, India beBeeDataEngineer Full time ₹ 1,50,00,000 - ₹ 2,50,00,000

Job Title: Senior Cloud Data Engineer

Job Description

We are seeking an experienced Senior Cloud Data Engineer to join our team. The ideal candidate will have a strong background in cloud computing, data engineering, and big data technologies.

  • Assess Technology Landscape: Evaluate the current technology landscape and assess the impact of new requirements on existing data integration frameworks.
  • Develop High-Performance Spark Jobs: Design, develop, and deploy high-performance Spark jobs using Scala for new project needs and enhance existing ones.
  • Optimize Spark Job Performance: Optimize Spark job performance through stress testing and other optimization techniques.
  • Create Efficient Data Pipelines: Create efficient data pipelines using AWS Lambda or Apache Airflow for developed/enhanced Spark jobs.
Required Skills and Qualifications

The ideal candidate will have:

  • A minimum of 7-9 years of IT experience, with 5+ years in AWS projects.
  • Associate Level and Professional Level AWS Certification is a plus.
  • In-depth knowledge of AWS Services, including S3, EC2, EMR, Serverless, Athena, AWS Glue, Lambda, and Step Functions.
  • Cloud databases, including AWS Aurora, Singlestore, RedShift, and Snowflake.
  • Big Data technologies, including Hadoop, Hive, Spark, and YARN.
  • Programming languages, including Scala, Python, Shell Scripts, and PySpark.
  • Strong SQL skills and expertise in developing ETL workflows with complex transformations.
  • Understanding of AWS VPC, Subnets, Security Groups, and Route Tables.
Benefits

This role offers a competitive salary and benefits package, as well as opportunities for professional growth and development.

Others

We are an equal opportunities employer and welcome applications from diverse candidates. If you are a motivated and experienced individual looking for a new challenge, please submit your application.

  • Cloud Data Engineer

    6 days ago

    Thiruvananthapuram, Kerala, India beBeeDataEngineer Full time ₹ 1,00,00,000 - ₹ 2,00,00,000

    Job Description:We are seeking an experienced data engineer to join our team. As a senior member of the engineering group, you will be responsible for designing, developing and maintaining scalable and secure data solutions on Databricks.Key Responsibilities:Collaborate with business stakeholders, data scientists and analysts to deliver actionable insights...

  • Senior Cloud Data Engineering Specialist

    6 days ago

    Thiruvananthapuram, Kerala, India beBeeDataEngineering Full time ₹ 1,04,000 - ₹ 1,30,878

    Job Role Overview:As a senior data engineering specialist, you will design and develop scalable solutions using Azure Databricks and PySpark. This role involves collaboration with product owners to analyze requirements and create detailed interface designs.Key Responsibilities:Develop and optimize data pipelines using ADF, SQL, and NoSQL...

  • Senior Cloud Data Engineer(Lead)

    5 days ago

    Thiruvananthapuram, Kerala, India beBeeCloudEngineering Full time ₹ 1,50,00,000 - ₹ 2,00,00,000

    Job Title: Cloud Data Engineering LeadJob DescriptionWe are seeking an experienced Cloud Data Engineering Lead to join our team. As a key member of our data engineering organization, you will be responsible for designing, developing, and optimizing ETL/ELT data pipelines using Apache Spark (PySpark or Scala), AWS Glue, and Azure Data Factory.Around 6+ years...

  • Senior Cloud Data Architect

    4 days ago

    Thiruvananthapuram, Kerala, India beBeeDataEngineering Full time ₹ 20,00,000 - ₹ 25,00,000

    Job Title: Cloud Data Engineering LeaderOverview: We are seeking a seasoned Cloud Data Engineering Leader to spearhead the development and implementation of data-intensive applications using cloud-native technologies.Key Responsibilities:Lead a team of Senior Engineers in designing and developing scalable data architectures on AWS and GCP.Collaborate with...

  • Senior Data Engineer

    5 days ago

    Thiruvananthapuram, Kerala, India beBeeDataEngineer Full time ₹ 1,71,52,000 - ₹ 2,14,40,000

    Senior Data Engineer PositionOur company is seeking a highly skilled Senior Data Engineer to lead our data engineering efforts. In this role, you will be responsible for designing, developing, and maintaining large-scale data systems that support business intelligence and analytics.Lead the design and implementation of data pipelines, ETL processes, and data...

  • Leading Cloud Data Engineer

    2 days ago

    Thiruvananthapuram, Kerala, India beBeeCloudDataEngineer Full time ₹ 1,50,00,000 - ₹ 2,00,00,000

    About Cloud Data Engineer PositionsTop cloud data engineering positions require highly specialized professionals with extensive knowledge of cloud computing platforms, including Amazon Web Services (AWS), Microsoft Azure, and Google Cloud Platform (GCP).Key skills for these roles include expertise in data warehousing, big data processing, and data analytics,...

  • Senior Cloud Data Solutions Architect

    7 days ago

    Thiruvananthapuram, Kerala, India beBeeDataEngineer Full time ₹ 2,00,00,000 - ₹ 2,50,00,000

    Job Title: Senior Data EngineerWe are seeking a highly skilled Senior Data Engineer to join our team. As a Senior Data Engineer, you will be responsible for designing, implementing, and maintaining data solutions on the Microsoft Azure Data platform and SQL Server.Key Responsibilities:Design and develop warehouse solutions using Azure Synapse Analytics,...

  • Expert Cloud Data Engineer

    1 day ago

    Thiruvananthapuram, Kerala, India beBeeDataEngineer Full time ₹ 2,00,00,000 - ₹ 2,50,00,000

    Job Title: Data Engineer with Expertise in Cloud Technologies We are looking for a highly skilled Data Engineer with expertise in cloud technologies to join our team.About the Role:We are seeking an experienced Data Engineer who can design, develop and implement data solutions using Azure cloud technologies. The ideal candidate will have strong experience...

  • Cloud Data Engineering Position

    4 days ago

    Thiruvananthapuram, Kerala, India beBeeData Full time ₹ 20,00,000 - ₹ 26,25,000

    Job Title: Cloud Data EngineerJob OverviewWe are seeking a skilled and experienced Cloud Data Engineer to join our dynamic team.Key ResponsibilitiesDesign and Develop Scalable Data Pipelines: Build, deploy, and maintain large-scale data pipelines on Google Cloud Platform (GCP).Develop and Maintain Data Warehouse Solutions: Design, implement, and optimize...

  • Cloud Data Engineer

    2 days ago

    Thiruvananthapuram, Kerala, India beBeeDataEngineer Full time ₹ 15,00,000 - ₹ 28,00,000

    Cloud Data Engineering Position","We are looking for a skilled professional to develop and implement large-scale data pipelines using Azure Databricks.","","Design, deploy, and maintain scalable data processing architectures on Azure Databricks.","Collaborate with cross-functional teams to design and implement data warehousing and business intelligence...