Lead Cloud Data Engineer

19 hours ago

Shimoga, Karnataka, India beBeeDataEngineer Full time ₹ 14,62,500 - ₹ 20,18,500

Job Title: Data Engineer

Domain: Agentic AI – AWS Cloud Solutions

Open Positions: 1 – 4

Position Overview:

We are seeking skilled Cloud-Native Data Engineers to design, build, and manage robust data pipelines that power our AI solutions on AWS. The role focuses on developing efficient ETL/ELT workflows, ensuring data quality, security, and scalability to support AI/ML model training, inference, and intelligent decision-making processes in a cloud-native environment.

Key Responsibilities:

  1. Design, develop, and maintain scalable ETL/ELT pipelines to process structured, unstructured, and streaming data in AWS environments using cutting-edge tools and technologies.
  2. Utilize industry-leading AWS services such as S3, Glue, EMR, Lambda, Kinesis, Step Functions, Redshift, Athena, DynamoDB, RDS, and Lake Formation for streamlined data ingestion, transformation, storage, and querying.
  3. Implement robust data governance, security, and quality controls throughout the data lifecycle, supporting regulatory compliance and adhering to industry standards.
  4. Enable both real-time and batch data processing pipelines to power AI-driven workflows and applications with minimal latency.
  5. Collaborate closely with AI/ML teams to prepare clean, high-quality datasets optimized for model training, inference, and fine-tuning, leveraging expert knowledge of data modeling, data warehousing concepts, and schema design principles.
  6. Optimize data infrastructure to achieve high performance, scalability, reliability, and cost efficiency in cloud-native architecture.
  7. Implement CI/CD pipelines and data engineering best practices for automated deployments, continuous integration, and continuous delivery.
  8. Maintain thorough documentation of data pipelines, architecture, and processes to facilitate reproducibility and knowledge transfer among team members.

Required Skills & Qualifications:

  • 3–7 years of hands-on experience in Data Engineering, building cloud-based data solutions, and designing scalable ETL/ELT workflows.
  • Strong programming skills in Python, SQL, and/or Scala/Java, with expertise in big data frameworks like Apache Spark, Hadoop, or Flink.
  • Expertise in AWS cloud services, including S3, Glue, EMR, Redshift, Athena, Kinesis, Lambda, Step Functions, DynamoDB, and RDS.
  • Experience with data pipeline orchestration tools such as Apache Airflow, AWS Step Functions, Dagster, or similar.
  • Proficiency in DevOps practices, including Infrastructure as Code (Terraform, CloudFormation), CI/CD automation, Git, and containerization (Docker).
  • Hands-on experience in managing real-time streaming data using Kafka, Kinesis, or equivalent tools.

Preferred Attributes:

  • Experience working in regulated industries (healthcare, Life Sciences) with a focus on compliance and data privacy.
  • Strong problem-solving skills and ability to work in a collaborative, cross-functional team environment.
  • Passion for designing scalable and efficient cloud-native data solutions, with excellent communication skills and attention to detail.

  • Cloud Data Solutions Engineer

    1 day ago

    Shimoga, Karnataka, India beBeeData Full time US$ 1,20,000 - US$ 1,70,000

    Cloud Data Architect PositionJob Description:We are seeking a skilled Cloud Data Architect to design, develop, and manage enterprise data solutions. The ideal candidate will have experience in cloud data architecture, data warehousing, big data processing, and data integration.Key Responsibilities:Design end-to-end data solutions aligning with business and...

  • Cloud Migration Data Engineer

    1 week ago

    Shimoga, Karnataka, India beBeeDataEngineer Full time ₹ 12,00,000 - ₹ 15,00,000

    Job OverviewWe are seeking a seasoned Data Engineer to join our team. This individual will be responsible for designing, developing, and implementing complex data pipelines that enable the migration of on-premise data systems to the cloud.The ideal candidate will have a strong background in data engineering, ETL development, and cloud migration projects....

  • Cloud Data Engineer

    1 day ago

    Shimoga, Karnataka, India beBeeData Full time US$ 80,000 - US$ 1,50,000

    Are you a skilled professional with expertise in cloud-based technologies?Azure Data Engineer is a key role that drives business transformation through deep engineering expertise and innovative solutions.Main Responsibilities:Develop mastery over AWS/Azure/SAP technologiesELT - Master the process of extracting, loading, and transforming dataData Modeling -...

  • Lead Data Engineer

    1 day ago

    Shimoga, Karnataka, India beBeeData Full time ₹ 18,32,000 - ₹ 22,48,000

    We're looking for a seasoned Data Expert to lead our team in delivering cutting-edge data solutions.As a Senior Data Engineer, you'll play a key role in designing and developing scalable data pipelines and ETL processes using Databricks. You'll optimize Spark jobs and ensure efficient data processing and storage.Key Responsibilities:Develop and maintain...

  • Senior Cloud Data Engineer

    1 week ago

    Shimoga, Karnataka, India beBeeData Full time ₹ 1,20,00,000 - ₹ 2,00,00,000

    Seeking a seasoned data engineer to join our team.We are an innovative company that specializes in cloud-based data analytics. Our goal is to provide cutting-edge solutions for businesses to make informed decisions and drive growth.As a pivotal member of our engineering team, you will play a crucial role in designing, implementing, and optimizing data...

  • Cloud Data Engineer

    2 days ago

    Shimoga, Karnataka, India beBeeDataEngineer Full time ₹ 20,00,000 - ₹ 25,00,000

    We are seeking a skilled data engineer to support our cloud-based data platform. Key responsibilities include:Maintaining and monitoring Databricks-based data pipelines and Azure services, such as Data Lake and Synapse.Implementing continuous integration and deployment pipelines using Azure DevOps for data engineering workflows.Conducting regular system...

  • Cloud Engineering Team Lead

    1 day ago

    Shimoga, Karnataka, India beBeeEngineering Full time ₹ 90,00,000 - ₹ 1,20,00,000

    Cloud Engineering Leader Job DescriptionWe are seeking a seasoned Senior Cloud Engineering professional to spearhead the design and implementation of our cloud-based platform.Lead the development of robust, scalable cloud modules that align with business objectives and technical standards.Drive the implementation of cloud solutions, collaborating with...

  • Cloud Data Solutions Engineer

    1 week ago

    Shimoga, Karnataka, India beBeeDataEngineering Full time ₹ 20,00,000 - ₹ 25,00,000

    Job Title: Data Engineering LeaderAs a seasoned data engineering leader, you will spearhead the design, development, and maintenance of scalable, secure, and high-performance data solutions on Databricks. Your expertise will be pivotal in delivering actionable insights that drive business growth.Key Responsibilities:Develop and implement efficient data...

  • Cloud Data Engineering Professional

    19 hours ago

    Shimoga, Karnataka, India beBeeCloudDataEngineer Full time ₹ 20,00,000 - ₹ 25,00,000

    Senior Cloud Data EngineerGreetings. We are seeking an experienced Senior Cloud Data Engineer with expertise in GCP to join our team.About the Role:This is a 4-month contract position, working remotely full-time (11 am to 8 pm IST).We require candidates with 4+ years of experience in data engineering and a strong understanding of cloud computing.Key...

  • Cloud Data Engineering Specialist

    4 days ago

    Shimoga, Karnataka, India beBeeDataEngineering Full time ₹ 20,00,000 - ₹ 25,00,000

    Drive business growth by leveraging cloud-based data engineering solutions.About the RoleWe are seeking a skilled Cloud Data Engineering Specialist to join our team. As a key member of our organization, you will be responsible for designing and implementing robust data pipelines that integrate multiple sources and ensure high availability, scalability, and...