Cloud Data Engineer

13 hours ago


india, IN Lemongrass Full time

About Lemongrass

Lemongrass is a software-enabled services provider, synonymous with SAP on Cloud, focused on delivering superior, highly automated Managed Services to Enterprise customers. Our customers span multiple verticals and geographies across the Americas, EMEA and APAC. We partner with AWS, SAP, Microsoft and other global technology leaders.


We are seeking an experienced Cloud Data Engineer with a strong background in AWS, Azure, and GCP. The ideal candidate will have extensive experience with cloud-native ETL tools such as AWS DMS, AWS Glue, Kafka, Azure Data Factory, GCP Dataflow, and other ETL tools like Informatica, SAP Data Intelligence, etc. You will be responsible for designing, implementing, and maintaining robust data pipelines and building scalable data lakes. Experience with various data platforms like Redshift, Snowflake, Databricks, Synapse, Snowflake and others is essential. Familiarity with data extraction from SAP or ERP systems is a plus.


Key Responsibilities:

Design and Development:

  • Design, develop, and maintain scalable ETL pipelines using cloud-native tools (AWS DMS, AWS Glue, Kafka, Azure Data Factory, GCP Dataflow, etc.).
  • Architect and implement data lakes and data warehouses on cloud platforms (AWS, Azure, GCP).
  • Develop and optimize data ingestion, transformation, and loading processes using Databricks, Snowflake, Redshift, BigQuery and Azure Synapse.
  • Implement ETL processes using tools like Informatica, SAP Data Intelligence, and others.
  • Develop and optimize data processing jobs using Spark Scala.


Data Integration and Management:

  • Integrate various data sources, including relational databases, APIs, unstructured data, and ERP systems into the data lake.
  • Ensure data quality and integrity through rigorous testing and validation.
  • Perform data extraction from SAP or ERP systems when necessary.


Performance Optimization:

  • Monitor and optimize the performance of data pipelines and ETL processes.
  • Implement best practices for data management, including data governance, security, and compliance.


Collaboration and Communication:

  • Work closely with data scientists, analysts, and other stakeholders to understand data requirements and deliver solutions.
  • Collaborate with cross-functional teams to design and implement data solutions that meet business needs.


Documentation and Maintenance:

  • Document technical solutions, processes, and workflows.
  • Maintain and troubleshoot existing ETL pipelines and data integrations.


Qualifications


Education:

  • Bachelor’s degree in Computer Science, Information Technology, or a related field. Advanced degrees are a plus.


Experience:

  • 7+ years of experience as a Data Engineer or in a similar role.
  • Proven experience with cloud platforms: AWS, Azure, and GCP.
  • Hands-on experience with cloud-native ETL tools such as AWS DMS, AWS Glue, Kafka, Azure Data Factory, GCP Dataflow, etc.
  • Experience with other ETL tools like Informatica, SAP Data Intelligence, etc.
  • Experience in building and managing data lakes and data warehouses.
  • Proficiency with data platforms like Redshift, Snowflake, BigQuery, Databricks, and Azure Synapse.
  • Experience with data extraction from SAP or ERP systems is a plus.
  • Strong experience with Spark and Scala for data processing.

Skills:

  • Strong programming skills in Python, Java, or Scala.
  • Proficient in SQL and query optimization techniques.
  • Familiarity with data modeling, ETL/ELT processes, and data warehousing concepts.
  • Knowledge of data governance, security, and compliance best practices.
  • Excellent problem-solving and analytical skills.
  • Strong communication and collaboration skills.


Preferred Qualifications:

  • Experience with other data tools and technologies such as Apache Spark, or Hadoop.
  • Certifications in cloud platforms (AWS Certified Data Analytics – Specialty, Google Professional Data Engineer, Microsoft Certified: Azure Data Engineer Associate).
  • Experience with CI/CD pipelines and DevOps practices for data engineering
  • Selected applicant will be subject to a background investigation, which will be conducted and the results of which will be used in compliance with applicable law.


What we offer in return:

  • Remote Working: Lemongrass always has been and always will offer 100% remote work
  • Flexibility: Work where and when you like most of the time
  • Training: A subscription to A Cloud Guru and generous budget for taking certifications and other resources you’ll find helpful
  • State of the art tech: An opportunity to learn and run the latest industry standard tools
  • Team: Colleagues who will challenge you giving the chance to learn from them and them from you


Lemongrass Consulting is proud to be an Equal Opportunity and Affirmative Action employer. We do not discriminate on the basis of race, religion, color, national origin, religious creed, gender, sexual orientation, gender identity, gender expression, age, genetic information, status as a protected veteran, status as an individual with a disability, or other applicable legally protected characteristics


  • Data Engineer

    13 hours ago


    india, IN Data-Hat AI Full time

    Department: Data Engineering & AI Solutions Reports To: Lead Data Solutions Architect Travel: International travel required (up to 30–40%) Position Summary: We are hiring a senior-level Data Engineer to lead the design, development, and optimization of high-performance data infrastructure that underpins mission-critical AI systems. With 12+ years of...

  • Cloud Engineer

    13 hours ago


    india, IN EXL Full time

    We're looking for a highly skilled and experienced Cloud AI Engineer to join our dynamic team. In this role, you'll be instrumental in designing, developing, and deploying cutting-edge artificial intelligence and machine learning solutions leveraging the full suite of Google Cloud Platform (GCP) services.Objectives of this roleLead the end-to-end development...

  • Cloud Data Delivery

    13 hours ago


    india, IN Pacific Data Integrators Full time

    Core Technical & Domain SkillsExtensive hands-on experience with cloud modernization of ETL pipelines Strong data debugging skills and deep understanding of enterprise analytics stack Proven track record with at least one hyperscaler analytic environment with either (Databricks, Snowflake, etc.).Informatica (IDMC/CDGC) preferred; must be strong on IDMC or...

  • Data Engineer

    14 hours ago


    india, IN Bahwan CyberTek Full time

    Job Title: Data Engineer – Google Cloud Platform (GCP) Job Summary We are seeking a skilled and motivated Data Engineer with hands-on experience in building scalable data pipelines and cloud-native data solutions on Google Cloud Platform. The ideal candidate will be proficient in GCP services like Pub/Sub, Dataflow, Cloud Storage, and BigQuery, with a...


  • india, IN Rialtes Full time

    Job Description: Salesforce Data Cloud LeadLocation: Remote (India)Job Type: Freelance / Contract - 6 monthsAbout the RoleWe are looking for an experienced Salesforce Data Cloud Lead with 10+ years of hands-on Salesforce expertise to spearhead our Data Cloud initiatives. This role requires deep knowledge of Salesforce Data Cloud (formerly Customer Data...

  • Cloud Engineer

    14 hours ago


    india, IN Strobes Security, Inc. Full time

    We are looking for a Mid-level Cloud Engineer with hands-on expertise in designing, automating, and operating production-grade cloud infrastructure. This role requires a strong background in AWS services, DevOps/DevSecOps practices, Infrastructure as Code, monitoring, and container orchestration. The engineer will be responsible for building resilient,...

  • Cloud Engineer

    14 hours ago


    india, IN DBiz.ai Full time

    We are seeking a dynamic and skilled AWS Cloud & DevOps Engineer to design, implement, and maintain scalable, secure, and automated cloud environments on Amazon Web Services. The ideal candidate will combine infrastructure engineering expertise with DevOps practices to support application deployment, performance, and availability.Key ResponsibilitiesAWS...

  • Lead Data Engineer

    13 hours ago


    , India, IN Searce Inc Full time

    Who we are?Searce means ‘a fine sieve’ & indicates ‘to refine, to analyze, to improve’. It signifies our way of working: To improve to the finest degree of excellence, ‘solving for better’ every time. Searcians are passionate improvers & solvers who love to question the status quo.The primary purpose of all of us, at Searce, is driving...

  • Data Engineer

    13 hours ago


    india, IN Canopus Infosystems - A CMMI Level 3 Company Full time

    Position: Data EngineerExperience: 2+ YearsLocation: RemoteJoining: Immediate Joiners PreferredAbout the Role:We are looking for a skilled Data Engineer with strong Python expertise and hands-on experience in handling large datasets, data cleaning, analysis, and visualization. The ideal candidate should be capable of building data pipelines, performing web...

  • Data Engineer

    13 hours ago


    india, IN Vriba Solutions Full time

    Role: Data Engineering Remote Looking for 5-10 years of Exp• Design, develop & maintain ETL/ELT pipelines• Ingest & transform data from APIs, DBs, files, streams• Build real-time & batch processing solutions• Data validation, quality & cleansing• Translate business needs into data models• Ensure data security, access control & compliance•...