Cloud Data Pipeline Architect

Cloud Data Engineer PositionAbout Lemongrass is a software-enabled services provider, synonymous with SAP on Cloud, focused on delivering superior, highly automated Managed Services to Enterprise customers. Our customers span multiple verticals and geographies across the Americas, EMEA and APAC. We partner with AWS, SAP, Microsoft and other global technology leaders.We are seeking an experienced Cloud Data Engineer with a strong background in cloud platforms such as AWS, Azure, and GCP. The ideal candidate will have extensive experience with cloud-native data processing tools like AWS DMS, AWS Glue, Kafka, Azure Data Factory, GCP Dataflow, etc. You will be responsible for designing, implementing, and maintaining robust data pipelines and building scalable data lakes. Experience with various data platforms like Redshift, Snowflake, Databricks, Synapse, Snowflake and others is essential. Familiarity with data extraction from SAP or ERP systems is a plus.Key Responsibilities:Data Engineering:Design and develop scalable data pipelines using cloud-native data processing tools (AWS DMS, AWS Glue, Kafka, Azure Data Factory, GCP Dataflow, etc.).Architect and implement data lakes and data warehouses on cloud platforms (AWS, Azure, GCP).Develop and optimize data ingestion, transformation, and loading processes using Databricks, Snowflake, Redshift, BigQuery and Azure Synapse.Implement data processing jobs using Spark Scala.Data Integration and Management:Integrate various data sources, including relational databases, APIs, unstructured data, and ERP systems into the data lake.Ensure data quality and integrity through rigorous testing and validation.Perform data extraction from SAP or ERP systems when necessary.Performance Optimization:Monitor and optimize the performance of data pipelines and data processing jobs.Implement best practices for data management, including data governance, security, and compliance.Collaboration and Communication:Work closely with data scientists, analysts, and other stakeholders to understand data requirements and deliver solutions.Collaborate with cross-functional teams to design and implement data solutions that meet business needs.Documentation and Maintenance:Document technical solutions, processes, and workflows.Maintain and troubleshoot existing data pipelines and data integrations.QualificationsBachelor's Degree: Computer Science, Information Technology, or a related field. Advanced degrees are a plus.Experience: 7+ years of experience as a Data Engineer or in a similar role.Cloud Platforms: Proven experience with cloud platforms: AWS, Azure, and GCP.Data Processing Tools: Hands-on experience with cloud-native data processing tools such as AWS DMS, AWS Glue, Kafka, Azure Data Factory, GCP Dataflow, etc.Data Platforms: Proficiency with data platforms like Redshift, Snowflake, BigQuery, Databricks, and Azure Synapse.Skills:Strong programming skills in Python, Java, or Scala.Familiarity with SQL and query optimization techniques.Knowledge of data modeling, data warehousing concepts, and data governance.Excellent problem-solving and analytical skills.Strong communication and collaboration skills.Preferred Qualifications:Experience with other data tools and technologies such as Apache Spark, or Hadoop.Certifications in cloud platforms (AWS Certified Data Analytics – Specialty, Google Professional Data Engineer, Microsoft Certified: Azure Data Engineer Associate).Experience with CI/CD pipelines and DevOps practices for data engineeringWhat we Offer:Remote Working: Work from anywhere, anytime.Flexibility: Flexible working hours.Training: Subscription to A Cloud Guru and generous budget for certifications and resources.State-of-the-art Tech: Opportunity to learn and work with latest industry standard tools.Team: Collaborative team with opportunities to learn and grow.EQUAL OPPORTUNITY EMPLOYER: We are proud to be an equal opportunity employer. We do not discriminate based on race, religion, color, national origin, gender, sexual orientation, age, disability, or other protected characteristics.