Master Cloud Data Pipelines Specialist

Job Description:Lemongrass is a software-enabled services provider, synonymous with SAP on Cloud. We deliver superior, highly automated Managed Services to Enterprise customers across the globe.We are seeking an experienced Data Engineer with a strong background in cloud platforms AWS, Azure, and GCP. The ideal candidate will have extensive experience with cloud-native ETL tools such as AWS DMS, AWS Glue, Kafka, Azure Data Factory, GCP Dataflow, and other ETL tools like Informatica, SAP Data Intelligence, etc.The Data Engineer will be responsible for designing, implementing, and maintaining robust data pipelines and building scalable data lakes. Experience with various data platforms like Redshift, Snowflake, Databricks, Synapse, and others is essential. Familiarity with data extraction from SAP or ERP systems is a plus.Design and develop scalable ETL pipelines using cloud-native tools (AWS DMS, AWS Glue, Kafka, Azure Data Factory, GCP Dataflow, etc.).Architect and implement data lakes and data warehouses on cloud platforms (AWS, Azure, GCP).Develop and optimize data ingestion, transformation, and loading processes using Databricks, Snowflake, Redshift, BigQuery, and Azure Synapse.Implement ETL processes using tools like Informatica, SAP Data Intelligence, and others.Develop and optimize data processing jobs using Spark Scala.Responsibilities: 1. Design and Developmenta. Design, develop, and maintain scalable ETL pipelines using cloud-native tools.b. Architect and implement data lakes and data warehouses on cloud platforms.2. Data Integration and Managementa. Integrate various data sources, including relational databases, APIs, unstructured data, and ERP systems into the data lake.b. Ensure data quality and integrity through rigorous testing and validation.3. Performance Optimizationa. Monitor and optimize the performance of data pipelines and ETL processes.b. Implement best practices for data management, including data governance, security, and compliance.Required Skills and Qualifications:Bachelor's degree in Computer Science, Information Technology, or a related field. Advanced degrees are a plus.7+ years of experience as a Data Engineer or in a similar role.Proven experience with cloud platforms: AWS, Azure, and GCP.Hands-on experience with cloud-native ETL tools such as AWS DMS, AWS Glue, Kafka, Azure Data Factory, GCP Dataflow, etc.Experience with other ETL tools like Informatica, SAP Data Intelligence, etc.Experience in building and managing data lakes and data warehouses.Proficiency with data platforms like Redshift, Snowflake, BigQuery, Databricks, and Azure Synapse.Experience with data extraction from SAP or ERP systems is a plus.Strong experience with Spark and Scala for data processing.Benefits:Remote Working: Work from anywhere, at any time.Flexibility: Choose your work schedule and location.Training: Access to industry-standard training resources.State-of-the-art tech: Work with the latest industry tools and technologies.Collaborative Team: Work with experienced professionals who share knowledge and expertise.Equal Opportunity Employer:Lemongrass Consulting is proud to be an Equal Opportunity and Affirmative Action employer. We do not discriminate on the basis of race, religion, color, national origin, religious creed, gender, sexual orientation, gender identity, gender expression, age, genetic information, status as a protected veteran, status as an individual with a disability, or other applicable legally protected characteristics