Cloud Data Engineer- Senior

About Lemongrass Lemongrass is a software-enabled services provider, synonymous with SAP on Cloud, focused on delivering superior, highly automated Managed Services to Enterprise customers. Our customers span multiple verticals and geographies across the Americas, EMEA and APAC. We partner with AWS, SAP, Microsoft and other global technology leaders.

We are seeking an experienced Cloud Data Engineer with a strong background in AWS, Azure, and GCP. The ideal candidate will have extensive experience with cloud-native ETL tools such as AWS DMS, AWS Glue, Kafka, Azure Data Factory, GCP Dataflow, and other ETL tools like Informatica, SAP Data Intelligence, etc. You will be responsible for designing, implementing, and maintaining robust data pipelines and building scalable data lakes. Experience with various data platforms like Redshift, Snowflake, Databricks, Synapse, Snowflake and others is essential. Familiarity with data extraction from SAP or ERP systems is a plus.

Design, develop, and maintain scalable ETL pipelines using cloud-native tools (AWS DMS, AWS Glue, Kafka, Azure Data Factory, GCP Dataflow, etc.).

Architect and implement data lakes and data warehouses on cloud platforms (AWS, Azure, GCP).

Develop and optimize data ingestion, transformation, and loading processes using Databricks, Snowflake, Redshift, BigQuery and Azure Synapse.

Implement ETL processes using tools like Informatica, SAP Data Intelligence, and others.

Develop and optimize data processing jobs using Spark Scala.

Data Integration and Management:

Integrate various data sources, including relational databases, APIs, unstructured data, and ERP systems into the data lake.

Ensure data quality and integrity through rigorous testing and validation.

Perform data extraction from SAP or ERP systems when necessary.

Performance Optimization:

Monitor and optimize the performance of data pipelines and ETL processes.

Implement best practices for data management, including data governance, security, and compliance.

Work closely with data scientists, analysts, and other stakeholders to understand data requirements and deliver solutions.

Collaborate with cross-functional teams to design and implement data solutions that meet business needs.

Maintain and troubleshoot existing ETL pipelines and data integrations.

Bachelor's degree in Computer Science, Information Technology, or a related field. Experience:

~7+ years of experience as a Data Engineer or in a similar role.

~ Proven experience with cloud platforms: AWS, Azure, and GCP.

~ Hands-on experience with cloud-native ETL tools such as AWS DMS, AWS Glue, Kafka, Azure Data Factory, GCP Dataflow, etc.

~ Experience with other ETL tools like Informatica, SAP Data Intelligence, etc.

~ Experience in building and managing data lakes and data warehouses.

~ Proficiency with data platforms like Redshift, Snowflake, BigQuery, Databricks, and Azure Synapse.

~ Experience with data extraction from SAP or ERP systems is a plus.

~ Strong experience with Spark and Scala for data processing.

Strong programming skills in Python, Java, or Scala.

Proficient in SQL and query optimization techniques.

Familiarity with data modeling, ETL/ELT processes, and data warehousing concepts.

Knowledge of data governance, security, and compliance best practices.

Experience with other data tools and technologies such as Apache Spark, or Hadoop.

Certifications in cloud platforms (AWS Certified Data Analytics – Specialty, Google Professional Data Engineer, Microsoft Certified: Azure Data Engineer Associate).

Experience with CI/CD pipelines and DevOps practices for data engineering

Remote Working: Lemongrass always has been and always will offer 100% remote work

Training: A subscription to A Cloud Guru and generous budget for taking certifications and other resources you'll find helpful

We do not discriminate on the basis of race, religion, color, national origin, religious creed, gender, sexual orientation, gender identity, gender expression, age, genetic information, status as a protected veteran, status as an individual with a disability, or other applicable legally protected characteristics

---