Highly Experienced Senior Cloud Data Specialist

Transform Your Career with a Senior Data Engineering Role

Job Description

As a seasoned Senior Data Engineer, you will spearhead large-scale data processing systems on cloud platforms. Your primary responsibilities include:

1. Technology Landscape Assessment

• Conduct in-depth analysis of existing technology landscapes to comprehend current data integration frameworks and assess their alignment with requirements.

• Develop scalable Spark jobs using programming languages like Scala for new project demands.
• Enhance existing Spark jobs to meet ongoing product enhancement needs.

• Design and implement efficient data pipelines for developed/enhanced Spark jobs using cloud services such as AWS Lambda or Apache Airflow.

• Lead database design processes, encompassing logical and physical designs, star schema, snowflake schema, and other database structures.

• Optimize Spark job performance through stress testing and tuning.

• Maintain accurate project documentation while adhering to quality standards and schedules.

Required Skills and Qualifications

To succeed in this role, you must possess:

1. At least 7-9 years of IT experience.
2. 5+ years of experience in cloud-related projects.
3. Associate Level and Professional Level cloud certifications (good to have).
4. In-depth knowledge of cloud services: S3, EC2, EMR, Serverless, Athena, AWS Glue, Lambda, Step Functions.
5. Cloud databases: Aurora, Singlestore, RedShift, Snowflake.
6. Big data technologies: Hadoop, Hive, Spark, YARN.
7. Programming languages: Scala, Python, Shell Scripts, PySpark.
8. Operating Systems: Any flavor of Linux, Windows.
9. Strong SQL skills.
10. Orchestration tools: Apache Airflow.
11. Experience in developing ETL workflows involving complex transformations like SCD, deduplications, aggregations.
12. Thorough understanding of cloud VPC, subnets, security groups, and route tables.
13. Ability to learn and adapt to new cloud services or big data technologies.

Benefits

We offer a dynamic work environment that values innovation, teamwork, and customer satisfaction. As a member of our team, you can expect:

• Competitive salary.
• Opportunities for growth and professional development.
• Collaborative and dynamic work environment.
• Recognition and rewards for outstanding performance.

How to Apply

If you are a motivated and experienced data engineer seeking a new challenge, please submit your application along with your resume and cover letter.

Key Responsibilities

Manage the build phase and ensure quality-assured code meets requirements and adheres to cloud architecture principles. Resolve complex design and development issues.

Requirements

7-9 years of IT experience.

5+ years of cloud-related project experience.

Good to have Associate Level and Professional Level cloud certification.

Knowledge of cloud services: S3, EC2, EMR, Serverless, Athena, AWS Glue, Lambda, Step Functions.

Cloud databases: Aurora, Singlestore, RedShift, Snowflake.

Big data technologies: Hadoop, Hive, Spark, YARN.

Programming languages: Scala, Python, Shell Scripts, PySpark.

Operating Systems: Any flavor of Linux, Windows.

Strong SQL skills.

Orchestration tools: Apache Airflow.

Experience in developing ETL workflows involving complex transformations like SCD, deduplications, aggregations.

Conceptual understanding of cloud VPC, subnets, security groups, and route tables.

Ability to learn and adapt to new cloud services or big data technologies.

Our Company Culture

At [Company Name], we foster a collaborative environment where employees can grow and thrive. Our company culture emphasizes innovation, teamwork, and customer satisfaction.

What We Offer

As a valued member of our team, you will receive:

• Competitive salary.
• Opportunities for growth and professional development.
• Collaborative and dynamic work environment.
• Recognition and rewards for outstanding performance.