Data Engineer II

About the Role

We are seeking a highly skilled and experienced Software Engineer II - Data, to join our SAles Automation Engineering team. As a key member of our team, you will be responsible for driving the design, development, and governance of data solutions to address complex business and technical challenges. Your expertise in software engineering, data systems, and data governance will play a critical role in building scalable and efficient data platforms and tools while ensuring data integrity and compliance. This is a unique opportunity to make a significant impact on our organization, contribute to the success of our team, and champion data governance practices.

What the Candidate Will Need / Bonus Points
- What the Candidate Will Do -

• Solution Development: Collaborate with stakeholders to understand business needs and translate them into scalable and reliable data systems and tools, while ensuring data quality, privacy, and compliance.
• Data Governance: Champion and enforce data governance practices, including data lineage, metadata management, data quality controls, and privacy regulations.
• Data Architecture: Design and develop large-scale data systems, including databases, data warehouses, and big data platforms, with a strong focus on data governance and compliance requirements.
• Software Engineering Skills: Excellent programming skills, with expertise in building robust and scalable software solutions using modern software engineering practices in alignment with data governance guidelines.
• Data Integration: Collect and integrate data from various sources to create a unified and accurate source of truth for financial and compliance domains, while adhering to data governance policies.
• Performance Optimization: Optimize data processing and query performance using technologies such as HDFS, Hive, Presto, and Spark, while ensuring adherence to data governance SLAs.
• Automation and Efficiency: Drive automation initiatives by developing scripts, utilities, and frameworks to streamline data processes, improve efficiency, and enforce data governance practices.
• Collaboration and Mentoring: Collaborate with cross-functional teams, mentor junior engineers, and foster a culture of data governance and compliance awareness within the team.
• Innovation and Continuous Improvement: Stay updated with the latest industry trends and technologies in data engineering and data governance, evaluate new tools and techniques, and propose innovative solutions to enhance data systems, processes, and governance practices.
• Documentation and Knowledge Sharing: Maintain comprehensive documentation of data solutions, processes, best practices, and data governance frameworks, and actively share knowledge with the team.
• Problem-Solving Abilities: Analytical mindset with the ability to understand complex business or technical problems and propose effective data solutions, considering data governance and compliance aspects.

• Communication Skills: Strong verbal and written communication skills to effectively convey complex technical concepts

• Basic Qualifications -

• Education: Bachelor's or master's degree in Computer Science, Engineering, or a related field.

• Experience: 4+ years of experience as a software engineer, with a strong focus on data engineering and large-scale data systems.
• Technical Expertise: Proficiency in technologies such as HDFS, Hive, Presto, Spark, and Python. Experience with additional data technologies and tools is a plus.
• Data Governance: Strong understanding of data governance principles, regulations, and industry best practices, with practical experience in implementing and enforcing data governance frameworks.

• Data Architecture: Solid understanding of data architecture principles and proven experience in designing and developing scalable data systems, while considering data governance requirements.

• Preferred Qualifications -

• Good hands-on experience with object-oriented programming languages like Python.

• Proven experience in large-scale distributed storage and database systems (SQL or NoSQL, e.g. HIVE, MySQL, Cassandra) and data warehousing architecture and data modeling.
• Working experience in cloud technologies like GCP, AWS, Azure
• Knowledge of reporting tools like Tableau and/or other BI tools.