Data Engineer II

About Zeta
Zeta is a
Next-Gen Banking Tech
company that empowers banks and fintechs to launch banking products for the future. It was founded by Bhavin Turakhia and Ramki Gaddipati in 2015.

Our flagship processing platform - Zeta Tachyon - is the industry's first modern, cloud-native, and fully API-enabled stack that brings together issuance, processing, lending, core banking, fraud & risk, and many more capabilities as a single-vendor stack. 20M+ cards have been issued on our platform globally.

Zeta is actively working with the largest Banks and Fintechs in multiple global markets transforming customer experience for multi-million card portfolios.

Zeta has over
1700+
employees - with over
70%
roles in R&D - across locations in the
US
,
EMEA
, and
Asia
. We raised
$280 million
at a
$1.5 billion
valuation from Softbank, Mastercard, and other investors in 2021.

Learn more @

,

,
Linkedin
,
Twitter
About The Role
As a Data Engineer II, you will play a crucial role in developing, optimizing, and managing several large data lakes and data warehouses, comprising data from multiple disparate sources.

Responsibilities

• Data Pipeline Operations
• Design, build, and maintain robust and scalable data pipelines to ingest, transform, and deliver structured and unstructured data from multiple sources.
• Ensure high-quality data by implementing monitoring, validation, and error-handling processes.
• Platform Engineering & Optimization
• Create and update data models to represent the structure of the data.
• Design, implement, and maintain database systems. Optimize database performance and ensure data integrity. Troubleshoot and resolve database issues.
• Build and manage data warehouses for storage and analysis of large datasets.
• Collaborate on data modeling, schema design, and performance optimization for large-scale datasets.
• Data Quality and Governance: Implement and enforce data quality standards. Contribute to data governance processes and policies.
• Scripting and Programming: Develop and automate data processes through programming languages (e.g., Python, Java, SQL). Implement data validation scripts and error handling mechanisms.
• Version Control: Use version control systems (e.g., Git) to manage codebase changes for data pipelines.
• Monitoring and Optimization: Implement monitoring solutions to track the performance and health of data systems. Optimize data processes for efficiency and scalability.
• Cloud Platforms: Work with cloud platforms (e.g., AWS, Azure, GCP) to deploy and manage data infrastructure. Utilize cloud-based services for data storage, processing, and analytics.
• Security: Implement and adhere to data security best practices. Ensure compliance with data protection regulations.
• Troubleshooting and Support: Provide support for data-related issues and participate in root cause analysis.

Skills

• Expertise in data modeling, database design, and data warehousing. Proficient in SQL and programming languages such as Python, Java, or Scala.
• Experience with big data technologies such as Hadoop, Spark, and Kafka.
• Cloud-native architecture expertise (AWS, GCP, or Azure), including containerization (Docker, Kubernetes) and infrastructure-as-code (Terraform, CloudFormation).

Experience And Qualification

• Bachelor's/master's degree in engineering (computer science, information systems) with 3-5 years of experience in data engineering, BI engineering, and data warehouse development.
• Excellent command on SQL and one or more programming languages, preferably Python or Java.
• Knowledge of Flink, Airflow, Apache Spark, DBT, Athena / Presto
• Experience working with Kubernetes.

Equal Opportunity
Zeta is an equal opportunity employer. We celebrate diversity and are committed to creating an inclusive environment for all employees. We encourage applicants from all backgrounds, cultures, and communities to apply and believe that a diverse workforce is key to our success