Senior Data Engineer

Education
At Meazure Learning
, we aim to empower open-minded, inquisitive, and driven people, and we love how each new addition to the team adds to our culture. Here, you can positively impact the careers of millions of test-takers and reshape the education technology landscape by working toward one vision:

"To provide life-long learners across the globe the freedom to pursue their academic dreams and career aspirations safely, securely, and conveniently."

Our Vision starts with our values—
Hungry, Humble, and Smart.
We are looking for team members who model drive for results, think of the organization and team first without ego or agenda, and lead with emotional intelligence. This is the foundation of success for all employees at Meazure Learning.

The Role
The
Sr. Data Engineer I
will be responsible for designing, building, and maintaining scalable data pipelines and systems to support the organization's data-driven initiatives. This role will work closely with data scientists, analysts, and other stakeholders to ensure data is easily accessible, clean, and reliable for analysis and reporting. The Sr. Data Engineer I will help drive improvements in data architecture and performance, ensuring that data can be leveraged for actionable insights to drive the business forward.

The Responsibilities
Data Pipeline Development:

• Design, build, and maintain scalable and reliable data pipelines to process and transform large volumes of data from various sources. Should have experience using tools such as Azure Data Factory, AWS Glue, or Apache Airflow.
• Work with cross-functional teams to understand data requirements and ensure that data is collected, processed, and stored in an optimal way for analytics and reporting.
• Implement and optimize ETL / ELT processes to ensure efficient and accurate data delivery to stakeholders using Python, SQL, and PySpark, integrating data from APIs, SaaS systems, and on-premises sources.
• Implement data quality validation frameworks and automated monitoring for data accuracy and timeliness.

Data Modeling & Architecture

• Design and implement data models that support business intelligence and analytics needs, ensuring data is structured efficiently and meets reporting and analytical requirements. Should have practical exposure to Snowflake, Azure Synapse, or Redshift.
• Develop and manage data warehouses and data lakes using Azure Data Lake Storage (ADLS), S3, or Delta Lake, ensuring performance, scalability, and cost optimization.
• Implement data partitioning, clustering, and indexing strategies to enhance query performance.
• Collaborate with data architects to define and evolve the enterprise data architecture and adopt Data Mesh or Lakehouse principles where applicable

Collaboration & Cross-Functional Support

• Work closely with data scientists, data analysts, and other teams to understand data needs and ensure data is available for analysis and reporting.
• Work closely with BI teams to ensure seamless data flow and integration with visualization tools such as Power BI, Tableau, or Looker.
• Collaborate with DevOps and platform teams to ensure CI/CD integration and infrastructure-as-code (IaC) deployment using Terraform or CloudFormation.
• Provide technical expertise to other departments by developing data solutions that support key business objectives.
• Troubleshoot and resolve data-related issues, ensuring the reliability and accuracy of the data.

Continuous Improvement & Optimization

• Optimize data workflows for performance, scalability, and cost efficiency, leveraging Spark optimization, Snowflake query tuning, and auto-scaling techniques.
• Expertise in Snowflake architecture, including virtual warehouses, time travel, and query optimization.
• Continuously monitor and improve data pipeline performance, addressing any bottlenecks or inefficiencies.
• Stay current with emerging trends in data engineering, cloud-native architecture, and AI-driven data management

Documentation & Best Practices

• Create and maintain thorough documentation of data pipeline workflows, data models, and architectural decisions.
• Promote data engineering best practices and contribute to establishing standards for data quality, security, and governance.
• Promote CI/CD, version control (Git), and Agile methodologies in data engineering workflows.

The Desired Attributes

• Advanced Data Engineering Skills: Strong experience with Azure (ADF, Synapse, ADLS, Databricks) and/or AWS (Glue, Redshift, S3, Lambda) cloud ecosystems. Proficiency in Python, SQL, and PySpark, with experience building modular, reusable data frameworks.
• ETL / ELT Experience: Solid understanding and experience building, maintaining, and optimizing ETL / ELT pipelines, including handling complex data transformations.
• BI & Analytics Integration: Hands-on experience with Power BI, including DAX, data modeling, and performance tuning. Familiarity with data cataloging and lineage tools.
• Data Architecture Expertise: Knowledge of data modeling, database design, and big data technologies, with the ability to design scalable data infrastructure.
• Problem-Solving and Analytical Thinking: Strong ability to diagnose and solve technical issues and optimize data processing workflows.
• Collaboration Skills: Ability to work well within cross-functional teams and with business stakeholders to understand their data needs. Ability to communicate complex technical concepts clearly and effectively to non-technical stakeholders.
• Attention to Detail: Strong focus on data quality and accuracy to ensure that data is reliable and suitable for analytics.
• Experience: At least 5-8 years of experience as a data engineer or in a related role, with a proven track record of building and maintaining data systems.
• Educational Background: A degree in Computer Science, Engineering, Data Science, or a related field, or equivalent professional experience.

The Benefits

• Company-Sponsored Health Insurance
• Competitive Pay
• Remote work
• Healthy Work Culture
• Career Growth Opportunities
• Learning and Development Programs
• Referral Award Program
• Company-Provided IT Equipment (for remote team members)
• Transportation Program (for on-site team members)
• Company-Provided Meals (for on-site team members)
• 14 Company-Provided Holidays
• Generous Leave Program

Learn more at

Meazure Learning is an Equal Opportunity Employer and Prohibits Discrimination and Harassment of Any Kind: Meazure Learning is committed to the principle of equal employment opportunity for all employees and to providing employees with a work environment free of discrimination and harassment. All employment decisions at Meazure Learning are based on business needs, job requirements, and individual qualifications, without regard to race, color, religion or belief, national, social or ethnic origin, sex (including pregnancy), age, physical, mental or sensory disability, HIV Status, sexual orientation, gender identity and/or expression, marital, civil union or domestic partnership status, past or present military service, family medical history or genetic information, family or parental status, or any other status protected by the laws or regulations in the locations where we operate. Meazure Learning will not tolerate discrimination or harassment based on any of these characteristics.

Monday through Friday

2:00 PM - 11:00 PM IST