Senior Data Engineering Professional

Job DescriptionWe are seeking a skilled Data Engineer to join our team.About the RoleThe ideal candidate will have hands-on experience with designing and developing data systems, including pipelines, APIs, analytics, AI, and machine learning at scale. They will be responsible for building and maintaining production-grade pipelines and platform components that power business and product outcomes.Primary ResponsibilitiesDesign and Develop Data Systems: The Data Engineer will design and develop scalable and maintainable data systems, including pipelines, APIs, and data platforms services.Collaborate with Cross-Functional Teams: The Data Engineer will collaborate with senior engineers, analysts, and product stakeholders to translate technical requirements into working solutions.Develop and Support APIs: The Data Engineer will develop and support APIs, batch and real-time data flows, ensuring reliability and performance in 24x7 environments.Participate in End-to-End Software Development Lifecycle: The Data Engineer will participate in the end-to-end software development lifecycle, including planning, testing, deployment, and operations.Take Ownership of Features and Components: The Data Engineer will take ownership of features and components, and see them through from design to deployment.Document Technical Decisions: The Data Engineer will document technical decisions, workflows, and runbooks to support long-term maintainability and clarity for peers.Practice Responsible Data Governance: The Data Engineer will practice responsible data governance, ensuring data quality, privacy, and lineage are considered in all development.Continuously Learn and Grow: The Data Engineer will continuously learn and grow through code reviews, pairing, and technical mentorship.RequirementsTo succeed in this role, you will need:Experience and Technical Skills2-4 years of development experience: You will have hands-on experience with production systems in cloud environments.Proficient in Python and/or Golang: You will be proficient in Python and/or Golang, and SQL for data processing, transformation, and orchestration tasks.Cloud Platform Experience: You will have experience with at least one modern cloud platform (e.g., GCP, AWS, or Azure).API Development Experience: You will have experience developing REST or GraphQL APIs and internal data access layers.ETL/ELT Pipeline Experience: You will have experience building and maintaining ETL/ELT pipelines or API-driven data services.Source Control Experience: You will have experience with source control (e.g., Git), automated testing, and CI/CD practices.Orchestration Tooling Experience: You will have exposure to orchestration tooling such as n8n, Cloud scheduler, Airflow, Step Functions, or similar.Data Modeling Concepts: You will have an understanding of data modeling concepts and cloud warehousing (e.g., Databricks, BigQuery, Snowflake or other).Event-Based Systems: You will have familiarity with Kafka, Pub/Sub, or other event-based systems.Data Quality and Observability: You will have awareness of data quality, observability, and governance principles in engineering contexts.Strong Communication Skills: You will have strong written and verbal communication skills, with an ability to share context with both technical peers and cross-functional partners.Containerized Environments: You will have experience working with containerized environments (e.g., Docker, Kubernetes).Infrastructure-as-Code: You will have exposure to infrastructure-as-code, especially for deploying and managing data workflows.BI Tools: You will have hands-on use of BI tools like Looker or Tableau.Mentorship: You will have a growth mindset and interest in mentoring junior peers or learning from senior engineers.Highly Favorable SkillsIn addition to the required skills, the following skills are highly favorable:Strong Communication Skills: You will have strong written and verbal communication skills, with an ability to clearly explain technical concepts to peers, analysts, and product partners.Initiative and Problem-Solving: You will have demonstrated initiative in solving ambiguous technical problems or improving systems without being prompted.Client-Facing Experience: You will have exposure to client-facing or cross-functional environments, such as working directly with product managers, analysts, or external partners.Critical System Deployment: You will have hands-on experience deploying or operating critical systems, services, or pipelines with high availability requirements.Agile Development Experience: You will have participation in agile or iterative development teams, including experience with sprint planning, retrospectives, or technical scoping.Documentation and Knowledge Sharing: You will have contributions to documentation, internal knowledge bases, or open-source projects.Mentorship and Growth: You will have interest in mentoring interns or junior engineers, or actively seeking mentorship to accelerate your own growth.