Senior Data Engineer
4 days ago
We are seeking a skilled and proactive Senior Engineer with strong Snowflake expertise and AWS cloud exposure to lead the implementation and operational excellence of a scalable, multitenant modern data platform for a leading US-based marketing agency serving nonprofit clients. This role requires hands-on experience in managing Snowflake environments, supporting data pipeline orchestration, enforcing platform-level standards, and ensuring observability, performance, and security across environments. You will collaborate with architects, engineers, and DevOps teams to operationalize the platform's design and drive its long-term stability and scalability in a cloud-native ecosystem.Key Responsibilities.Design and manage schema isolation, role-based access control (RBAC), masking policies, and cost-optimized Snowflake architecture for multiple nonprofit tenants.Implement and maintain CI/CD pipelines for dbt, Snowflake objects, and metadata-driven ingestion processes using GitHub Actions or similar tools.Develop and maintain automation accelerators for data ingestion, schema validation, error handling, and onboarding new clients at scale.Collaborate with architects and data engineers to ensure seamless integration with source CRMs, ByteSpree connectors, and downstream BI/reporting layers.Monitor and optimize performance of Snowflake workloads (e.g., query tuning, warehouse sizing, caching strategy) to ensure reliability and scalability.Establish and maintain observability and monitoring practices across data pipelines, ingestion jobs, and platform components (e.g., error tracking, data freshness, job status dashboards).Manage infrastructure-as-code (IaC), configuration templates, and version control practices across the data stack.Ensure robust data validation, quality checks, and observability mechanisms are in place across all platform services.Support incident response, pipeline failures, and technical escalations in production, coordinating across engineering and client teams.Contribute to data governance compliance by implementing platform-level policies for PII, lineage tracking, and tenant-specific metadata tagging.QualificationsBachelor's or Master's degree in Computer Science, Data Engineering, or a related technical field6+ years of experience in data engineering or platform delivery, including 3+ years of hands-on Snowflake experience in production environmentsProven expertise in building and managing multitenant data platforms, including schema isolation, RBAC, and masking policiesSolid knowledge of CI/CD practices for data projects, with experience guiding pipeline implementations using tools like GitHub ActionsHands-on experience with dbt, SQL, and metadata-driven pipeline design for large-scale ingestion and transformation workloadsStrong understanding of AWS cloud services relevant to data platforms (e.g., S3, IAM, Lambda, CloudWatch, Secrets Manager)Experience optimizing Snowflake performance, including warehouse sizing, caching, and cost control strategiesFamiliarity with setting up observability frameworks, monitoring tools, and data quality checks across complex pipeline ecosystemsProficient in infrastructure-as-code (IaC) concepts and managing configuration/versioning across environmentsAwareness of data governance principles, including lineage, PII handling, and tenant-specific metadata tagging
-
Senior Data Engineer
1 week ago
kolkata, India beBeeDataEngineer Full timeUnlock Data PotentialAs a seasoned Senior Data Engineer, you will design and develop robust data pipelines in Python for ingesting and processing large-scale text datasets. Your primary mission is to transform massive datasets into high-quality formats.Data Engineering: Design, build, and own automated data pipelines in Python for processing terabyte-scale...
-
Senior Data Engineer
2 weeks ago
Kolkata, India UST Full timeSenior Data EngineersExperience - 6 +Yrs (5-7 relevant years) Location: TrivandrumMandatory Skill - Pyspark, SQL, Azure DatabricksUK Shift TimingJob Description Key Accountabilities / Responsibilities:Provide technical direction and leadership to data engineers on data platform initiatives - ensuring adherence to best practices in data modelling, End to End...
-
Senior Data Engineer
2 weeks ago
Kolkata, India UST Full timeSenior Data EngineersExperience - 6 +Yrs (5-7 relevant years) Location: TrivandrumMandatory Skill - Pyspark, SQL, Azure DatabricksUK Shift TimingJob Description Key Accountabilities / Responsibilities:Provide technical direction and leadership to data engineers on data platform initiatives - ensuring adherence to best practices in data modelling, End to End...
-
Senior Data Engineer
3 weeks ago
Kolkata, India Tata Consultancy Services Full timeGreetings from TCS! Job Title: Senior Data Engineer Required Skillset: Python, Spark, Databricks, AWS (S3, Glue, AirFlow, Cloudwatch, Lambda) Experience Range: 8+ years Job Description ROLE AND MISSION DESCRIPTION Main tasks Master Databricks tools (job creation, cluster, notebook) and be able to query efficiently with SQL Maintain the platform in...
-
Senior Data Engineer
3 weeks ago
Kolkata, India Tata Consultancy Services Full timeGreetings from TCS! Job Title: Senior Data Engineer Required Skillset: Python, Spark, Databricks, AWS (S3, Glue, AirFlow, Cloudwatch, Lambda) Experience Range: 8+ years Job Description ROLE AND MISSION DESCRIPTION Main tasks - Master Databricks tools (job creation, cluster, notebook) and be able to query efficiently with SQL - Maintain the platform in...
-
Senior Data Engineer
3 weeks ago
Kolkata, India Tata Consultancy Services Full timeGreetings from TCS! Job Title: Senior Data Engineer Required Skillset: Python, Spark, Databricks, AWS (S3, Glue, AirFlow, Cloudwatch, Lambda) Experience Range: 8+ years Job Description ROLE AND MISSION DESCRIPTION Main tasks Master Databricks tools (job creation, cluster, notebook) and be able to query efficiently with SQL Maintain the platform in...
-
Senior Data Engineer
7 days ago
kolkata, India Tata Consultancy Services Full timeGreetings from TCS Job Title: Senior Data Engineer Required Skillset: Python, Spark, Databricks, AWS (S3, Glue, AirFlow, Cloudwatch, Lambda) Experience Range: 8+ years Job Description ROLE AND MISSION DESCRIPTION Main tasks Master Databricks tools (job creation, cluster, notebook) and be able to query efficiently with SQL Maintain the platform in operational...
-
Senior Data Engineer
1 week ago
Kolkata, India CXC Full time**Please apply only if you are available to work in Australian time zone and comfortable with 6 months contract duration**About the RoleWe’re seeking a highly skilled and autonomous Senior Data Engineer with strong experience in Power BI implementations to join our new data and analytics team. This role is critical to the development and enhancement of...
-
Senior Data Specialist
1 week ago
kolkata, India beBeeData Full timeSenior Data Engineer PositionThe role of Senior Data Engineer involves designing, developing and maintaining web scraping scripts to automate data collection from various online sources.Key responsibilities include extracting, cleaning, structuring and storing large datasets in MySQL databases.Developing tools for data visualization and analysis of product...
-
Senior Data Engineer
14 hours ago
Kolkata, West Bengal, India Tata Consultancy Services Full timeGreetings from TCSJob Title: Senior Data EngineerRequired Skillset: Python, Spark, Databricks, AWS (S3, Glue, AirFlow, Cloudwatch, Lambda)Experience Range: 8+ yearsJob DescriptionROLE AND MISSION DESCRIPTIONMain tasksMaster Databricks tools (job creation, cluster, notebook) and be able to query efficiently with SQLMaintain the platform in operational...
