Senior Data Engineer
2 days ago
Description :Responsibilities: Develop & Optimize Data Pipelines Build, test, and maintainETL/ELT data pipelines using AzureDatabricks & Apache Spark (PySpark) .Optimizeperformance and cost-efficiency of Spark jobs.Ensure data quality through validation, monitoring, and alerting mechanisms.Understand cluster types, configuration, and use-case for serverless Implement Unity Catalog for Data Governance Design and enforceaccess control policies using Unity Catalog.Managedata lineage, auditing, and metadata governance .Enable secure data sharing across teams and external stakeholders. Integrate with Cloud Data Platforms Work withAzure Data Lake Storage / Azure Blob Storage/ Azure Event Hub to integrate Databricks with cloud-baseddata lakes, data warehouses, and event streams .ImplementDelta Lake for scalable, ACID-compliant storage. Automate & Orchestrate Workflows DevelopCI/CD pipelines for data workflows usingAzure Databricks Workflows or Azure Data Factory .Monitor and troubleshoot failures injob execution and cluster performance . Collaborate with Stakeholders Work withData Analysts, Scientists, and Business Teams to understand requirements.Translate business needs intoscalable data engineering solutions . API expertiseAbility to pull data from a wide variety of APIs using different strategies and methods Required Skills & Experience: Azure Databricks & Apache Spark (PySpark) – Strong experience in buildingdistributed data pipelines . Python – Proficiency in writing optimized and maintainable Python code for data engineering. Unity Catalog – Hands-on experience implementingdata governance, access controls, and lineage tracking . SQL – Strong knowledge of SQL for data transformations and optimizations. Delta Lake – Understanding oftime travel, schema evolution, and performance tuning . Workflow Orchestration – Experience withAzure Databricks Jobs or Azure Data Factory . CI/CD & Infrastructure as Code (IaC) – Familiarity with Databricks CLI, Databricks DABs, and DevOps principles . Security & Compliance – Knowledge ofIAM, role-based access control (RBAC), and encryption . Preferred Qualifications: Experience withMLflow for model tracking & deployment in Databricks. Familiarity withstreaming technologies (Kafka, Delta Live Tables, Azure Event Hub, Azure Event Grid). Hands-on experience withdbt (Data Build Tool) for modular ETL development. Certification inDatabricks, Azure is a plus. Experience with Azure Databricks Lakehouse connectors for SalesForce and SQL Server Experience with Azure Synapse Link for Dynamics, dataverse Familiarity with other data pipeline strategies, like Azure Functions, Fabric, ADF, etc Soft Skills: Strongproblem-solving and debugging skills. Ability towork independently and in teams . Excellentcommunication and documentation skills.
-
Senior Data Engineer
3 days ago
Chennai, Tamil Nadu, India AABM Cloud Data Solution Full timeSenior Data Engineer (Remote, India)10+ Years Data Engineer Experience RequiredSQL, Python, Snowflake - 8+ years Mandatory hands-on experienceExperience with any ETL Tools (SSIS Preferred), Cloud Environments, and DB2/DBT is a plus.
-
Senior Data Engineer
1 week ago
Chennai, India Eucloid Data Solutions Full timeJob Description:Eucloid is looking for a Senior Data Engineer to join our Data Platform team supporting various business applications. The ideal candidate will support development of data infrastructure for our clients by participating in activities which may include starting from up- stream and down-stream technology selection to designing and building of...
-
Senior Data Engineer
1 week ago
Chennai, India Eucloid Data Solutions Full timeJob Description: Eucloid is looking for a Senior Data Engineer to join our Data Platform team supporting various business applications. The ideal candidate will support development of data infrastructure for our clients by participating in activities which may include starting from up- stream and down-stream technology selection to designing and building of...
-
Senior Data Engineer
1 week ago
Chennai, India Eucloid Data Solutions Full timeJob Description: Eucloid is looking for a Senior Data Engineer to join our Data Platform team supporting various business applications. The ideal candidate will support development of data infrastructure for our clients by participating in activities which may include starting from up- stream and down-stream technology selection to designing and building of...
-
Senior Data Engineer
1 week ago
Chennai, India Eucloid Data Solutions Full timeJob Description:Eucloid is looking for a Senior Data Engineer to join our Data Platform team supporting various business applications. The ideal candidate will support development of data infrastructure for our clients by participating in activities which may include starting from up- stream and down-stream technology selection to designing and building of...
-
Senior Data Engineer
1 week ago
Chennai, India Eucloid Data Solutions Full timeJob Description: Eucloid is looking for a Senior Data Engineer to join our Data Platform team supporting various business applications. The ideal candidate will support development of data infrastructure for our clients by participating in activities which may include starting from up- stream and down-stream technology selection to designing and building of...
-
Senior Data Engineer
6 days ago
Chennai, India Eucloid Data Solutions Full timeJob Description: Eucloid is looking for a Senior Data Engineer to join our Data Platform team supporting various business applications. The ideal candidate will support development of data infrastructure for our clients by participating in activities which may include starting from up- stream and down-stream technology selection to designing and building of...
-
Senior Data Engineer
6 days ago
Chennai, India Eucloid Data Solutions Full timeJob Description:Eucloid is looking for a Senior Data Engineer to join our Data Platform team supporting various business applications. The ideal candidate will support development of data infrastructure for our clients by participating in activities which may include starting from up- stream and down-stream technology selection to designing and building of...
-
Senior Data Engineer
6 days ago
Chennai, India Eucloid Data Solutions Full timeJob Description:Eucloid is looking for a Senior Data Engineer to join our Data Platform team supporting various business applications. The ideal candidate will support development of data infrastructure for our clients by participating in activities which may include starting from up- stream and down-stream technology selection to designing and building of...
-
Data Engineer
2 weeks ago
Chennai, Tamil Nadu, India AABM Cloud Data Solution Full time ₹ 20,00,000 - ₹ 25,00,000 per yearWe are seeking a Senior Data Engineer with10+ yearsof experience to join our team.Required Qualifications10+ years of experience in data engineering or similar role.Hands on experience in snowflake, SSIS, Python ( including NumPy and Pandas) is mandatory.Expertise in SQL and any cloud environment (AWS & Azure, etc.) is mandatory.Proficiency in mordern BI...
