Data Engineer – Databricks
3 weeks ago
Role Summary:
We are looking for a Data Engineer with expertise in Azure Databricks, data transformation, and integration pipelines to support forecasting, scheduling, and analytics flows in the WFM Re-Platform program.
Key Responsibilities
- Design and implement data pipelines in Azure Databricks for ingesting and transforming data from upstream systems (SAP, PIPS, POS) into WFM and UKG.
- Optimize ETL/ELT workflows for performance and scalability.
- Collaborate with Java/API developers to integrate event-driven triggers into data pipelines.
- Implement data quality checks, schema validation, and error handling.
- Support batch and near-real-time data flows for operational and analytics use cases.
- Work with Boomi and WFM teams to ensure data contracts and canonical models are enforced.
Required Skills
- Strong experience with Azure Databricks (PySpark, Delta Lake).
- Proficiency in SQL and data modeling.
- Experience with Azure Data Lake, and Event Hub.
- Familiarity with data governance and security best practices.
- Ability to work with large datasets and optimize for performance.
- Familiarity with CI/CD (Jenkins and Terraform preferred).
- Knowledge of JSON, XML.
Nice-to-Have
- Experience with UKG Data Hub or similar HR/payroll data platforms.
- Knowledge of API integration and microservices.
- Familiarity with Power BI or other reporting tools.
-
Databricks Data Engineer
2 weeks ago
Chennai, Tamil Nadu, India, Tamil Nadu Tata Consultancy Services Full timeAbout the RoleThe Databricks Data Engineer will play a crucial role in migrating and optimizing data workflows, ensuring high performance and reliability in our data operations.Experience- 3 to 6 yearsLocation - Kolkata /Chennai/TrivandrumRequired Technical Skill Set ------ Databricks, AWS, Python & PySparkGood to have- Experience in AWS platform (S3, EC2,...
-
Azure Databricks Engineer
3 weeks ago
Chennai, Tamil Nadu, India, Tamil Nadu Tata Consultancy Services Full timeRole**Databricks Engineer (Individual Contributor)Required Technical Skill Set**Azure Databricks, PysparkExperience: 4 to 10 YearsLocation: Hyd,Kolkata, Noida, Chennai, BangaloreDesired Competencies (Technical/Behavioral Competency)Must-Have**1. Azure Data Bricks (Python)2. Pyspark3. ADLS4. complex problem-solving skillGood-to-HaveAzure DevopsAzure Data...
-
Data Engineer- Databricks
6 days ago
Chennai, Tamil Nadu, India InfoCepts Full time ₹ 9,00,000 - ₹ 12,00,000 per yearPosition: Data Engineer- DatabricksPurpose of the Position:Develop, support and steer end-to-end business intelligence using Databricks.Location: Nagpur/ Pune/ Chennai/ BangaloreKey Responsibilities:Work with business analysts and data architects to translate requirements into technical implementations.Design, develop, implement, and maintain pyspark code...
-
Databricks Admin
2 weeks ago
Chennai, Tamil Nadu, India, Tamil Nadu Tata Consultancy Services Full timeDatabricks AdminExp- 5 to 8 yearsLocation- Chennai/ KolkataRequired SkillsDatabricks AdministrationTerraformAWS cloud servicesMLflowWorkflowsDatabricks Asset BundlesAWS IAMVPCPrivate endpointsFirewallsS3SQL + PySparkdbx CLIResponsibilitiesImplement, and maintain the Databricks platform, including workspace setup, user and group management, access control,...
-
Senior Data Engineer – Databricks
2 weeks ago
Chennai, Tamil Nadu, India Zillion Technologies Full time ₹ 8,00,000 - ₹ 24,00,000 per yearSenior Data Engineer – DatabricksLocation: Hyderabad/ChennaiWork Schedule: Timings 2:30 PM to 11:30 PMRole Overview:We are seeking a highly skilled Senior Data Engineer with deep expertise in Databricks to design, build, and optimize scalable data pipelines and architectures. You will collaborate with cross-functional teams including data scientists,...
-
Principal Architect
1 week ago
Chennai, Tamil Nadu, India, Tamil Nadu Tiger Analytics Full timeTitle : Principal Architect – Databricks Location : Chennai, Bengaluru, Hyderabad Who we areTiger Analytics is a global leader in AI and analytics, helping Fortune 1000 companies solve their toughest challenges. We offer full-stack AI and analytics services & solutions to empower businesses to achieve real outcomes and value at scale. We are on a mission...
-
Data Engineer – Databricks
4 days ago
Chennai, Tamil Nadu, India Tata Consultancy Services Full time ₹ 15,00,000 - ₹ 25,00,000 per yearRole Summary:We are looking for aData Engineerwith expertise inAzure Databricks,data transformation, andintegration pipelinesto support forecasting, scheduling, and analytics flows in the WFM Re-Platform program.Key ResponsibilitiesDesign and implement data pipelines in Azure Databricks for ingesting and transforming data from upstream systems (SAP, PIPS,...
-
Data Engineer
2 weeks ago
Chennai, Tamil Nadu, India CX Data Labs Full time ₹ 15,00,000 - ₹ 25,00,000 per yearHiRole - Azure Data EngineerLocation - Chennai, Gurugram (5days Office)Full timeShift timing 2pm to 11pmKey Responsibilities:· Develop, maintain, and optimize scalable ETL/ELT pipelines using PySpark and Databricks.· Collaborate with cross-functional teams to design and implement data models and data integration solutions.· Create and maintain robust SQL...
-
Databricks Data Engineer 6+ years
1 week ago
Chennai, Tamil Nadu, India Raah Techservices Full time ₹ 4,69,000 - ₹ 18,17,548 per yearPosition OverviewWe are looking for an experienced Databricks Data Engineer with 6+ years of expertise in building and managing large-scale data platforms. The ideal candidate will have strong hands-on experience with Databricks, Spark, and Cloud Data Engineering practices. This role involves designing, developing, and optimizing data pipelines, enabling...
-
Databricks Admin
2 weeks ago
Chennai, Tamil Nadu, India, Tamil Nadu Tata Consultancy Services Full timeTCS present an excellent opportunity for Databricks AdminJob Location: Chennai , KolkataExperience required : 6-12 yrsInterview date: 17th Oct (Friday)Required Technical Skill Set**Databricks Administration, Terraform, AWS cloud services, MLflow, Workflows, Databricks Asset Bundles, AWS IAM, VPC, private endpoints, firewalls, S3, SQL + PySpark, dbx...