Data Engineer – Databricks
1 week ago
Role Summary:
We are looking for a
Data Engineer
with expertise in
Azure Databricks
,
data transformation
, and
integration pipelines
to support forecasting, scheduling, and analytics flows in the WFM Re-Platform program.
Key Responsibilities
- Design and implement
data pipelines
in Azure Databricks for ingesting and transforming data from upstream systems (SAP, PIPS, POS) into WFM and UKG. - Optimize
ETL/ELT workflows
for performance and scalability. - Collaborate with Java/API developers to integrate
event-driven triggers
into data pipelines. - Implement
data quality checks
, schema validation, and error handling. - Support
batch and near-real-time data flows
for operational and analytics use cases. - Work with Boomi and WFM teams to ensure
data contracts
and
canonical models
are enforced.
Required Skills
- Strong experience with
Azure Databricks
(PySpark, Delta Lake). - Proficiency in
SQL
and
data modeling
. - Experience with
Azure Data Lake
, and
Event Hub
. - Familiarity with
data governance
and
security best practices
. - Ability to work with
large datasets
and optimize for performance. - Familiarity with
CI/CD
(Jenkins and Terraform preferred). - Knowledge of
JSON, XML
.
Nice-to-Have
- Experience with
UKG Data Hub
or similar HR/payroll data platforms. - Knowledge of
API integration
and
microservices
. - Familiarity with
Power BI
or other reporting tools.
-
Senior Databricks Engineer
2 days ago
Chennai, Tamil Nadu, India Zorba Consulting Full time ₹ 12,00,000 - ₹ 36,00,000 per yearExperience : 8-15 years. Primary Roles And Responsibilities : Developing Modern Data Warehouse solutions using Databricks and AWS/ Azure Stack. Ability to provide solutions that are forward-thinking in data engineering and analytics space. Collaborate with DW/BI leads to understand new ETL pipeline development requirements. Triage issues to find gaps in...
-
Databricks Architect
2 days ago
Chennai, Tamil Nadu, India DataTerrain, Inc. Full time ₹ 12,00,000 - ₹ 36,00,000 per yearJob Title: Databricks ArchitectExperience: 12+ yearsJob Summary:We are seeking an experienced Databricks Architect to design, implement, and optimize data solutions on the Databricks platform. The ideal candidate will have deep expertise in big data technologies, cloud platforms, and analytics architectures, with strong communication skills to interact...
-
Databricks spark
1 day ago
Chennai, Tamil Nadu, India Cognizant Technology Solutions Full time ₹ 12,00,000 - ₹ 36,00,000 per yearJob SummaryThe Sr. Developer role is crucial for driving innovation and efficiency in our hybrid work model. With a focus on Kafka Python Databricks SQL Databricks Workflows and PySpark the candidate will enhance our data processing capabilities. Experience in Claims and Billing domains is advantageous. This position requires 8 to 9 years of experience and...
-
Data Engineer
1 week ago
Chennai, Tamil Nadu, India CG-VAK Software & Exports Ltd. Full time ₹ 12,00,000 - ₹ 36,00,000 per yearJob Title:Data Engineer (Scala, Spark, Pyspark, Databricks)Remark - final round will be the F2FExperience: 10+ Years (Lead Role)ResponsibilitiesDesign, develop, and maintain robust and scalable data pipelines using Apache Spark and Scala on the Databricks platform.Implement ETL (Extract, Transform, Load) processes for various data sources, ensuring data...
-
Data Engineer
2 weeks ago
Chennai, Tamil Nadu, India DataMoo Full time ₹ 8,00,000 - ₹ 24,00,000 per yearWe're Hiring | Data Engineer (Databricks) – 2+ Years ExperienceAt, we're building next-generationAI-driven platformsthat are transforming industries likeBFSI, Healthcare, Manufacturing, and RetailthroughData Science, Data Engineering, and Generative AI.We're now looking for a passionateData Engineer (Databricks)to join our growing team inChennaiand help us...
-
Senior Databricks Developer
2 weeks ago
Chennai, Tamil Nadu, India Genpact Full time ₹ 1,20,000 - ₹ 2,40,000 per yearPrincipal Consultant, Sr. Databricks DeveloperPrincipal Consultant, Sr. Databricks Developer-COR Ready to shape the future of work? At Genpact, we don't just adapt to change—we drive it. AI and digital innovation are redefining industries, and we're leading the charge. Genpact's AI Gigafactory, our industry-first accelerator, is an example of how...
-
DataBricks / AWS Redshift
2 days ago
Chennai, Tamil Nadu, India Virtusa Full time ₹ 15,00,000 - ₹ 25,00,000 per yearKey responsibilities include designing developing and maintaining scalable data pipelines using Apache Spark on Databricks Writing efficient and production ready PySpark or Scala code for data transformation and ETL processes Integrating data from various structured and unstructured sources into a unified platform Implementing Delta Lake and managing data...
-
Data Engineer
1 week ago
Chennai, Tamil Nadu, India Colan Infotech Private Limited Full time ₹ 6,00,000 - ₹ 18,00,000 per yearGreetings from Colan InfotechWe are hiring Azure Data Engineer urgent basisJob Location - Chennai / Bangalore (WFO only)Role: Azure Data EngineerExperience: 3-5 YearsSkill set:Pyspark / Scala Spark, Python, Azure Databricks and Azure Data Factory Roles and Responsibilities: Should have programming skills with the ability to write optimized and reusable...
-
Data Engineer
1 week ago
Chennai, Tamil Nadu, India YO HR Consultancy Full time ₹ 12,00,000 - ₹ 36,00,000 per yearData Engineer/Senior Data EngineerLocation: ChennaiExperience: 2 - 8 YearsRole DescriptionThe Data Engineer will be responsible for designing and developing data engineering solutions, creating and maintaining data models, building Extract Transform Load (ETL) pipelines, implementing data warehousing, and performing data analytics on large...
-
AWS Data Engineer
1 week ago
Chennai, Tamil Nadu, India MyCareernet Full time ₹ 6,00,000 - ₹ 18,00,000 per yearCompany:IT Services OrganizationKey Skills:AWS, Pyspark, Databricks, SQL, Python, ETL, Azure Databricks, Data modeling, Data Warehouse, Data Engineer, Data Engineering, PL/SQL, Data ModellingRoles and Responsibilities:Design, develop, and maintain ETL processes to support data integration and transformation.Utilize Python for data engineering tasks, ensuring...