Data Engineer
1 week ago
Job Description
Job Title: Data Engineer (PySpark + Azure Databricks)
**Location: Bangalore, Hyderabad, Chennai & Mumbai
Experience: 6 � 10 years
Job Summary**
We are looking for a skilled Data Engineer with strong experience in PySpark and Azure Databricks to design, build, and optimize scalable data pipelines and analytics solutions. The ideal candidate will have hands-on expertise in big data processing, Azure data services, and automation for data-driven decision-making.
Key Responsibilities
- Design, develop, and maintain ETL/ELT data pipelines using Azure Data Factory and Databricks.
- Build and optimize PySpark scripts and Databricks notebooks for large-scale data processing.
- Perform data ingestion, transformation, and aggregation from multiple sources (SQL, APIs, ADLS, Blob, SFTP, etc.).
- Implement Delta Lake architecture for data versioning, ACID transactions, and optimized queries.
- Work with Azure Data Lake Storage (Gen2) for managing and structuring raw, processed, and curated data layers.
- Develop and manage CI/CD pipelines for Databricks using Azure DevOps or GitHub Actions.
- Implement data validation, quality checks, and monitoring mechanisms across data pipelines.
- Collaborate with business and analytics teams to deliver clean, structured data for reporting and machine learning.
- Optimize PySpark jobs using techniques like broadcast joins, Z-Ordering, partitioning, and caching.
- Ensure compliance with data governance, security, and regulatory requirements.
- Troubleshoot performance bottlenecks and improve resource utilization on Databricks clusters.
Skills Required
RoleData Engineer (Pyspark + DataBricks) Contract Hiring
Industry TypeIT/ Computers - Software
Functional Area
Required Education Bachelor Degree
Employment TypeFull Time, Permanent
Key Skills
- DATA ENGINEER
- DATABRICKS
- PY SPARK
Other Information
Job CodeGO/JC/1327/2025
Recruiter NameChristopher
-
Azure Data Engineer
7 days ago
Hyderabad, Telangana, India Enable Data Full time ₹ 15,00,000 - ₹ 25,00,000 per yearEnable Data Incorporated is currently seeking a skilled and experienced Azure Data Engineer to join our dynamic team. As a leading provider of advanced application, data, and cloud engineering services, Enable Data has developed deep expertise across various industries. We work closely with our customers to leverage modern solutions and technologies to drive...
-
Azure Data Engineer With Snowflake
1 week ago
Hyderabad, Telangana, India Enable Data Full time ₹ 15,00,000 - ₹ 25,00,000 per yearEnable Data Incorporated is currently seeking a skilled and experienced Azure Data Engineer to join our dynamic team. As a leading provider of advanced application, data, and cloud engineering services, Enable Data has developed deep expertise across various industries. We work closely with our customers to leverage modern solutions and technologies to drive...
-
Senior Data Engineer
7 days ago
Hyderabad, Telangana, India The Modern Data Company Full time ₹ 12,00,000 - ₹ 36,00,000 per yearJob InformationDate Opened11/07/2025IndustrySoftware ProductJob TypeFull timeCityHyderabadState/ProvinceTelanganaCountryIndiaZip/Postal Code500081About UsThe Modern Data Company is redefining data management for the AI era, transforming data from a technical challenge into a company's most powerful business asset. Modern's DataOS platform is the world's...
-
Data Engineer Advisor
2 weeks ago
Hyderabad, Telangana, India NTT DATA Full time ₹ 1,00,00,000 - ₹ 2,00,00,000 per yearEnsure audit trail is in place for data migration and migrated data is traceable back to the cleanup / data enrichment activities and a clear line of sight to the source legacy systems Work closely with SAP S4 HANA implementation teams to ensure blueprint is effectively understood and translated into data migration requirements / data concept documents 10+...
-
Data Analyst and Modelling
2 weeks ago
Hyderabad, Telangana, India Hudson Data Full time ₹ 6,00,000 - ₹ 12,00,000 per yearPassion for applying AI and data-driven thinking to improve processes, enhance decision-making, and drive innovation.As a Data Analyst and Modelling professional, you will be responsible for collecting, processing, and performing statistical analysis on large datasets to extract meaningful insights and build predictive frameworks that inform strategic...
-
Databricks Engineer
2 weeks ago
Hyderabad, Telangana, India NTT DATA Full time ₹ 12,00,000 - ₹ 36,00,000 per yearDesign, build, and maintain robust ETL/ELT data pipelines using Apache Spark on Databricks. Implement data Lakehouse architecture using Delta Lake for cost-effective data storage and analytics. Use Databricks Workflows for orchestrating batch and streaming pipelines. Develop and maintain CI/CD pipelines for data applications using tools such as Azure DevOps,...
-
Data Engineer Senior Consultant
7 days ago
Hyderabad, Telangana, India NTT DATA, Inc. Full time ₹ 15,00,000 - ₹ 28,00,000 per yearUnderstand and execute data migration blueprints (migration concepts, transformation rules, mappings, selection criteria)Understand and contribute to the documentation of the data mapping specifications, conversion rules, technical design specifications as requiredBuild the conversion processes and associated programs that will migrate the data per the...
-
Hyderabad, Telangana, India NTT DATA Full time ₹ 6,00,000 - ₹ 18,00,000 per yearJob summary The PeopleSoft to Workday Data Conversion Technical Lead will be responsible for the technical design, development, and execution of the data migration from PeopleSoft to Workday. This hands-on role requires deep technical expertise in both PeopleSoft and Workday data structures and tools. The lead will manage the technical conversion team,...
-
SRE Engineer
7 days ago
Hyderabad, Telangana, India NTT DATA Full time ₹ 8,00,000 - ₹ 24,00,000 per yearReq ID: 338436NTT DATA strives to hire exceptional, innovative and passionate individuals who want to grow with us. If you want to be part of an inclusive, adaptable, and forward-thinking organization, apply now. We are currently seeking a SRE Engineer to join our team in Hyderabad, Telangana (IN-TG), India (IN). "NTT DATA Services currently seeks...
-
Azure Cloud Engineer
1 week ago
Hyderabad, Telangana, India NTT DATA Full time ₹ 10,00,000 - ₹ 30,00,000 per yearNTT DATA strives to hire exceptional, innovative and passionate individuals who want to grow with us. If you want to be part of an inclusive, adaptable, and forward-thinking organization, apply now. We are currently seeking a Azure Cloud Engineer to join our team in Hyderabad, Telangana (IN-TG), India (IN). Role: - Azure Cloud Engineer - PaaS, SaaS,...