Databricks + Pyspark
7 days ago
Skills- Databricks+ Pyspark
Experience: 4 to 13 years
Location: AIA-Pune
We are looking for a highly skilled Data Engineer with expertise in PySpark and Databricks to design, build, and optimize scalable data pipelines for processing massive datasets.
Key Responsibilities:
- Build & Optimize Pipelines: Develop high-throughput ETL workflows using PySpark on Databricks.
- Data Architecture & Engineering: Work on distributed computing solutions, optimize Spark jobs, and build efficient data models.
- Performance & Cost Optimization: Fine-tune Spark configurations, optimize Databricks clusters, and reduce compute/storage costs.
- Collaboration: Work closely with Data Scientists, Analysts, and DevOps teams to ensure data reliability.
- ETL & Data Warehousing: Implement scalable ETL processes for structured & unstructured data.
- Monitoring & Automation: Implement logging, monitoring, and alerting mechanisms for data pipeline health and fault tolerance.
-
PySpark Developer
3 days ago
Hyderabad, Telangana, India Algoleap Technologies Full timeSUMMARY Job SummaryWe are looking for a Senior PySpark Developer with 3 to 6 years of experience in building and optimizing data pipelines using PySpark on Databricks, within AWS cloud environments. This role focuses on the modernization of legacy domains, involving integration with systems like Kafka and collaboration across cross-functional teams.Key...
-
PySpark Developer
5 days ago
Hyderabad, Telangana, India Algoleap Technologies Pvt Ltd Full timeJob SummaryWe are looking for a Senior PySpark Developer with 3 to 6 years of experience in building and optimizing data pipelines using PySpark on Databricks, within AWS cloud environments. This role focuses on the modernization of legacy domains, involving integration with systems like Kafka and collaboration across cross-functional teams.Key...
-
AWS Databricks
2 days ago
Hyderabad, Telangana, India LTIMindtree Full timeJob Location-ALL LTI LocationExp-5 to 12 yearsDatabricks expertise Proven HandsOn experience with the Databricks platform and its componentsProgramming languages Strong proficiency in PySpark for data manipulation and processingBig data technologies Expertise in Apache Spark and Delta Lake for handling large datasetsCloud knowledge Good to have Experience...
-
Databricks with AWS
1 day ago
Hyderabad, Telangana, India Cognizant Technology Solutions Full timeAIA - Hyderabed DriveJob SummaryWe are seeking a Sr. Developer with 7 to 12 years of experience to join our team. The ideal candidate will have expertise in Spark in Scala Delta Sharing and Databricks Unity Catalog Admin. This role involves working with cutting-edge technologies like Databricks CLI Delta Live Pipelines and Structured Streaming. The candidate...
-
Databricks Engineer
5 days ago
Hyderabad, Telangana, India NTT DATA Full timeDesign, build, and maintain robust ETL/ELT data pipelines using Apache Spark on Databricks. Implement data Lakehouse architecture using Delta Lake for cost-effective data storage and analytics. Use Databricks Workflows for orchestrating batch and streaming pipelines. Develop and maintain CI/CD pipelines for data applications using tools such as Azure DevOps,...
-
Databricks Developer
2 weeks ago
Hyderabad, Telangana, India Tezo Full time US$ 6,00,000 - US$ 18,00,000 per yearPosition: Databricks DeveloperLocation: HyderabadExperience: 5–11 YearsNotice Period: Immediate Joiners PreferredAbout the RoleWe are looking for an experienced Databricks Developer with strong expertise in building scalable data pipelines using Apache Spark, Delta Lake, and cloud-native data platforms. The ideal candidate must have hands-on experience in...
-
Data Engineer with Databricks
1 day ago
Hyderabad, Telangana, India ZScale LLC Full timeShare your resume:Title:Data Engineer with DatabricksOverall Experience:5 – 7 yearsDatabricks Experience:2+ yearsNotice Period:Immediate to 30 DaysLocation:Hyderabad, Telangana, IndiaPAN CARD:MandatoryCore skills:* Azure Cloud, Databricks workflows, DLT, Notebooks, Python, SQL, PySpark, ADLS Gen2, ADF, GitHub, PL/SQL, ORACLE, ETL experience, Understanding...
-
Databricks with Python
3 days ago
Hyderabad, Telangana, India Tata Consultancy Services Full timeRole:Databricks with PythonExperience range: 5-8 yearsLocation: Hyderabad (WALK-IN DRIVE in Hyderabad on 20th Dec)NOTE: Relevant Databricks experience must be 5 yearsJob description:Must Have:Extensive expertise in designing and implementing data load processes using Azure Data Factory, Azure Databricks, Delta Lake, Azure Delta Lake Storage and...
-
Hyderabad, Telangana, India EverestDX Inc Full timeDescriptionJob Summary :We are seeking an experienced Azure Data Engineer / Lead with strong expertise in Azure services, distributed data processing, and team leadership.The ideal candidate will have hands-on experience with Azure Databricks, Azure Data Lake, Azure Data Factory, PySpark/Spark, and SQL, along with the ability to guide a small team on...
-
AVP - Databricks Architect
1 week ago
Hyderabad, Telangana, India Impetus Career Consultants Full timeJob Title:AVP – Databricks ArchitectLocation:HyderabadExperience:14+ YearsAbout the RoleWe are seeking a senior Databricks Architect to lead the design and delivery of next-generation data platforms. This role requires deep technical authority in Databricks, Unity Catalog, and modern data engineering patterns, with the ability to define enterprise-scale...