EverestDX - Senior Data Engineer - Python/PySpark
22 hours ago
Description
Job Summary :
- We are seeking an experienced Azure Data Engineer / Lead with strong expertise in Azure services, distributed data processing, and team leadership.
- The ideal candidate will have hands-on experience with Azure Databricks, Azure Data Lake, Azure Data Factory, PySpark/Spark, and SQL, along with the ability to guide a small team on technical design and delivery.
Key Responsibilities
- Design, develop, and optimize large-scale data pipelines using Azure Databricks, ADLS, and ADF.
- Implement and manage distributed data processing solutions using Spark/PySpark.
- Write and optimize SQL queries for data extraction, transformation, and analysis.
- Lead and mentor a small team of data engineers, providing technical guidance and reviewing design solutions.
- Collaborate with stakeholders to translate business requirements into scalable and efficient data solutions.
- Ensure data quality, governance, and compliance across data platforms.
- Support production deployments, troubleshooting, and performance optimization.
Required Skills
- Strong expertise with Azure Databricks, Azure Data Lake, and Azure Data Factory.
- Hands-on experience in Spark/PySpark for distributed data processing.
- Proficiency in SQL for complex queries and optimization.
- Solid understanding of Azure cloud platform and its ecosystem.
- Proven experience in leading and mentoring teams.
- Strong problem-solving and analytical skills.
- Excellent communication and collaboration abilities
)
-
Generative AI Engineer
4 days ago
Hyderabad, Telangana, India EverestDX Inc Full time ₹ 12,00,000 - ₹ 36,00,000 per yearAbout the Company:EverestDX Inc, a Product and Services company headquartered in Stamford, with global delivery centers in Hyderabad and Chennai . Our Platform/Solution includes Orchestration, Intelligent operations with BOTs', AI-powered analytics for Enterprise IT. Our vision is to enable Digital Transformation for enterprises to deliver seamless customer...
-
Senior PySpark Engineer
2 days ago
Hyderabad, Telangana, India Rapsys Technologies Pte. Ltd Full time ₹ 6,00,000 - ₹ 27,00,000 per yearRole: Senior PySpark EngineerExperience Required: Minimum 8+ YearsWork Location: Hyderabad (5 Days Work from Office)Job Type: Contract to Hire (1 Year/ Renewable)Notice Period: Immediate to 15 Days maxMode of Interview: VirtualWe are seeking a highly skilled PySpark Data Engineer to design, build, and optimize large-scale data pipelines and distributed...
-
Senior PySpark/Python Developer
2 weeks ago
Hyderabad, Telangana, India Zorba Consulting Full time ₹ 12,00,000 - ₹ 24,00,000 per yearAbout The Role :We are seeking a highly skilled and experienced Senior PySpark/Python Developer to play a critical role in building a robust and reliable system for managing and disseminating customer notifications regarding PG&E's Planned Power Outages (PPOs). This is an exciting opportunity to tackle complex data challenges within a dynamic environment and...
-
Python And PySpark Developer
6 days ago
Hyderabad, Telangana, India Nisum Full time ₹ 12,00,000 - ₹ 24,00,000 per yearCompany DescriptionNisum is a global consulting partner specializing in digital commerce and evolution, offering AI-powered platforms and tailor-made solutions to unlock growth, optimize operations, and create long-term value. With over 25 years of proven experience, Nisum has a consistent track record of delivering complex digital transformations for...
-
Python Pyspark Developer
2 weeks ago
Hyderabad, Telangana, India MatchPoint Full time ₹ 9,00,000 - ₹ 12,00,000 per yearType: PermanentLocation: Hyderabad (5 Days Onsite)Experience RequiredJob Description:We are seeking a skilledData Engineerwith strong expertise inPySpark Quries, Python programming, and Data Structures & Algorithms (DSA). The ideal candidate will design and optimize large-scale data pipelines, write efficient and scalable code, and solve complex data...
-
Senior Pyspark Data Engineer
4 days ago
Hyderabad, Telangana, India DataEconomy Full time ₹ 20,00,000 - ₹ 25,00,000 per yearJob InformationDate Opened10/13/2025Job TypeFull timeIndustryIT ServicesCityHyderabadState/ProvinceTelanganaCountryIndiaZip/Postal Code500081About UsAbout DATAECONOMY: We are a fast-growing data & analytics company headquartered in Dublin with offices inDublin, OH, Providence, RI, and an advanced technology center in Hyderabad,India. We are clearly...
-
Hyderabad, Telangana, India EverestDX Inc Full time ₹ 12,00,000 - ₹ 36,00,000 per yearDescriptionAbout the Company :Everest DX We are a Digital Platform Services company, headquartered in Stamford.Our Platform/Solution includes Orchestration, Intelligent operations with BOTs, AI-powered analytics for Enterprise IT.Our vision is to enable Digital Transformation for enterprises to deliver seamless customer experience, business efficiency and...
-
Python Developer
4 days ago
Hyderabad, Telangana, India Data Unveil Full time ₹ 9,00,000 - ₹ 12,00,000 per yearJob Description:Position Title: Python DeveloperExperience: 3Years to 5YearsLocation: Hyderabad, TelanganaHire Type: Full Time, On-siteStart Date: ImmediateJob Summary:We are seeking a Python Developer with 2-3 years of experience, skilled in Python, PySpark, Oracle, MySQL, and basic AWS services. The candidate will work on data processing, ETL pipelines,...
-
PySpark Engineer
2 weeks ago
Hyderabad, Telangana, India Rapsys Technologies Pte. Ltd Full time ₹ 6,00,000 - ₹ 25,00,000 per yearRole: PySpark EngineerExperience Required: Minimum 5-10 YearsWork Location: Hyderabad (5 Days Work from Office)Job Type: Contract to Hire (1 Year/ Renewable)Notice Period: Immediate to 30 Days maxRequired skill sets and expertise:5+ years of experience in PySpark, Big Data technologies, Data Warehousing.Strong Python programming experience.Domain: Experience...
-
Senior Data Engineer
7 days ago
Hyderabad, Telangana, India Enable Data Incorporated Full time ₹ 12,00,000 - ₹ 36,00,000 per yearExperience Required: 8+YearsMode of work: RemoteSkills Required: Azure DataBricks, Eventhub, Kafka, Architecture, Azure Data Factory, Pyspark, Python, SQL, SparkNotice Period : Immediate Joiners/ Permanent/Contract role (Can join within September 29th 2025)Translate business rules into technical specifications and implement scalable data solutions.Manage a...