Senior Pyspark Data Engineer
7 days ago
Job Title: PySpark Data Engineer
Experience: 8 Years
Location: Hyderabad
Employment Type: Full-Time
Job Summary:
We are looking for a skilled and experienced PySpark Data Engineer to join our growing data engineering team. The ideal candidate will have 8 years of experience in designing and implementing data pipelines using PySpark, AWS Glue, and Apache Airflow, with strong proficiency in SQL. You will be responsible for building scalable data processing solutions, optimizing data workflows, and collaborating with cross-functional teams to deliver high-quality data assets.
Key Responsibilities:
- Design, develop, and maintain large-scale ETL pipelines using PySpark and AWS Glue.
- Orchestrate and schedule data workflows using Apache Airflow.
- Optimize data processing jobs for performance and cost-efficiency.
- Work with large datasets from various sources, ensuring data quality and consistency.
- Collaborate with Data Scientists, Analysts, and other Engineers to understand data requirements and deliver solutions.
- Write efficient, reusable, and well-documented code following best practices.
- Monitor data pipeline health and performance; resolve data-related issues proactively.
- Participate in code reviews, architecture discussions, and performance tuning.
Requirements
- 8 years of experience in data engineering roles.
- Strong expertise in PySpark for distributed data processing.
- Hands-on experience with AWS Glue and other AWS data services (S3, Athena, Lambda, etc.).
- Experience with Apache Airflow for workflow orchestration.
- Strong proficiency in SQL for data extraction, transformation, and analysis.
- Familiarity with data modeling concepts and data lake/data warehouse architectures.
- Experience with version control systems (e.g., Git) and CI/CD processes.
- Ability to write clean, scalable, and production-grade code.
Benefits Company Standard Benefits.
-
Senior Pyspark Data Engineer
7 days ago
Hyderabad, Telangana, India DataEconomy Full time ₹ 20,00,000 - ₹ 25,00,000 per yearJob InformationDate Opened10/13/2025Job TypeFull timeIndustryIT ServicesCityHyderabadState/ProvinceTelanganaCountryIndiaZip/Postal Code500081About UsAbout DATAECONOMY: We are a fast-growing data & analytics company headquartered in Dublin with offices inDublin, OH, Providence, RI, and an advanced technology center in Hyderabad,India. We are clearly...
-
Senior Data Engineer
2 weeks ago
Hyderabad, Telangana, India Enable Data Incorporated Full time ₹ 12,00,000 - ₹ 36,00,000 per yearExperience Required: 8+YearsMode of work: RemoteSkills Required: Azure DataBricks, Eventhub, Kafka, Architecture, Azure Data Factory, Pyspark, Python, SQL, SparkNotice Period : Immediate Joiners/ Permanent/Contract role (Can join within September 29th 2025)Translate business rules into technical specifications and implement scalable data solutions.Manage a...
-
Senior Data Engineer
3 days ago
Hyderabad, Telangana, India MatchPoint Full time ₹ 1,50,000 - ₹ 28,00,000 per yearRole:Lead Data Engineer / Senior Data Engineer / Sr. Data platform engineer(with SQL, Python, and PySpark)Work experiance: 8 + yearsLocation: Hyderabad-(Onsite)Responsibilities:• Develop and enhance data-processing, orchestration, monitoring, and more by leveraging popular open-source software, AWS, and GitLab automation.• Collaborate with product and...
-
PySpark Developer
5 days ago
Hyderabad, Telangana, India algoleap Full time ₹ 15,00,000 - ₹ 25,00,000 per yearJob SummaryWe are looking for a Senior PySpark Developer with 3 to 6 years of experience in building and optimizing data pipelines using PySpark on Databricks, within AWS cloud environments. This role focuses on the modernization of legacy domains, involving integration with systems like Kafka and collaboration across cross-functional teams.Key...
-
Databricks + Pyspark
2 weeks ago
Hyderabad, Telangana, India Cognizant Full time ₹ 1,00,00,000 - ₹ 3,00,00,000 per yearSkills- Databricks+ PysparkExperience: 4 to 13 yearsLocation: AIA-PuneWe are looking for a highly skilled Data Engineer with expertise in PySpark and Databricks to design, build, and optimize scalable data pipelines for processing massive datasets.Key Responsibilities:Build & Optimize Pipelines: Develop high-throughput ETL workflows using PySpark on...
-
Date Engineer(Python, Pyspark and AWS)
1 week ago
Hyderabad, Telangana, India Zorba AI Full time ₹ 15,00,000 - ₹ 25,00,000 per yearKey Skills Required-Minimum 6 years of working experience in Python, Pyspark, AWS and SQL.Programming & Frameworks: Python, PySparkDatabases & Querying: Strong SQL (query optimization, joins, window functions)Big Data & Processing: PySpark for distributed data processing, ETL pipelinesCloud Platform: AWS (S3, Glue, Lambda, EMR, Redshift, Athena)Data...
-
Data Engineer – AWS Glue, Redshift,, PySpark
3 days ago
Hyderabad, Telangana, India Cyepro Solutions Full time ₹ 12,00,000 - ₹ 24,00,000 per yearCompany Overview:Cyepro Solutions is at the forefront of innovation in customer relationship management, specializing in the automotive industry. We offer a platform that empowers dealerships, manufacturers, and service providers to enhance customer experiences and streamline operations. Headquartered in Hyderabad, Telangana, with a team of employees, Cyepro...
-
Senior PySpark/Python Developer
2 weeks ago
Hyderabad, Telangana, India Zorba Consulting Full time ₹ 12,00,000 - ₹ 24,00,000 per yearAbout The Role :We are seeking a highly skilled and experienced Senior PySpark/Python Developer to play a critical role in building a robust and reliable system for managing and disseminating customer notifications regarding PG&E's Planned Power Outages (PPOs). This is an exciting opportunity to tackle complex data challenges within a dynamic environment and...
-
Senior Data Engineer
5 days ago
Hyderabad, Telangana, India Saaki Argus and Averil Consulting Full time ₹ 12,00,000 - ₹ 24,00,000 per yearAbout the Client:One of thecloud and data analytics companythat empowers businesses to unlock insights and drive innovation through modern data solutions.Role:Senior Data Engineer (AWS)Experience:6 to 10 yearsLocation:Chennai & HyderabadNotice Period:Immediate Joiners / Max. 30 days / Serving Notice onlySkillsets:6 – 10 years of experience in Data...
-
Senior Data Engineer
1 day ago
Hyderabad, Telangana, India Tide Platform Private Limited Full time ₹ 15,00,000 - ₹ 25,00,000 per yearLead Data Engineer(pyspark) ABOUT TIDE At Tide, we are building a business management platform designed to save small businesses time and money. We provide our members with business accounts and related banking services, but also a comprehensive set of connected administrative solutions from invoicing to accounting. Launched in 2017, Tide is now...