PySpark Developer
1 week ago
Job Summary
We are looking for a Senior PySpark Developer with 3 to 6 years of experience in building and optimizing data pipelines using PySpark on Databricks, within AWS cloud environments. This role focuses on the modernization of legacy domains, involving integration with systems like Kafka and collaboration across cross-functional teams.
Key Responsibilities
- Develop and optimize scalable PySpark applications on Databricks.
- Work with AWS services (S3, EMy, Lambda, Dlue) for cloud-native data processing.
- Integrate streaming and batch data sources, especially using Kafka.
- Tune Spark jobs for performance, memory, and compute efficiency.
- Collaborate with DevOps, product, and analytics teams on delivery and deployment.
- Ensure data governance, lineage, and quality compliance across all pipelines.
Required Skills
- 3–6 years of hands-on development in PySpark.
- Experience with Databricks and performance tuning using Spark UI.
- Strong understanding of AWS services, Kafka, and distributed data processing.
- Proficient in partitioning, caching, join optimization, and resource configuration.
- Familiarity with data formats like Parquet, Avro, and OyC.
- Exposure to orchestration tools (Airflow, Databricks Workflows).
- Scala experience is a strong plus.
-
Pyspark Developer
3 days ago
Hyderabad, Telangana, India NTT DATA Business Solutions Full time ₹ 8,00,000 - ₹ 12,00,000 per yearJob SummaryWe are looking for a Senior PySpark Developer with 3 to 6 years of experience in building and optimizing data pipelines using PySpark on Databricks, within AWS cloud environments. This role focuses on the modernization of legacy domains, involving integration with systems like Kafka and collaboration across cross-functional teams.Key...
-
Pyspark
3 days ago
Hyderabad, Telangana, India Cirruslabs Full timeLed the data integration efforts for enterprise-scale analytics and warehousing projects.Designed and developed PySpark scriptsboth generic frameworks and project-specific solutions—to handle complex ETL workflows.Created and managed process schedules to automate data ingestion, transformation, and loading pipelines.Developed and optimized data integration...
-
Python Developer with Pyspark
1 week ago
Hyderabad, Telangana, India Datamaxis Full time ₹ 5,00,000 - ₹ 15,00,000 per yearPython Developer with PysparkHyderabadRole - FulltimeAvailability to Join - ImmediateYears of experience - 5+Required skills and qualifications5+ years of experience as a Python Developer with a strong portfolio of projects.Experience working in Pyspark is mustBachelor's degree in Computer Science, Software Engineering or a related field.In-depth...
-
Python Pyspark Developer
12 hours ago
Hyderabad, Telangana, India MatchPoint Full time ₹ 9,00,000 - ₹ 12,00,000 per yearType: PermanentLocation: Hyderabad (5 Days Onsite)Experience RequiredJob Description:We are seeking a skilledData Engineerwith strong expertise inPySpark Quries, Python programming, and Data Structures & Algorithms (DSA). The ideal candidate will design and optimize large-scale data pipelines, write efficient and scalable code, and solve complex data...
-
PySpark & ETL Data Engineer
5 days ago
Hyderabad, Telangana, India CirrusLabs Full timeWe areCirrusLabs. Our vision is to become the world's most sought-after niche digital transformation company that helps customers realize value through innovation. Our mission is to co-create success with our customers, partners and community. Our goal is to enable employees to dream, grow and make things happen. We are committed to excellence. We are a...
-
Date Engineer(Python, Pyspark and AWS)
2 weeks ago
Hyderabad, Telangana, India Zorba AI Full time ₹ 15,00,000 - ₹ 25,00,000 per yearKey Skills Required-Minimum 6 years of working experience in Python, Pyspark, AWS and SQL.Programming & Frameworks: Python, PySparkDatabases & Querying: Strong SQL (query optimization, joins, window functions)Big Data & Processing: PySpark for distributed data processing, ETL pipelinesCloud Platform: AWS (S3, Glue, Lambda, EMR, Redshift, Athena)Data...
-
Senior Pyspark Data Engineer
2 weeks ago
Hyderabad, Telangana, India DATAECONOMY Full time ₹ 20,00,000 - ₹ 25,00,000 per yearJob Title: PySpark Data EngineerExperience: 8 YearsLocation: HyderabadEmployment Type: Full-Time Job Summary: We are looking for a skilled and experienced PySpark Data Engineer to join our growing data engineering team. The ideal candidate will have 8 years of experience in designing and implementing data pipelines using PySpark, AWS Glue, and Apache...
-
Senior Pyspark Data Engineer
3 days ago
Hyderabad, Telangana, India DATAECONOMY Full time ₹ 12,00,000 - ₹ 24,00,000 per yearAbout UsAbout DATAECONOMY: We are a fast-growing data & analytics company headquartered in Dublin with offices inDublin, OH, Providence, RI, and an advanced technology center in Hyderabad,India. We are clearly differentiated in the data & analytics space via our suite of solutions, accelerators, frameworks, and thought leadership.Job DescriptionJob...
-
Pyspark,sql & aws glue Professional
1 week ago
Hyderabad, Telangana, India IDESLABS PRIVATE LIMITED Full time ₹ 12,00,000 - ₹ 36,00,000 per yearLooking to onboard a skilled professional with 6-8 years of experience in Pyspark, SQL, and AWS Glue. The ideal candidate will have a strong background in these technologies and excellent problem-solving skills. This position is located across Pan India.Roles and ResponsibilityDesign, develop, and implement data processing pipelines using Pyspark and AWS...
-
Senior Pyspark Data Engineer
2 weeks ago
Hyderabad, Telangana, India DataEconomy Full time ₹ 20,00,000 - ₹ 25,00,000 per yearJob InformationDate Opened10/13/2025Job TypeFull timeIndustryIT ServicesCityHyderabadState/ProvinceTelanganaCountryIndiaZip/Postal Code500081About UsAbout DATAECONOMY: We are a fast-growing data & analytics company headquartered in Dublin with offices inDublin, OH, Providence, RI, and an advanced technology center in Hyderabad,India. We are clearly...