pyspark
1 day ago
Job Summary
We are seeking a Sr. Developer with 8 to 12 years of experience to join our dynamic team. The ideal candidate will have strong expertise in Databricks SQL Databricks Workflows and PySpark. Experience in the Cards & Payments domain is a plus. This hybrid role offers the flexibility of working both remotely and on-site during day shifts. No travel is required.
Responsibilities
- Develop and maintain scalable data pipelines using Databricks SQL and Databricks Workflows.
- Collaborate with cross-functional teams to design and implement data solutions that meet business requirements.
- Optimize and troubleshoot PySpark applications to ensure high performance and reliability.
- Provide technical guidance and mentorship to junior developers on best practices and coding standards.
- Conduct code reviews to ensure code quality and adherence to development standards.
- Implement data security and privacy measures to protect sensitive information.
- Work closely with stakeholders to gather and analyze requirements for new data projects.
- Create and maintain comprehensive documentation for data processes and workflows.
- Monitor and manage data pipeline performance making necessary adjustments to improve efficiency.
- Stay updated with the latest industry trends and technologies to continuously improve data solutions.
- Participate in agile development processes including sprint planning daily stand-ups and retrospectives.
- Ensure data quality and integrity by implementing robust validation and testing procedures.
- Collaborate with the DevOps team to automate deployment and monitoring of data solutions.
Qualifications
- Possess strong expertise in Databricks SQL and Databricks Workflows.
- Demonstrate proficiency in PySpark for developing and optimizing data applications.
- Have experience in the Cards & Payments domain which is a plus.
- Exhibit excellent problem-solving skills and attention to detail.
- Show ability to work effectively in a hybrid work model.
- Display strong communication and collaboration skills.
-
Pyspark
1 week ago
Hyderabad, Telangana, India Cirruslabs Full timeLed the data integration efforts for enterprise-scale analytics and warehousing projects.Designed and developed PySpark scriptsboth generic frameworks and project-specific solutions—to handle complex ETL workflows.Created and managed process schedules to automate data ingestion, transformation, and loading pipelines.Developed and optimized data integration...
-
Pyspark Developer
1 week ago
Hyderabad, Telangana, India NTT DATA Business Solutions Full time ₹ 8,00,000 - ₹ 12,00,000 per yearJob SummaryWe are looking for a Senior PySpark Developer with 3 to 6 years of experience in building and optimizing data pipelines using PySpark on Databricks, within AWS cloud environments. This role focuses on the modernization of legacy domains, involving integration with systems like Kafka and collaboration across cross-functional teams.Key...
-
Databricks + Pyspark
1 day ago
Hyderabad, Telangana, India Cognizant Full time ₹ 1,00,00,000 - ₹ 3,00,00,000 per yearSkills- Databricks+ PysparkExperience: 4 to 13 yearsLocation: AIA-PuneWe are looking for a highly skilled Data Engineer with expertise in PySpark and Databricks to design, build, and optimize scalable data pipelines for processing massive datasets.Key Responsibilities:Build & Optimize Pipelines: Develop high-throughput ETL workflows using PySpark on...
-
PySpark Engineer
5 days ago
Hyderabad, Telangana, India Rapsys Technologies Pte. Ltd Full time ₹ 6,00,000 - ₹ 25,00,000 per yearRole: PySpark EngineerExperience Required: Minimum 5-10 YearsWork Location: Hyderabad (5 Days Work from Office)Job Type: Contract to Hire (1 Year/ Renewable)Notice Period: Immediate to 30 Days maxRequired skill sets and expertise:5+ years of experience in PySpark, Big Data technologies, Data Warehousing.Strong Python programming experience.Domain: Experience...
-
Pyspark + Databricks
2 days ago
Hyderabad, Telangana, India Cognizant Technology Solutions Full time ₹ 12,00,000 - ₹ 36,00,000 per yearJob SummaryWe are seeking a highly skilled Sr. Developer with 6 to 10 years of experience to join our team. The ideal candidate will have expertise in Databricks SQL Databricks Workflows and PySpark. Experience in the Cards & Payments domain is a plus. This is a hybrid work model with day shifts and no travel required.ResponsibilitiesDevelop and maintain...
-
PySpark & ETL Data Engineer
2 weeks ago
Hyderabad, Telangana, India CirrusLabs Full timeWe areCirrusLabs. Our vision is to become the world's most sought-after niche digital transformation company that helps customers realize value through innovation. Our mission is to co-create success with our customers, partners and community. Our goal is to enable employees to dream, grow and make things happen. We are committed to excellence. We are a...
-
Senior Pyspark Data Engineer
1 week ago
Hyderabad, Telangana, India DATAECONOMY Full time ₹ 12,00,000 - ₹ 24,00,000 per yearAbout UsAbout DATAECONOMY: We are a fast-growing data & analytics company headquartered in Dublin with offices inDublin, OH, Providence, RI, and an advanced technology center in Hyderabad,India. We are clearly differentiated in the data & analytics space via our suite of solutions, accelerators, frameworks, and thought leadership.Job DescriptionJob...
-
Python Pyspark Developer
7 days ago
Hyderabad, Telangana, India MatchPoint Full time ₹ 9,00,000 - ₹ 12,00,000 per yearType: PermanentLocation: Hyderabad (5 Days Onsite)Experience RequiredJob Description:We are seeking a skilledData Engineerwith strong expertise inPySpark Quries, Python programming, and Data Structures & Algorithms (DSA). The ideal candidate will design and optimize large-scale data pipelines, write efficient and scalable code, and solve complex data...
-
Hyderabad, Telangana, India Tata Consultancy Services Full time ₹ 4,00,000 - ₹ 6,00,000 per yearTCS Hiring Virtual Drive ***12-Nov-25 Python/Pyspark, Bigquery with GCP, Apache IcebergTCS - Hyderabad12 PM to 1 PMImmediate Joiners5 to 7 yearsRole**Python/Pyspark, Bigquery with GCP, Apache IcebergExp -5 to 7 yearsPlease read Job description before ApplyingNOTE: If the skills/profile matches and interested, please reply to this email by attaching your...
-
Senior PySpark/Python Developer
5 days ago
Hyderabad, Telangana, India Zorba Consulting Full time ₹ 12,00,000 - ₹ 24,00,000 per yearAbout The Role :We are seeking a highly skilled and experienced Senior PySpark/Python Developer to play a critical role in building a robust and reliable system for managing and disseminating customer notifications regarding PG&E's Planned Power Outages (PPOs). This is an exciting opportunity to tackle complex data challenges within a dynamic environment and...