Senior PySpark Developer
4 weeks ago
Job Title: Senior PySpark Developer
Job Summary:
We are seeking a highly skilled Senior PySpark Developer to join our team at Thinkwise Consulting LLP. As a Senior PySpark Developer, you will be responsible for designing, developing, and maintaining efficient and scalable solutions using PySpark and AWS Glue.
Key Responsibilities:
- Design and develop efficient and scalable solutions using PySpark and AWS Glue.
- Ensure data quality and integrity through rigorous testing, validation, and data cleansing processes.
- Integrate data from multiple sources such as databases, APIs, and external datasets.
- Optimize and tune PySpark jobs for enhanced performance and reliability.
- Document data engineering processes, workflows, and best practices.
Requirements:
- Strong programming skills in Python and proficiency with PySpark and SQL.
- Experience working with relational databases and big data technologies like Hadoop, Spark, Hive, and Impala.
- Excellent communication and collaboration abilities.
- Bachelor's or Master's degree in Engineering/Technology (BE/BTech or ME/MTech).
-
Senior PySpark Developer
4 weeks ago
Pune, Maharashtra, India Thinkwise Consulting LLP Full timeJob Title: Senior PySpark DeveloperJob Summary:We are seeking a highly skilled Senior PySpark Developer to join our team at Thinkwise Consulting LLP. As a Senior PySpark Developer, you will be responsible for designing, developing, and maintaining efficient and scalable solutions using PySpark and AWS Glue.Key Responsibilities:* Design and develop efficient...
-
Senior PySpark Developer
1 month ago
Pune, Maharashtra, India NewVision Software Full timeJob DescriptionJob Title: Senior PySpark DeveloperJob Summary: We are seeking a highly skilled Senior PySpark Developer to join our team at NewVision Software. The ideal candidate will have extensive experience in designing and implementing Big Data systems using PySpark, database migration, transformation, and integration solutions for Data warehousing...
-
PySpark Glue Developer
4 weeks ago
Pune, Maharashtra, India Thinkwise Consulting LLP Full timeJob Title: Senior Data Engineer - PySpark and AWS GlueJob Summary: We are seeking a highly skilled Senior Data Engineer to join our team at Thinkwise Consulting LLP. As a Senior Data Engineer, you will be responsible for designing, developing, and maintaining efficient and scalable data solutions using PySpark and AWS Glue.Key Responsibilities:Data...
-
Senior Pyspark Engineer
3 weeks ago
Pune, Maharashtra, India Evoke HR Solutions Pvt. Ltd. Full timeJob Title: Pyspark Lead / Databricks Lead / Senior Data EngineerExperience: 5.5 to 12 years of experience in Pyspark, Databricks, and Cloud (Azure or AWS)Key Responsibilities:Lead the development of Pyspark and Databricks projectsDesign and implement data engineering solutions using Pyspark and DatabricksCollaborate with cross-functional teams to deliver...
-
Senior PySpark Engineer Lead
4 weeks ago
Pune, Maharashtra, India DATAECONOMY Full timeJob Description:As a Senior PySpark Engineer Lead at DATAECONOMY, you will be responsible for leading a team of data engineers in the design and implementation of big data solutions using PySpark.You will collaborate with cross-functional teams to understand business needs and develop data-driven solutions.Design and implement scalable and robust data...
-
Senior PySpark Engineer
1 month ago
Pune, Maharashtra, India Tech Mahindra Full timeJob Summary:We are seeking a highly experienced Senior PySpark Engineer to lead our team in developing and implementing cutting-edge big data processing systems. The ideal candidate will have a strong background in PySpark, cloud computing, and software architecture.Key Responsibilities:Design and implement scalable big data processing systems using PySpark...
-
Senior PySpark Architect
3 weeks ago
Pune, Maharashtra, India Tech Mahindra Full timeAt Tech Mahindra, we are seeking an experienced Senior PySpark Architect to lead our big data processing initiatives. The ideal candidate will have a strong background in software architecture, with a focus on PySpark and big data processing systems.Key Responsibilities:Lead technical assignments to ensure timely and high-quality deliverables.Implement best...
-
Senior Data Engineer
1 month ago
Pune, Maharashtra, India Exusia Full timeJob Title: Senior Data Engineer (Developer) - Python/Pyspark/DatabricksExusia is seeking a highly skilled Senior Data Engineer (Developer) with expertise in Python/Pyspark/Databricks to join our global delivery team's Industry Analytics practice in India.Key Responsibilities:Design, develop, and maintain large-scale data engineering solutions using...
-
Pyspark Engineer
1 month ago
Pune, Maharashtra, India Evoke HR Solutions Pvt. Ltd. Full timeJob Title: Pyspark Lead / Databricks LeadJob Summary: We are seeking a highly skilled Pyspark Lead / Databricks Lead to join our team at Evoke HR Solutions Pvt. Ltd. The ideal candidate will have 6-12 years of experience in Pyspark, Databricks, Cloud, Big Data, and SQL.Key Responsibilities:Lead the development and implementation of Pyspark and Databricks...
-
PySpark Lead
4 weeks ago
Pune, Maharashtra, India DATAECONOMY Full timeJob Description:As a key member of the DATAECONOMY team, we are seeking a highly skilled PySpark Lead to lead the design and implementation of big data solutions.Collaborate with cross-functional teams to understand business needs and develop data-driven solutions that drive business growth.Design and implement scalable and robust data pipelines using...
-
PySpark Team Lead
1 month ago
Pune, Maharashtra, India DATAECONOMY Full timeJob OverviewLead a team of data engineers in the design and implementation of big data solutions using PySpark.As a PySpark Lead, you will be responsible for collaborating with cross-functional teams to understand business needs and develop data-driven solutions.Key responsibilities include designing and implementing scalable and robust data pipelines using...
-
PySpark Technology Lead
3 weeks ago
Pune, Maharashtra, India DATAECONOMY Full timeJob Title: PySpark LeadAbout the Role:DataEconomy is seeking a seasoned PySpark engineer to lead our team of data engineers in the design and implementation of big data solutions. This role involves collaborating with cross-functional teams to understand business needs and develop data-driven solutions.Responsibilities:Design and implement scalable and...
-
PySpark Team Lead
4 weeks ago
Pune, Maharashtra, India DATAECONOMY Full timeJob Title: PySpark Team LeadAbout the Role:At DATAECONOMY, we are seeking a highly skilled PySpark Team Lead to lead our team of data engineers in the design and implementation of big data solutions using PySpark. As a key member of our team, you will be responsible for collaborating with cross-functional teams to understand business needs and develop...
-
Pyspark Glue Engineer
2 weeks ago
Pune, Maharashtra, India Thinkwise Consulting LLP Full timeJob Title: Pyspark Glue EngineerAbout the Role:We are looking for a skilled Pyspark Glue Engineer to join our team at Thinkwise Consulting LLP. As a Pyspark Glue Engineer, you will be responsible for designing, developing, and maintaining efficient and scalable solutions using PySpark and AWS Glue. You will ensure data quality and integrity through rigorous...
-
PySpark Lead
1 month ago
Pune, Maharashtra, India DATAECONOMY Full timeJob Title: PySpark LeadJob Summary:We are seeking a highly experienced PySpark Lead to join our team at DATAECONOMY. As a key member of our data engineering team, you will be responsible for leading the design and implementation of big data solutions using PySpark.Key Responsibilities:* Lead a team of data engineers in the design and implementation of big...
-
Pyspark Lead/ Databricks Engineer
3 weeks ago
Pune, Maharashtra, India Evoke HR Solutions Pvt. Ltd. Full timeJob Title: Pyspark Lead / Databricks LeadAbout the Role: We are seeking an experienced Pyspark Lead / Databricks Lead to join our team at Evoke HR Solutions Pvt. Ltd. As a Pyspark Lead / Databricks Lead, you will be responsible for leading the development and implementation of Pyspark and Databricks solutions.Key Responsibilities:Lead the development and...
-
Data Engineer Azure Pyspark
4 weeks ago
Pune, Maharashtra, India Overture Rede Private Limited Full timeJob Title: Data EngineerLocation: RemoteJob Summary:Overture Rede Private Limited is seeking a highly skilled Data Engineer to design, build, and maintain scalable data pipelines using PySpark on Data bricks. The ideal candidate will have hands-on experience in writing PySpark scripts and managing Spark clusters, as well as expertise in Delta Lake features...
-
Senior Software Developer
2 weeks ago
Pune, Maharashtra, India Radical Technologies Full timeAt Radical Technologies, we are seeking a highly skilled Senior Software Developer to join our team. As a key member of our engineering team, you will be responsible for designing and implementing scalable data solutions using Cloud computing platforms such as Azure.Key Responsibilities:Develop and implement data pipelines using Data bricks and Data...
-
Senior Python Developer
4 weeks ago
Pune, Maharashtra, India DATAECONOMY Full timeJob Title: Senior Python DeveloperJob Overview:We are seeking a highly skilled Senior Python Developer to join our team at DATAECONOMY. The ideal candidate will have extensive experience with Python development and working with large datasets in distributed computing environments. You will be responsible for designing, implementing, and optimizing data...
-
Pune, Maharashtra, India BirlaSoft Full timeAzure Data Engineer with Databricks and PySpark RoleJob Summary:The ideal candidate for this position will have experience in performing design, development, and deployment using Azure services, specifically Data Factory, Databricks, PySpark, and SQL. They will be responsible for developing and maintaining scalable data pipelines and building new data source...