![Deloitte](https://media.trabajo.org/img/noimg.jpg)
PySpark Developer
2 weeks ago
Deloitte India is hiring for PySpark Developer
Level: Deputy Manager
Location: Bangalore/Delhi NCR/Mumbai
Job Type: Full-time
Experience Required: 4-6 years
Job Summary:
We are seeking a talented and experienced Deputy Manager - PySpark Developer with 4 to 6 years of experience to join our dynamic team. The ideal candidate will possess extensive expertise in PySpark, big data technologies, and data engineering practices. As a Deputy Manager, you will play a critical role in developing and optimizing data processing pipelines, ensuring data quality, and collaborating with cross-functional teams to deliver high-impact data solutions.
Key Responsibilities:
PySpark Development:
- Design, develop, and maintain scalable and efficient PySpark applications to process large datasets.
- Write clean, maintainable, and efficient code following best practices and coding standards.
- Optimize and tune PySpark jobs to improve performance and reduce execution times.
Big Data Technologies:
- Work with big data tools and frameworks such as Hadoop, Hive, and Spark to manage and process large-scale data.
- Implement and maintain data pipelines using Apache Airflow or similar orchestration tools.
- Ensure data is ingested, processed, and stored in an optimal manner for further analysis and reporting.
Data Engineering:
- Design and implement ETL processes to extract, transform, and load data from various sources.
- Ensure data quality and consistency through robust validation and testing procedures.
- Collaborate with data scientists and analysts to understand data requirements and deliver solutions that meet their needs.
Cloud Integration:
- Deploy and manage big data solutions on cloud platforms such as AWS, Azure, or Google Cloud.
- Leverage cloud services for storage, computing, and data processing to enhance scalability and performance.
- Optimize cloud resource utilization to reduce costs and improve efficiency.
Collaboration and Communication:
- Work closely with cross-functional teams, including data scientists, analysts, and business stakeholders, to understand requirements and deliver data solutions.
- Communicate effectively with team members and stakeholders, providing regular updates on project status.
- Document technical designs, processes, and procedures to ensure knowledge sharing and continuity.
Continuous Improvement:
- Stay up-to-date with the latest industry trends and technologies in big data and data engineering.
- Identify opportunities for process improvement and implement best practices to enhance productivity and efficiency.
- Participate in code reviews and provide constructive feedback to ensure code quality and maintainability.
Qualifications:
- Bachelor's degree in Computer Science, Data Science, or a related field.
- 4-6 years of professional experience in PySpark development and big data technologies.
- Strong understanding of distributed computing and parallel processing concepts.
- Proficiency in SQL and experience with data warehousing solutions.
- Familiarity with data modeling, ETL processes, and data pipeline orchestration.
- Experience with cloud platforms (e.g., AWS, Azure, GCP) and related services.
- Solid understanding of data structures, algorithms, and software engineering principles.
- Excellent problem-solving skills and attention to detail.
- Strong communication and interpersonal skills.
Preferred Qualifications:
- Relevant certifications (e.g., Databricks Certified Associate Developer for Apache Spark).
- Experience with real-time data processing and streaming technologies (e.g., Kafka, Flink).
- Knowledge of machine learning frameworks and libraries.
- Familiarity with containerization technologies (e.g., Docker, Kubernetes).
- Experience with version control systems (e.g., Git).
How you’ll grow
Connect for impact
Our exceptional team of professionals across the globe are solving some of the world’s most complex business problems, as well as directly supporting our communities, the planet, and each other. Know more in our Global Impact Report and our India Impact Report.
Empower to lead
You can be a leader irrespective of your career level. Our colleagues are characterised by their ability to inspire, support, and provide opportunities for people to deliver their best and grow both as professionals and human beings. Know more about Deloitte and our One Young World partnership.
Inclusion for all
At Deloitte, people are valued and respected for who they are and are trusted to add value to their clients, teams and communities in a way that reflects their own unique capabilities. Know more about everyday steps that you can take to be more inclusive. At Deloitte, we believe in the unique skills, attitude and potential each and every one of us brings to the table to make an impact that matters.
Drive your career
At Deloitte, you are encouraged to take ownership of your career. We recognise there is no one size fits all career path, and global, cross-business mobility and up / re-skilling are all within the range of possibilities to shape a unique and fulfilling career. Know more about Life at Deloitte.
Everyone’s welcome… entrust your happiness to us
Our workspaces and initiatives are geared towards your 360-degree happiness. This includes specific needs you may have in terms of accessibility, flexibility, safety and security, and caregiving. Here’s a glimpse of things that are in store for you.
Interview tips
We want job seekers exploring opportunities at Deloitte to feel prepared, confident and comfortable. To help you with your interview, we suggest that you do your research, know some background about the organisation and the business area you’re applying to. Check out recruiting tips from Deloitte professionals.
-
Lead PySpark Developer
2 weeks ago
bangalore, India LTIMindtree Full timeJob Description: Primary Skill Set: Lead PySpark Developer Seconday Skill Set: SAS tools Lead a team of data engineers in the design and implementation of big data solutions using PySpark. Collaborate with cross-functional teams to understand business needs and develop data-driven solutions. Design and implement scalable and robust data pipelines...
-
PySpark Developer
2 weeks ago
bangalore, India Deloitte Full timeDeloitte India is hiring for PySpark DeveloperLevel: Deputy ManagerLocation: Bangalore/Delhi NCR/MumbaiJob Type: Full-timeExperience Required: 4-6 yearsJob Summary:We are seeking a talented and experienced Deputy Manager - PySpark Developer with 4 to 6 years of experience to join our dynamic team. The ideal candidate will possess extensive expertise in...
-
Pyspark Developer
3 months ago
bangalore, India Corporate Resources Full timeJob Description Designing and developing big data applications using the PySpark framework to meet the needs of the business Writing and optimizing Spark SQL statements to extract and manipulate large datasets Developing and deploying Spark algorithms to perform data processing and analytics tasks,...
-
PySpark Developer
2 weeks ago
bangalore, India Deloitte Full timeDeloitte India is hiring for PySpark Developer Level: Deputy Manager Location: Bangalore/Delhi NCR/Mumbai Job Type: Full-time Experience Required: 4-6 years Job Summary: We are seeking a talented and experienced Deputy Manager - PySpark Developer with 4 to 6 years of experience to join our dynamic team. The ideal candidate will possess extensive...
-
Pyspark
3 days ago
bangalore, India Alp Consulting Limited Full timeProject Role : Software Development Engineer Project Role Description : Analyze, design, code and test multiple components of application code across one or more clients. Perform maintenance, enhancements and/or development work. Must have skills : PySpark Good to have skills : NA Educational Qualification : BE Bachelor of Engineering Project Role :...
-
AM-Pyspark Developer
1 month ago
bangalore, India Genpact Full timeWith a startup spirit and 115,000+ curious and courageous minds, we have the expertise to go deep with the world’s biggest brands—and we have fun doing it. We dream in digital, dare in reality, and reinvent the ways companies work to make an impact far bigger than just our bottom line. We’re harnessing the power of technology and humanity to create...
-
AM-Pyspark Developer
3 weeks ago
bangalore, India Genpact Full timeWith a startup spirit and 115,000+ curious and courageous minds, we have the expertise to go deep with the world’s biggest brands—and we have fun doing it. We dream in digital, dare in reality, and reinvent the ways companies work to make an impact far bigger than just our bottom line. We’re harnessing the power of technology and humanity to create...
-
Pyspark Developer
2 days ago
bangalore, India Wipro Full timeResponsibilities: Execute data analysis tasks guided by the architect and lead. (cluster/process log analysis, code profiling, metrics gathering). Analyze Hive, Spark, Kafka, Hbase, spark streaming processes for identifying performance improvement opportunities Recommended optimizations for data storage, Hbase, HDFS. Assist with migration impact analysis and...
-
Python+Pyspark
3 weeks ago
bangalore, India Wissen Full timeWissen Technology is now hiringPython+Pyspark We are seeking a skilled Python Developer with a strong background in PySpark to develop and optimize data processing applications. The ideal candidate will be responsible for building robust and scalable data processing solutions using Python and PySpark. Experience–4-8years Location:Bangalore ...
-
Python Pyspark Lead
2 months ago
bangalore, India Virtusa Full timePython Pyspark Lead - CREQ187226 Description Design and develop on Hadoop applications,Hands on in developing Jobs in pySpark with Python/ SCALA (Preferred) or Java/ SCALAExperience on Core Java, Experience on Map Reduce programs, Hive programming, Hive queries performance conceptsExperience on source code management with Git repositoriesSecondary...
-
Python Pyspark Lead
3 weeks ago
bangalore, India Virtusa Full timePython Pyspark Lead - CREQ187226 Description Design and develop on Hadoop applications,Hands on in developing Jobs in pySpark with Python/ SCALA (Preferred) or Java/ SCALAExperience on Core Java, Experience on Map Reduce programs, Hive programming, Hive queries performance conceptsExperience on source code management with Git repositoriesSecondary...
-
ETL Developer
3 weeks ago
Bangalore, India IT Full timeWe are seeking a skilled ETL Developer with a total of 5 years of experience, including a minimum of 2 to 3 years of hands-on experience with Data Bricks. Proficiency in Python and PySpark is essential for this - Develop, implement, and maintain ETL processes for data integration, transformation, and loading.- Collaborate with stakeholders to understand...
-
ETL Developer
2 months ago
Bangalore, India IT Full timeWe are seeking a skilled ETL Developer with a total of 5 years of experience, including a minimum of 2 to 3 years of hands-on experience with Data Bricks. Proficiency in Python and PySpark is essential for this - Develop, implement, and maintain ETL processes for data integration, transformation, and loading.- Collaborate with stakeholders to understand...
-
Tableau Developer
3 months ago
Bangalore,Chennai, India Sam manpower services & Career LLP Full timeTableau Developer - Develop Tableau dashboards and reports to visualize business metrics, KPIs, and trends, based on stakeholder requirements.- Collaborate with data engineers to access and prepare data from various sources, ensuring data quality and integrity for Tableau visualizations.- Optimize Tableau dashboards for performance and usability,...
-
Senior Python Developer
3 weeks ago
Bangalore, India Spruce IT Pvt. Ltd. Full timeJob Role: Sr Python Developer. Skills: PySpark / Flink / Apache Spark / Scala. Experience: 6+ years. Location: Pan India. JD: - Sr Python Developer.- Must have Hands on experience- in python.- Develop pipeline objects using PySpark / Flink / Apache Spark / Scala. - Candidates preferred who have experience in building real-time data streams using Flink and...
-
Senior Python Developer
3 months ago
Bangalore, India Spruce IT Pvt. Ltd. Full timeJob Role: Sr Python Developer. Skills: PySpark / Flink / Apache Spark / Scala. Experience: 6+ years. Location: Pan India. JD: - Sr Python Developer.- Must have Hands on experience- in python.- Develop pipeline objects using PySpark / Flink / Apache Spark / Scala. - Candidates preferred who have experience in building real-time data streams using Flink and...
-
PySpark Data System Engineer
3 months ago
bangalore, India Anicalls (Pty) Ltd Full time• PySpark Developer / PySpark Data Engineer• Should have at least three years of strong experience in PySpark• Strong SQL Expertise• Strong communication and client-facing skills
-
Pyspark/Hadoop Developer
1 month ago
bangalore, India 12542 Citicorp Services India Private Limited Full timeData Engineer: The Data Engineer is responsible for building Data Engineering Solutions using next generation data techniques. The individual will be working with tech leads, product owners, customers and technologists to deliver data products/solutions in a collaborative and agile environment. Responsibilities: Responsible for design and...
-
Pyspark
1 week ago
bangalore district, India Alp Consulting Limited Full timeJob description Title-Hadoop Developer Must Skill-Hadoop + Pyspark Years of Exp-4-6 Years Location: Whitefield, Bangalore Shift Time- General Shift (9 am- 6 pm) Job Title: Hi Applicants Hiring for a Job in a Reputed Organization(Product and Service based company) . Here is a Gateway to it, through ALP Consulting. Recruiting Employment Type:...
-
PySpark Data Engineer
1 week ago
bangalore, India Edstem Technologies Full timeWe are seeking a talented and experienced PySpark Data Engineer to join our dynamic team. The ideal candidate will have a strong background in data engineering, a passion for big data technologies, and the ability to work in a fast-paced, collaborative environment.Willing to work in Location: Trivandrum, Bengaluru, ChennaiKey Responsibilities:Data Pipeline...