Consultant - PySpark
21 hours ago
About KPMG in India
KPMG entities in India are professional services firm(s). These Indian member firms are affiliated with KPMG International Limited. KPMG was established in India in August 1993. Our professionals leverage the global network of firms, and are conversant with local laws, regulations, markets and competition. KPMG has offices across India in Ahmedabad, Bengaluru, Chandigarh, Chennai, Gurugram, Jaipur, Hyderabad, Jaipur, Kochi, Kolkata, Mumbai, Noida, Pune, Vadodara and Vijayawada.
KPMG entities in India offer services to national and international clients in India across sectors. We strive to provide rapid, performance-based, industry-focused and technology-enabled services, which reflect a shared knowledge of global and local industries and our experience of the Indian business environment.
Experience: 3–8 years
What We're Looking For
We're hiring a Spark Scala Developer who has real-world experience working in Big Data environments, both on-prem and/or in the cloud. You should know how to write production-grade Spark applications, fine-tune performance, and work fluently with Scala's functional style. Experience with cloud platforms and modern data tools like Snowflake or Databricks is a strong plus.
⸻
Your Responsibilities
• Design and develop scalable data pipelines using Apache Spark and Scala
• Optimize and troubleshoot Spark jobs for performance (e.g. memory management, shuffles, skew)
• Work with massive datasets in on-prem Hadoop clusters or cloud platforms like AWS/GCP/Azure
• Write clean, modular Scala code using functional programming principles
• Collaborate with data teams to integrate with platforms like Snowflake, Databricks, or data lakes
• Ensure code quality, documentation, and CI/CD practices are followed
⸻
Must-Have Skills
• 3+ years of experience with Apache Spark in Scala
• Deep understanding of Spark internals—DAG, stages, tasks, caching, joins, partitioning
• Hands-on experience with performance tuning in production Spark jobs
• Proficiency in Scala functional programming (e.g. immutability, higher-order functions, Option/Either)
• Proficiency in SQL
• Experience with any major cloud platform: AWS, Azure, or GCP
⸻
Nice-to-Have
• Worked with Databricks, Snowflake, or Delta Lake
• Exposure to data pipeline tools like Airflow, Kafka, Glue, or BigQuery
• Familiarity with CI/CD pipelines and Git-based workflows
• Comfortable with SQL optimization and schema design in distributed environments
Equal employment opportunity information
KPMG India has a policy of providing equal opportunity for all applicants and employees regardless of their color, caste, religion, age, sex/gender, national origin, citizenship, sexual orientation, gender identity or expression, disability or other legally protected status. KPMG India values diversity and we request you to submit the details below to support us in our endeavor for diversity. Providing the below information is voluntary and refusal to submit such information will not be prejudicial to you.
-
Pyspark with Scala
2 weeks ago
Bengaluru, Karnataka, India Wipro Full time ₹ 6,00,000 - ₹ 18,00,000 per yearJob DescriptionJob Title: Pyspark with ScalaReq Id: 59596City: BengaluruState/Province: KarnatakaPosting Start Date: 8/13/25Wipro Limited (NYSE: WIT, BSE: 507685, NSE: WIPRO) is a leading technology services and consulting company focused on building innovative solutions that address clients' most complex digital transformation needs. Leveraging our holistic...
-
DataBricks Consultant
1 week ago
Bengaluru, Karnataka, India GyanSys Inc. Full time ₹ 15,00,000 - ₹ 25,00,000 per yearIn this position you will be responsible for providing insights to clients. To do so, you will first meet with our clients to uncover their business needs and challenges. Then, you will use your strong analytical skills to perform quantitative and observational data analyses. From these analyses, you will form and present your recommendations to our...
-
Consultant
1 week ago
Bengaluru, Karnataka, India Genpact Full time ₹ 5,00,000 - ₹ 15,00,000 per yearGenpact (NYSE\: G) is a global professional services and solutions firm delivering outcomes that shape the future. Our 125,000+ people across 30+ countries are driven by our innate curiosity, entrepreneurial agility, and desire to create lasting value for clients. Powered by our purpose – the relentless pursuit of a world that works better for people –...
-
Bengaluru, Karnataka, India Infosys Full time ₹ 20,00,000 - ₹ 25,00,000 per yearJob Description:Infosys Consulting the management consulting business of Infosys is looking to hire Data EngineerYou should have between 3 to 10 years of Data Engineering experienceSuccessful candidates will be part of a specialised customer facing Advanced Analytics team in our rapidly expanding Automation Artificial Intelligence Consulting PracticeThey...
-
AWS Data Engineer
1 week ago
Bengaluru, Karnataka, India Acenet consulting Full time ₹ 6,00,000 - ₹ 18,00,000 per yearExperience: 5 to 8 yearsLocation: Bengaluru, Gurgaon, PuneJob code: 101356Posted on: Oct 27, 2025About Us:AceNet Consulting is a fast-growing global business and technology consulting firm specializing in business strategy, digital transformation, technology consulting, product development, start-up advisory and fund-raising services to our global clients...
-
Consultant
2 days ago
Bengaluru, Karnataka, India BSR & Co Full time ₹ 9,00,000 - ₹ 12,00,000 per yearDescriptionThis role is responsible to provide operational support for Azure Data Lake along with Databricks, ADLS and Data FactoryResponsibilities• Responsible for user provisioning, access controls and group administration• Manage –- Databricks clusters and permissions- Azure Data Storage, key vault, Tokens, and...
-
Databricks, AWS Architect, Pyspark
1 week ago
Bengaluru, Karnataka, India Infosys Full time ₹ 12,00,000 - ₹ 36,00,000 per yearJob Description:Experience in developing and maintaining data quality checksExperience in developing and maintaining data governance policies and proceduresExperience in developing and maintaining data security policies and proceduresKey Responsibilities:A day in the life of an InfoscionAs part of the Infosys consulting team your primary role would be to...
-
Associate Consultant
1 week ago
Bengaluru, Karnataka, India KPMG Global Services Full time ₹ 6,00,000 - ₹ 18,00,000 per yearJob RequirementsMandatory SkillsBachelors or higher degree in Computer Science or a related discipline; or equivalent (minimum 4 years work experience). At least 2+ years of consulting or client service delivery experience on Azure Data Solution At least 2+ years of experience in developing data ingestion, data processing and analytical pipelines for big...
-
T&T- EAD- ADMM- Consultant
1 week ago
Bengaluru, Karnataka, India Deloitte Full time ₹ 12,00,000 - ₹ 24,00,000 per yearJob requisition ID :: 90942Date: Oct 30, 2025Location: BengaluruDesignation: ConsultantEntity: Deloitte Touche Tohmatsu India LLPWhat impact will you make?Every day, your work will make an impact that matters, while you thrive in a dynamic culture of inclusion, collaboration and high performance. As the undisputed leader in professional services, Deloitte is...
-
Databricks, PySpark, IICS
24 hours ago
Bengaluru, Karnataka, India Infosys Full time ₹ 12,00,000 - ₹ 36,00,000 per yearKey Responsibilities:A day in the life of an InfoscionAs part of the Infosys consulting team your primary role would be to get to the heart of customer issues diagnose problem areas design innovative solutions and facilitate deployment resulting in client delightYou will develop a proposal by owning parts of the proposal document and by giving inputs in...