Pyspark Lead

1 week ago


Bengaluru, Karnataka, India CIEL HR Services Full time

We are hiring for our client-An International IT service providerRole- Pyspark LeadMandatory skill set- Python+Spark+Scala(experience in all 3 skill sets should be strong & mandatory) ,Data Engineering+ AWSExp.

Level- 5-12 yrsLocation- Bangalore & HyderabadNotice Period-Immediate to 15days

Job DescriptionDesign and implement scalable and robust ELT processes using Python, Scala,and Apache Spark.
  • Collaborate with data scientists, analysts, and other stakeholders to understanddata requirements and ensure the timely delivery of high-quality data solutions.
  • Optimize and troubleshoot data-related issues to ensure data quality, reliability,and performance.
  • Implement best practices for data security, privacy, and compliance.
  • Work closely with cross-functional teams to integrate data solutions into existingsystems and processes.
  • Continuously evaluate and implement emerging technologies to enhance dataprocessing efficiency.


  • Bengaluru, Karnataka, India LTIMindtree Full time

    Job Description: Primary Skill Set: Lead PySpark Developer Seconday Skill Set: SAS tools Lead a team of data engineers in the design and implementation of big data solutions using PySpark. Collaborate with cross-functional teams to understand business needs and develop data-driven solutions. Design and implement scalable and robust data pipelines using...

  • Python Pyspark Lead

    1 week ago


    Bengaluru, Karnataka, India Virtusa Full time

    Python Pyspark Lead - CREQ187226 Description Design and develop on Hadoop applications,Hands on in developing Jobs in pySpark with Python/ SCALA (Preferred) or Java/ SCALAExperience on Core Java, Experience on Map Reduce programs, Hive programming, Hive queries performance conceptsExperience on source code management with Git repositoriesSecondary...


  • Bengaluru, Karnataka, India LTIMindtree Full time

    Job Description:Primary Skill Set:Lead Py Spark Developer Seconday Skill Set: SAS tools Lead a team of data engineers in the design and implementation of big data solutions using Py Spark.Collaborate with cross-functional teams to understand business needs and develop data-driven solutions.Design and implement scalable and robust data pipelines using Py...


  • Bengaluru, Karnataka, India NAM Info Inc Full time

    AWS Data Engineer with PySpark Domain: Clinical / pharma/ healthcare Location: Bangalore or Chennai / Kolkata / Hyderabad Preferred Skills: AWS and Python and or PySpark AWS Redshift, Aurora, AWS Glue , AWS Lambda, etc. Extensive experience with Data gathering and ingestion (from multiple sources), and manipulation, orchestration and optimization on...


  • Bengaluru, Karnataka, India NAM Info Inc Full time

    AWS Data Engineer with PySparkDomain: Clinical / pharma/ healthcareLocation: Bangalore or Chennai / Kolkata / Hyderabad Preferred Skills:AWS and Python and or PySparkAWS Redshift, Aurora, AWS Glue, AWS Lambda, etc.Extensive experience with Data gathering and ingestion (from multiple sources), and manipulation, orchestration and optimization on AWS CloudSpark...


  • Bengaluru, Karnataka, India Genpact Full time

    Genpact (NYSE:G) is a global professional services and solutions firm delivering outcomes that shape the future. Our 125,000+ people across 30+ countries are driven by our innate curiosity, entrepreneurial agility, and desire to create lasting value for clients. Powered by our purpose – the relentless pursuit of a world that works better for people – we...


  • Bengaluru, Karnataka, India Genpact Full time

    Genpact (NYSE:G) is a global professional services and solutions firm delivering outcomes that shape the future. Our 125,000+ people across 30+ countries are driven by our innate curiosity, entrepreneurial agility, and desire to create lasting value for clients. Powered by our purpose – the relentless pursuit of a world that works better for people – we...


  • Bengaluru, Karnataka, India Global Pharma Tek Full time

    Role: Azure Data Engineer At least years' experience driving impact in a similar capacity at companies creating cutting edge tech using Azure Cloud Experience as Azure Data Engineer Azure Cloud + Azure Data Factory + Azure Data Bricks + Azure SQL + Pyspark Proven experience deploying machine learning algorithms to production Demonstrated proficiency in...


  • Bengaluru, Karnataka, India Global Pharma Tek Full time

    Role: Azure Data Engineer At least years' experience driving impact in a similar capacity at companies creating cutting edge tech using Azure Cloud Experience as Azure Data Engineer Azure Cloud + Azure Data Factory + Azure Data Bricks + Azure SQL + Pyspark Proven experience deploying machine learning algorithms to production Demonstrated proficiency in...


  • Bengaluru, Karnataka, India LTIMindtree Full time

    Mandatory Skills: Python, Oracle database, PySpark, Scala, SQL, Data Warehousing, NoSQL DatabasesJob Location – Any LTIMINDTREEExperience - 6 to 9 yearsNotice Period Immediate 45 days maxSkills and Qualifications:Experience level for the 7 to 9 years of experienceCompetency Senior LeadLocation Offshore Bangalore IndiaRequested skills Python Database...


  • Bengaluru, Karnataka, India Impetus Technologies Full time

    Job Tittle Lead Databricks EngineerDatabricks Engineers with 2 6 years of hand on experience in Pyspark, Cloud Platform and SQL.Proven experience in designing and implementing data solutions on the Databricks platform with hands on experience in setting up Databricks cluster, working in Databricks modules, data pipelines for ingesting and transforming data...


  • Bengaluru, Karnataka, India LTIMindtree Full time

    Mandatory Skills: Python, Oracle database, PySpark, Scala, SQL, Data Warehousing, NoSQL DatabasesJob Location – Any LTIMINDTREEExperience - 6 to 9 yearsNotice Period - Immediate - 45 days maxSkills and Qualifications:Experience level for the 7 to 9 years of experienceCompetency Senior LeadLocation Offshore Bangalore IndiaRequested skills Python Database...


  • Bengaluru, Karnataka, India LTIMindtree Full time

    Mandatory Skills:Python, Oracle database, PySpark, Scala, SQL, Data Warehousing, NoSQL DatabasesJob Location– Any LTIMINDTREEExperience 6 to 9 yearsNoticePeriod -Immediate - 45 days maxSkills and Qualifications:Experience level for the 7 to 9 years of experienceCompetency Senior LeadLocation Offshore Bangalore IndiaRequested skills Python Database...

  • Tech Lead

    1 week ago


    Bengaluru, Karnataka, India Virtusa Full time

    Tech Lead - CREQ188370 DescriptionJOB DESCRIPTIONSkill: Java DeveloperDesired Skill setKey skills : Python, Pyspark, Spark, AWS Glue, Java ( Good to have ) Candidate should have the following skills Oracle SOA Suite 12C, SOA Developer, SOQ Administration. In-depth knowledge of Oracle SOA Suite architecture, design patterns, and best practices Experience on...


  • Bengaluru, Karnataka, India Damco Solutions Full time

    Position Title: Databricks Developer/ Lead || ETL || Data ModelingExperience: 4 to 9 YearsLocation BengaluruImmediate JoinersHands-on experience in Azure data bricks & Pyspark to develop ETL pipelinesWorking experience in ETL testing including Master Data Management, Data Completeness Data Cataloging, Data Leverage, and Data Quality for various data feeds...

  • Lead Consultant

    1 week ago


    Bengaluru, Karnataka, India Genpact Full time

    Responsibilities:Responsible for development based on client prioritization and approvalSupport client technical architects in conducting PoCs, including cost evaluations, of various AWS services and other toolsDevelop data ingress frameworks using the AWS tech stack like AWS Glue, Athena, Databricks, Python, Pyspark, SQLDesign and development of the...

  • Lead Data Engineer

    1 week ago


    Bengaluru, Karnataka, India Brillio Full time

    Azure Data Lead 6 - 8 years of experience as Tech Lead in Azure data technologies Hands on development experience in Azure stack- Azure Data Factory, Azure Data Lake, Azure Synapse, Azure SQL, Azure DevOps Desired to have implementation experience in PySpark, Microsoft Fabric, Purview, and PowerBI Strong experience in architecture, design and...


  • Bengaluru, Karnataka, India 12542 Citicorp Services India Private Limited Full time

    Lead Data Engineer:The Lead Data Engineer is responsible for building Data Engineering Solutions using next generation data techniques. The individual will be working directly with product owners, customers and technologists to deliver data products/solutions in a collaborative and agile environment.Responsibilities:Responsible for design and development of...


  • Bengaluru, Karnataka, India Extreme Networks Full time

    Extreme Networks Named to Computerworld's 2023 List of Best Places to Work in ITOver 50,000 customers globally trust our end-to-end, cloud-driven networking solutions and rely on our top-rated services and support to accelerate their digital transformation efforts and deliver progress like never before and with double digit growth year over year, no provider...


  • Bengaluru, Karnataka, India Genpact Full time

    Responsibilities Responsible for development based on client prioritization and approval Support client technical architects in conducting PoCs , including cost evaluations, of various AWS services and other tools Develop data ingress frameworks using the AWS tech stack like AWS Glue, Athena, Databricks, Python, Pyspark, SQL Design and development of the...