Current jobs related to PySpark Tech Lead - Anywhere in IndiaMultiple Locations - TD Newton & Associates

  • Pyspark Tech Lead

    3 days ago

    india Tech Mahindra Full time

    7-10 yearsTech lead with some management expStrong relevant experience of 8 years in pySpark, Bigdata with ADLS Gen 27+ years of experience in software architecture with a strong focus on PySpark and big data processing systems.Key Requirements:Cloud ProficiencyStrong in Pyspark, Python, or Shell scriptingCI/CD pipelines and application monitoring...

  • Tech Lead

    3 months ago

    Anywhere in India/Multiple Locations Hiret Full time

    Job Title : Tech Lead Job Description :We are looking for an experienced and passionate Tech Lead to join our e-commerce organization for Order Processing Domain. The ideal candidate should have a strong background in microservices API integrations, software development, and e-commerce. The role requires excellent leadership skills, a deep understanding of...

  • Tech Lead Data Engineer

    3 weeks ago

    India Perfios Full time

    About Perfios Founded in 2008, Perfios is a global B2B SaaS fintech serving the Banking, Financial Services and Insurance industry in 18 countries , empowering 1000+ Financial Institutions . Through its pioneering software platforms and products, Perfios helps Financial Institutions take big leaps by shaping their origination, onboarding,...

  • GCP Data Architect

    4 months ago

    Anywhere in India/Multiple Locations Huquo Full time

    Role : GCP Data Architect Description : As a GCP Data Architect, you will be responsible for architecting enterprise data solutions for migration, transformation or modernization on Google Cloud Platform (GCP) integrating native GCP services and other 3rd party data solutions. You will collaborate with cloud partners and our cross-functional teams to...

  • Process mining Engineer

    2 weeks ago

    india CAPCO Full time

    Process mining Engineer -Pyspark at Capco India Job Title: Process Mining Engineer Location: Bangalore / Chennai NP > 30 Days About Us “Capco, a Wipro company, is a global technology and management consulting firm. Awarded with Consultancy of the year in the British Bank Award and has been ranked Top Best Companies...

  • Process mining Engineer

    1 week ago

    india CAPCO Full time

    Process mining Engineer -Pyspark at Capco India Job Title: Process Mining Engineer Location: Bangalore / Chennai NP > 30 Days About Us “Capco, a Wipro company, is a global technology and management consulting firm. Awarded with Consultancy of the year in the British Bank Award and has been ranked Top Best Companies for Women in...

  • Software Engineering Lead

    3 months ago

    Anywhere in India/Multiple Locations Strategic Talent Partner Full time

    About Role :Software engineering lead provides technical expertise and leadership in design and development of high-quality software using industry standard best practices for new development of cloud native solutions.Duties & Responsibilities :- Being a hands-on contributor is a key responsibility in this role.- Executes the full SDLC from business...

  • QA Tech Lead

    3 weeks ago

    India Kitecyber Full time

    Company Description Kitecyber is a cybersecurity company specializing in securing and protecting modern organizations against SaaS and internet-based attacks. Using a patented AI-based approach, Kitecyber helps organizations discover and secure their SaaS apps and cloud APIs, eliminating unsanctioned app sprawl and preventing sensitive data exfiltration...

  • QA Tech Lead

    6 months ago

    India Kitecyber Full time

    Company DescriptionKitecyber is a cybersecurity company specializing in securing and protecting modern organizations against SaaS and internet-based attacks. Using a patented AI-based approach, Kitecyber helps organizations discover and secure their SaaS apps and cloud APIs, eliminating unsanctioned app sprawl and preventing sensitive data exfiltration and...

  • QA Tech Lead

    6 months ago

    india Kitecyber Full time

    Company Description Kitecyber is a cybersecurity company specializing in securing and protecting modern organizations against SaaS and internet-based attacks. Using a patented AI-based approach, Kitecyber helps organizations discover and secure their SaaS apps and cloud APIs, eliminating unsanctioned app sprawl and preventing sensitive data exfiltration and...

  • Technical Lead

    4 days ago

    Anywhere in India/Multiple Locations Calyptus Full time

    Job Description : Expectations and Responsibilities :As a non-exhaustive list of desirable traits, the ideal candidate :- Had demonstrable full-stack technical skills in frontend as well as web3 backend and infrastructure, ideally via open-source code, or strong referrals if failing that.- Has a good conceptual understanding of the architecture of EVM...

  • Data Analyst

    1 week ago

    india Tech Mahindra Full time

    The ideal candidate will use their passion for big data and analytics to provide insights to the business covering a range of topics. They will be responsible for conducting both recurring and ad hoc analysis for business users. Responsibilitiesa) Oracle to BQ DWH migration and Modernization b) Big Query, DataProc, GCS, PySpark, Airflow, Hadoop Ecosystem c)...

  • Lead Data Engineer

    3 months ago

    india TIU Consulting Full time

    Job Description : - Design, build and maintain highly scalable and available big data solutions on AWS cloud - Develop and manage AWS Glue data catalog, crawlers, and ETL jobs- Design and implement data synchronization solutions using AWS Datasync- Manage and optimize S3 data storage and access patterns- Develop and maintain Infrastructure as Code (IaC)...

  • Technical Lead

    4 months ago

    Anywhere in India/Multiple Locations/Bangalore iMind Your Business Solutions Private Limited Full time

    Technical Lead : React.JS, Node.JS, AWSOur Client is an AI Tech product company Headquartered in London UK and developing an AI powered enterprise platform that enables insurers the flexibility to scale capacity as needed, safely, securely, efficiently and at speed. Intelligent and flexible, tool understands global insurance processing challenges, and...

  • Lead Blockchain Developer

    4 months ago

    Anywhere in India/Multiple Locations Ment Tech Labs Pvt. Ltd. Full time

    Job Title : Senior Blockchain Developer Job Description : We are seeking a highly skilled Senior Blockchain Developer to join our team. The ideal candidate will have extensive experience in Ethereum, Bitcoin, Solana, and related technologies, with a strong focus on smart contracts and node setup. The candidate should be proficient in Solidity using tools...

  • Etl Testing

    4 months ago

    India Novature Tech Full time

    Keywords: ETL Testing, SQL, AWS, PYSPARK **Experience**: 4 - 10 years Designation / Role: ETL Test Engineer **Location**: INDIA **Job Description**: Looking for Strong Experience in ETL Testing Skills Required: ETL Testing, SQL,AWS, PYSPARK Location: Chennai, Mumbai, Pune, Bangalore and Gurugram Work Mode: Hybrid Shift: General Note: PF Mandatory

  • Technical architect

    4 months ago

    Anywhere in India/Multiple Locations RAPINNO TECH SOLUTIONS PRIVATE LIMITED Full time

    Job Description :Overview :About KPMG MBS :KPMG's Microsoft Business Solutions team is a Microsoft Gold Partner and leader in Microsoft software implementations for medium to large organisations, providing our clients with the ability to keep up with the ever-changing digital world by implementing Microsoft's M365, Azure, Microsoft's...

  • Lead Data Engineer

    2 weeks ago

    India Wavicle Data Solutions Full time

    Job Description:We are seeking a highly experienced Senior Data Engineer with over 8 years of expertise in data engineering.As a Lead Data Engineer, you will play a pivotal role in architecting and implementing data solutions.Your proficiency in Python, PySpark, AWS/Azure, Databricks/Snowflake, SQL, and leadership skills will be crucial for success.Key...

  • Senior Data Engineer

    2 weeks ago

    India True Tech Professionals Full time

    Senior Data Engineer Key Skills: Snowflake, Python, PysparkExperience: 6+ YearsEmployment Type: Full-timeAvailability: Immediate Joiners PreferredJob Description:We are seeking a highly skilled and experienced Senior Data Engineer to join our dynamic team. The ideal candidate will have a strong background in data engineering, with a focus on Snowflake,...

  • Senior Data Engineer

    2 weeks ago

    India True Tech Professionals Full time

    Senior Data Engineer Key Skills: Snowflake, Python, Pyspark Experience: 6+ Years Employment Type: Full-time Availability: Immediate Joiners Preferred Job Description: We are seeking a highly skilled and experienced Senior Data Engineer to join our dynamic team. The ideal candidate will have a strong background in data engineering, with a focus on...

PySpark Tech Lead

4 months ago

Anywhere in IndiaMultiple Locations TD Newton & Associates Full time

Technical Skills :

  • Extensive experience working on software engineering projects and SDLC
  • Have worked on various development project as developer and/or lead developer.
  • Capability to understand and comprehend the solution and create a development framework where all the developers will be contributing.
  • Should be able to create a Test driven development strategy with contribution from other developers and QAs (focusing on the solution, which is data engineering/Big data in our case) to achieve maximum code coverage .
  • Should be work closely with dev ops team and able to design CI/CD Strategy to orchestrate the team activities.
  • Proficient in the python programming language and exposure of other scripting language and Database would be advantage.
  • Comfortable with code review and provide support when needed
  • Working experience in implementing Data lake, ETL, Virtualization, Containerization, Orchestration etc.
  • Working experience on PySpark and/or Spark based solution.
  • Good understanding of various aspects and best practices of Big Data solutions.
  • Good understanding of onprem and cloud based solutions.
  • Good experience working with various big data file formats like parquet/delta/orc etc.
  • Ability to guide junior team members in team and deliver the ask.
)