Pyspark Developer

4 weeks ago

Chennai, Tamil Nadu, India MP DOMINIC AND CO Full time

Job Summary - Design develop and implement scalable data pipelines and streaming use cases using PySpark and Spark on a distributed computing platform - Possess strong programming skills in Spark streaming - Have familiarity with cloud platforms like GCP - Gain experience in big data technologies such as Hadoop Hive and HDFS - Perform ETL operations from various data sources and have experience with data warehousing concepts - Optimize PySpark jobs for performance and efficiency - Develop and maintain unit tests for data pipelines and streaming use cases - Troubleshoot and debug Spark applications - Collaborate with data scientists and analysts to understand data requirements - Document data pipelines and data models clearly and concisely - Participate in code reviews and knowledge sharing sessions - Stay updated with the latest advancements in PySpark and related technologies - Able to provide production support for the developed use cases - Have 3 years of experience as a Data Engineer - Proven experience using PySpark for data processing and streaming use cases - Strong understanding of data warehousing data modeling and ETL processes - Familiarity with big data concepts and distributed computing frameworks such as Hadoop Spark Kafka - Experience with SQL and a relational database management system like MySQL PostgreSQL - Experience with cloud platforms like AWS Azure GCP is a plus - Excellent problem-solving and analytical skills - Strong communication and collaboration skills - Ability to work independently and as part of a team

  • Pyspark Developer

    2 weeks ago

    Chennai, Tamil Nadu, India Citi Full time ₹ 12,00,000 - ₹ 36,00,000 per year

    Discover your future at CitiWorking at Citi is far more than just a job. A career with us means joining a team of more than 230,000 dedicated people from around the globe. At Citi, you'll have the opportunity to grow your career, give back to your community and make a real impact.Job OverviewAt Citi we're not just building technology, we're building the...

  • Pyspark

    4 days ago

    Chennai, Tamil Nadu, India Cognizant Technology Solutions Full time ₹ 12,00,000 - ₹ 36,00,000 per year

    Job SummaryAs a Sr. Developer you will play a pivotal role in optimizing and enhancing our data processing capabilities using PySpark and AWS technologies. Your expertise in Python and domain knowledge in Cards & Payments will drive impactful solutions. This hybrid role offers the flexibility of day shifts ensuring a balanced work-life...

  • databricks/pyspark

    1 week ago

    Chennai, Tamil Nadu, India NRM Analytix Full time ₹ 4,00,000 - ₹ 12,00,000 per year

    Responsibilities:* Design, develop & maintain PySpark solutions using Databricks platform* Optimize performance through efficient data processing techniques* Collaborate with cross-functional teams on project deliveryAccessible workspace

  • Pyspark, AWS

    3 days ago

    Chennai, Tamil Nadu, India Cognizant Technology Solutions Full time ₹ 15,00,000 - ₹ 25,00,000 per year

    Job SummaryWe are seeking a skilled Developer with 4 to 6 years of experience to join our team. The ideal candidate will have expertise in Amazon S3 and PySpark and a strong background in the Cards & Payments domain. This hybrid role offers the opportunity to work on cutting-edge projects in a dynamic environment contributing to the companys growth and...

  • Pyspark Developer(Chennai,Bangalore,Hyderabad,Kolkata,Pune)

    2 days ago

    Chennai, Tamil Nadu, India Tata Consultancy Servicess Full time ₹ 20,00,000 - ₹ 25,00,000 per year

    Skill : PySpark DeveloperExperience Range: 4 to 8Notice : (Immediate to 60 Days)Job Description:Technical Skills: Spark ,PySpark, Python, Hive, Scala, MapReduce, Unix shell scriptingob Description:4+ Years of experience with Developing/Fine tuning and implementing programs/applicationsUsing Python/PySpark/Scala on Big Data/Hadoop Platform.Roles and...

  • Pyspark Data Engineer

    2 weeks ago

    Chennai, Tamil Nadu, India Prowesstics Full time ₹ 15,00,000 - ₹ 25,00,000 per year

    We are looking for a skilledData Engineerwith hands-on experience inPySparkandDatabricksto design, develop, and optimize large-scale data pipelines. The ideal candidate should have strong problem-solving skills, experience working in cloud-based environments, and the ability to collaborate effectively with cross-functional teams.Key Responsibilities:Develop...

  • Databrick Pyspark

    2 weeks ago

    Chennai, Tamil Nadu, India Virtusa Full time ₹ 5,00,000 - ₹ 15,00,000 per year

    Key Responsibilities:Design, develop, and maintain scalable data pipelines using Apache Spark on Databricks. Write efficient and production-ready PySpark or Scala code for data transformation and ETL processes. Integrate data from various structured and unstructured sources into a unified platform. Implement Delta Lake and manage data versioning, updates,...

  • Python/Pyspark Development

    1 week ago

    Chennai, Tamil Nadu, India Standard Chartered Bank Full time ₹ 15,00,000 - ₹ 25,00,000 per year

    Job ID: 39129Location: Chennai, INArea of interest: TechnologyJob type: Regular EmployeeWork style: Office WorkingOpening date: 10 Sept 2025Job SummaryStrategy - Deliver on the functional requirements for the Regulatory exercisesBusiness - Group Functions - FinanceProcesses - Regulatory Stress Testing.Risk Management - Group standard requirementsKey...

  • Pyspark Developer(Chennai,Bangalore,Hyderabad,Kolkata,Pune)

    17 hours ago

    Chennai, Tamil Nadu, India, Tamil Nadu Tata Consultancy Servicess Full time

    Skill : PySpark DeveloperExperience Range: 4 to 8Notice : (Immediate to 60 Days)Job Description:Technical Skills: Spark ,PySpark, Python, Hive, Scala, MapReduce, Unix shell scriptingob Description:4+ Years of experience with Developing/Fine tuning and implementing programs/applicationsUsing Python/PySpark/Scala on Big Data/Hadoop Platform.Roles and...

  • Software Engineer, Tableau And PySpark, AVP

    2 days ago

    Chennai, Tamil Nadu, India NatWest Group Full time ₹ 6,00,000 - ₹ 18,00,000 per year

    Join us as a Software Engineer, Tableau And PySparkThis is an opportunity for a driven Software Engineer to take on an exciting new career challengeDay-to-day, you'll build a wide network of stakeholders of varying levels of seniorityIt's a chance to hone your existing technical skills and advance your careerWe're offering this role at associate vice...