Pyspark Developer

5 days ago

tamil nadu, India Tata Consultancy Services Full time

TCS is Hiring Pyspark Developer For Chennai, Hyderabad, Kolkata locationExperience : 6 - 10 yearsMode of interview: VirtualLocation : Chennai, Hyderabad, KolkataJOB DESCRIPTION:Must have:Minimum 3 Years of experience in design, development and deployment of big data applications and ETL jobs using PySpark APIs/sparkSQL.Experience in design, build and deployment of Python based applications.Experience in writing complex SQL queries/procedures using Relational databases like SQL Server or OracleExperience in version control system like Git and CI/CD pipeline is a must.Experience in Delta lake APIs is a plusExperience in Docker and Kubernetes is a plusKnowledge of AWS services like S3, Athena, Glue, Lambda, Redshift or Cloud platform is a plusResponsibilities:Designing, implementing, and maintaining jobs written in PySpark for extracting raw data, applying transformation, and writing into file/tables on Apache Spark cluster.Writing complex queries as per the business rules and data extraction logicQuery tuning and Performance optimization of various components as and when required.Work with development leads, System Architects and other teams (as needed) to manage dependencies, risks and issues.Contributing in all phases of the development lifecycleSupport testers and defect resolutionUpdate status/risks/issues/impediments in daily scrum calls to the customer and track it to closure.Writing testable, scalable and efficient codeWorking on the necessary documentations as needed

  • Pyspark

    2 weeks ago

    Chennai, Tamil Nadu, India Cognizant Full time

    **Skill**: Pyspark **Experience**: 6 to 13 years **Location**: Bhubaneswar **Job description**: - Develop and maintain scalable data pipelines using Python and PySpark. - Collaborate with data engineers and data scientists to understand and fulfill data processing needs. - Write clean, efficient, and well-documented code following best practices. -...

  • Pyspark

    2 weeks ago

    Coimbatore, Tamil Nadu, India Cognizant Full time

    **Description - External** **Skill: - Pyspark, SQL** **Experience: 3 to 14 years** **Location: - Coimbatore (Walkin on 8th Feb)** - Write clean, efficient, and reusable code following best practices. - Database design and management. - Participate in code reviews and contribute to team knowledge sharing. - Learn and adapt to new technologies, frameworks,...

  • Pyspark / Reltio

    4 days ago

    Chennai, Tamil Nadu, India Virtusa Full time

    Key Responsibilities: Develop and maintain data pipelines using PySpark in distributed computing environments (e.g., AWS EMR, Databricks). Integrate and synchronize data between enterprise systems and the Reltio MDM platform. Design and implement data transformation, cleansing, and enrichment processes. Collaborate with data architects, business analysts,...

  • Data Engineer

    1 week ago

    tamil nadu, India Tata Consultancy Services Full time

    Greetings from Tata Consulting Services!!!Role: Data Engineer with Mandatory Pyspark, Python KnowledgeDesired Experience Range: 5 to 10 yrsLocation: Pune, Hyderabad, Chennai, Bangalore, Kochi, Bhubaneshwar Notice period: 0 To 30 DaysInterview Mode: Virtual ModeInterview Date: 13th Nov 2025Time Of Interview: 10AM TO 2PMRequired Technical Skill Set: Python,...

  • Data Engineer

    2 days ago

    tamil nadu, India Tata Consultancy Services Full time

    Greetings from Tata Consulting Services!!! Role: Data Engineer with Mandatory Pyspark, Python Knowledge Desired Experience Range: 5 to 10 yrs Location: Pune, Hyderabad, Chennai, Bangalore, Kochi, Bhubaneshwar Notice period: 0 To 30 Days Interview Mode: Virtual Mode Interview Date: 13th Nov 2025 Time Of Interview: 10AM TO 2PM Required Technical Skill Set:...

  • Officer-pyspark Developer-c11-hybbrid-chennai

    4 days ago

    Chennai, Tamil Nadu, India Citi Full time

    **Responsibilities**: - Manage an Applications Development team of professionals to accomplish established goals and conduct personnel duties for team (e.g. performance evaluations, training and development, hiring and disciplinary actions) - Recommend new work procedures to increase process efficiencies - Ensure the quality of tasks provided by self and...

  • Etl Databricks with Aws

    4 hours ago

    Chennai, Tamil Nadu, India Virtusa Full time

    Develop and maintain a metadata driven generic ETL framework for automating ETL code Design, build, and optimize ETL/ELT pipelines using Databricks (PySpark/SQL) on AWS. Ingest data from a variety of structured and unstructured sources (APIs, RDBMS, flat files, streaming). Develop and maintain robust data pipelines for batch and streaming data using Delta...

  • Etl Testing with Pyspark

    4 days ago

    Chennai, Tamil Nadu, India Virtusa Full time

    The ETL Tester is responsible for validating and verifying data extraction transformation and loading processes to ensure data accuracy and integrity This role involves designing and executing test cases identifying data quality issues and collaborating with data engineers to resolve discrepanciesThe ETL Tester will also develop automated testing frameworks...

  • Big Data Developer

    5 days ago

    tamil nadu, India HCLTech Full time

    Position: Senior Data Engineer – Experience: 6–9 YearsRole SummaryWe are seeking Senior Data Engineer resources to work on the migration of applications from our legacy Cloudera environment to the new Kubernetes-based data platform. The role requires strong hands-on development skills in data engineering, with the ability to deliver high-quality...

  • Big Data Developer

    2 days ago

    tamil nadu, India HCLTech Full time

    Position: Senior Data Engineer – Experience: 6–9 Years Role Summary We are seeking Senior Data Engineer resources to work on the migration of applications from our legacy Cloudera environment to the new Kubernetes-based data platform. The role requires strong hands-on development skills in data engineering, with the ability to deliver high-quality...