Pyspark Developer

4 days ago

Kolkata, India Tata Consultancy Services Full time

TCS is Hiring Pyspark Developer For Chennai, Hyderabad, Kolkata locationExperience : 6 - 10 yearsMode of interview: VirtualLocation : Chennai, Hyderabad, KolkataJOB DESCRIPTION:Must have:- Minimum 3 Years of experience in design, development and deployment of big data applications and ETL jobs using PySpark APIs/sparkSQL.- Experience in design, build and deployment of Python based applications.- Experience in writing complex SQL queries/procedures using Relational databases like SQL Server or Oracle- Experience in version control system like Git and CI/CD pipeline is a must.- Experience in Delta lake APIs is a plus- Experience in Docker and Kubernetes is a plus- Knowledge of AWS services like S3, Athena, Glue, Lambda, Redshift or Cloud platform is a plusResponsibilities:- Designing, implementing, and maintaining jobs written in PySpark for extracting raw data, applying transformation, and writing into file/tables on Apache Spark cluster.- Writing complex queries as per the business rules and data extraction logic- Query tuning and Performance optimization of various components as and when required.- Work with development leads, System Architects and other teams (as needed) to manage dependencies, risks and issues.- Contributing in all phases of the development lifecycle- Support testers and defect resolution- Update status/risks/issues/impediments in daily scrum calls to the customer and track it to closure.- Writing testable, scalable and efficient code- Working on the necessary documentations as needed

  • Pyspark Developer-1

    1 week ago

    Kolkata, West Bengal, India Realign LLC Full time

    **Job Type: Full Time**: **Job Category: IT**: Job Title: PySpark Developer Job Summary: Responsibilities and Duties: - Develop and optimize PySpark data processing pipelines - Collaborate with data engineers and data scientists to implement data solutions - Write efficient and scalable PySpark code - Troubleshoot and resolve performance issues - Design...

  • Pyspark Architect

    1 week ago

    kolkata, India Talent Worx Full time

    Job Description: PySpark ArchitectLocation: Bangalore,Pune,Kolkata Experience Required: 7 to 13 YearsRole Overview:We are seeking a highly skilled and motivated PySpark Manager to lead our dataengineering initiatives. The ideal candidate will have deep expertise in PySpark,Hadoop, AWS, Teradata, Scala, and data visualization tools. You will be responsible...

  • Pyspark C5

    1 week ago

    Kolkata, India Mindtree Full time

    **Responsibilities**: Partner with business stakeholders to gather requirements and translate them into technical specifications and process documentation for IT counterparts (onshore and offshore) Highly proficient in the architecture and development of an event driven data warehouse streaming, batch, data modeling, and storage Advanced database...

  • Pyspark Architect

    1 week ago

    Kolkata, India Talent Worx Full time

    Job Description: PySpark Architect Location: Bangalore,Pune,Kolkata Experience Required: 7 to 13 Years Role Overview: We are seeking a highly skilled and motivated PySpark Manager to lead our data engineering initiatives. The ideal candidate will have deep expertise in PySpark, Hadoop, AWS, Teradata, Scala, and data visualization tools. You will be...

  • Pyspark Architect

    1 week ago

    Kolkata, West Bengal, India Talent Worx Full time ₹ 15,00,000 - ₹ 25,00,000 per year

    Job Description: PySpark ArchitectLocation: Bangalore,Pune,KolkataExperience Required: 7 to 13 YearsRole Overview:We are seeking a highly skilled and motivated PySpark Manager to lead our dataengineering initiatives. The ideal candidate will have deep expertise in PySpark,Hadoop, AWS, Teradata, Scala, and data visualization tools. You will be responsible...

  • Data Engineer

    3 weeks ago

    Kolkata, India GALAXY I TECHNOLOGIES INC Full time

    Key Responsibilities :- Design, build, and optimize data pipelines leveraging Apache Spark, PySpark, and SQL.- Develop scalable data integration, transformation, and modeling solutions for analytics and reporting.- Implement and manage CI/CD pipelines, release management, and production deployments.- Collaborate with data science teams to enable advanced...

  • Python + Pyspark + SQL

    1 week ago

    kolkata, India Talent Worx Full time

    Our Client is a professional services firm, is the Indian member firm affiliated with International and wasestablished in September 1993. Our professionals leverage the global network of firms, providing detailedknowledge of local laws, regulations, markets, and competition. Our client has offices across India in Ahmedabad,Bengaluru, Chandigarh, Chennai,...

  • Python + Pyspark + SQL

    1 week ago

    Kolkata, West Bengal, India Talent Worx Full time ₹ 9,00,000 - ₹ 12,00,000 per year

    Our Client is a professional services firm, is the Indian member firm affiliated with International and wasestablished in September 1993. Our professionals leverage the global network of firms, providing detailedknowledge of local laws, regulations, markets, and competition. Our client has offices across India in Ahmedabad,Bengaluru, Chandigarh, Chennai,...

  • Python + Pyspark + SQL

    1 week ago

    Kolkata, India Talent Worx Full time

    Our Client is a professional services firm, is the Indian member firm affiliated with International and was established in September 1993. Our professionals leverage the global network of firms, providing detailed knowledge of local laws, regulations, markets, and competition. Our client has offices across India in Ahmedabad, Bengaluru, Chandigarh, Chennai,...

  • Databricks Developer

    2 weeks ago

    Kolkata, India Tata Consultancy Services Full time

    Role: AWS Databricks DeveloperRequired Technical Skill Set: AWS/DatabricksDesired Experience Range: 6-8 yrsLocation of Requirement: KolkataNotice period: 90Job Description:• 5–6 years of total experience in data engineering or big data development.• 2–3 years hands-on experience with Databricks and Apache Spark.• Proficient in AWS cloud services...