Current jobs related to PySpark Developer - Kolkata, West Bengal - Corporate Resources

  • PySpark Developer

    4 weeks ago

    Kolkata, India Risk Resources LLP Full time

    Job Description :Must-Have :- Mandatory skill : Pyspark.- 3-6 years of experience in the design and implementation of Big Data pipelines using PySpark, database migration, transformation, and integration solutions for any Data warehousing project.- Must have excellent knowledge in Apache Spark and Python programming experience.- Experience in developing data...

  • Data Engineer

    2 weeks ago

    Kolkata, India Randstad India Full time

    Job Title - Pyspark DeveloperLocation - Hyderabad, Bangalore, ChennaiExperience - 4 - 8 YearsLooking for Immediate joiners or np with 15 days onlyAs a Data Engineer, you will be responsible for designing, developing, and maintaining data solutions for data generation, collection, and processing. Your typical day will involve creating data pipelines, ensuring...

  • Databricks Developer

    2 months ago

    Kolkata, India NUSTAR TECHNOLOGIES INDIA PRIVATE LIMITED Full time

    Exp: 5+yrsLocation : KolkataJob Description : - Minimum 5 years + working exp as Databricks Developer.- Minimum 3 years + working exp on PySpark and AWS.- 5+ years relevant and progressive data engineering experience.- Deep Technical knowledge and experience in Databricks, Python, Scala, Microsoft Azure architecture and platform including Synapse, ADF (Azure...

  • Pyspark/Python Data Engineer

    1 month ago

    Kolkata, India Genpact Full time

    Genpact (NYSE: G) is a global professional services and solutions firm delivering outcomes that shape the future. Our 125,000+ people across 30+ countries are driven by our innate curiosity, entrepreneurial agility, and desire to create lasting value for clients. Powered by our purpose – the relentless pursuit of a world that works better for people – we...

  • Databricks Developer

    5 hours ago

    Kolkata, India Tata Consultancy Services Full time

    TCS Hiring!!Role : Databricks DeveloperExp: 6-8 YrLocation: KolkataMinimum 4 years + working exp as Databricks DeveloperMinimum 4 years + working exp on PySpark and AWSMust Have :Databricks/PySpark – 4+ years of experience · Cloud experience4+ years of cloud experience Nice to HavePreferable Software engineering backgroundPreferable AWS...

  • Databricks Developer

    7 days ago

    Kolkata, India Tata Consultancy Services Full time

    Job Title Databricks DeveloperRelevant Experience (in Yrs) 5 years+Technical/Functional Skills· Minimum 5 years + working exp as Databricks Developer· Minimum 3 years + working exp on PySpark and AWSExperience- Required 5 years+Roles & Responsibilities· 5+ years relevant and progressive data engineering experience· Deep Technical knowledge and experience...

  • Lead Consultant

    2 months ago

    Kolkata, India Genpact Full time

    Genpact (NYSE: G) is a global professional services and solutions firm delivering outcomes that shape the future. Our 125,000+ people across 30+ countries are driven by our innate curiosity, entrepreneurial agility, and desire to create lasting value for clients. Powered by our purpose – the relentless pursuit of a world that works better for people –...

  • Databricks Developer

    1 week ago

    Kolkata, India Tata Consultancy Services Full time

    Job Title Databricks DeveloperRelevant Experience (in Yrs) 5 years+Technical/Functional Skills· Minimum 5 years + working exp as Databricks Developer· Minimum 3 years + working exp on PySpark and AWSExperience- Required 5 years+Roles & Responsibilities· 5+ years relevant and progressive data engineering experience· Deep Technical knowledge and experience...

  • Databricks Developer

    7 days ago

    kolkata, India Tata Consultancy Services Full time

    Job Title Databricks Developer Relevant Experience (in Yrs) 5 years+ Technical/Functional Skills · Minimum 5 years + working exp as Databricks Developer · Minimum 3 years + working exp on PySpark and AWS Experience- Required 5 years+ Roles & Responsibilities · 5+ years relevant and progressive data engineering experience · Deep Technical knowledge and...

  • Databricks Developer

    1 week ago

    Kolkata, India Tata Consultancy Services Full time

    Job Title Databricks DeveloperRelevant Experience (in Yrs) 5 years+Technical/Functional Skills· Minimum 5 years + working exp as Databricks Developer· Minimum 3 years + working exp on PySpark and AWSExperience- Required 5 years+Roles & Responsibilities· 5+ years relevant and progressive data engineering experience· Deep Technical knowledge and experience...

  • Databricks Developer

    4 days ago

    kolkata, India Tata Consultancy Services Full time

    Job Title Databricks DeveloperRelevant Experience (in Yrs) 5 years+Technical/Functional Skills· Minimum 5 years + working exp as Databricks Developer· Minimum 3 years + working exp on PySpark and AWSExperience- Required 5 years+Roles & Responsibilities· 5+ years relevant and progressive data engineering experience· Deep Technical knowledge and experience...

  • AWS Data Engineer

    7 days ago

    kolkata, India Tata Consultancy Services Full time

    Role** Developer Required Technical Skill Set** Databricks, Python, Pyspark Desired Experience Range** 4-6 Years Location of Requirement Kochi/ Kolkata, India Desired Competencies (Technical/Behavioral Competency) Must-Have** (Ideally should not be more than 3-5 lines) 3 years of experience in Databricks engineering solutions on AWS Cloud platforms...

  • AWS Data Engineer

    1 week ago

    Kolkata, India Tata Consultancy Services Full time

    Role** DeveloperRequired Technical Skill Set** Databricks, Python, PysparkDesired Experience Range** 4-6 YearsLocation of Requirement Kochi/ Kolkata, IndiaDesired Competencies (Technical/Behavioral Competency)Must-Have**(Ideally should not be more than 3-5 lines)3 years of experience in Databricks engineering solutions on AWS Cloud platforms using PySpark,...

  • AWS Data Engineer

    4 days ago

    kolkata, India Tata Consultancy Services Full time

    Role** DeveloperRequired Technical Skill Set** Databricks, Python, PysparkDesired Experience Range** 4-6 YearsLocation of Requirement Kochi/ Kolkata, IndiaDesired Competencies (Technical/Behavioral Competency)Must-Have**(Ideally should not be more than 3-5 lines)3 years of experience in Databricks engineering solutions on AWS Cloud platforms using PySpark,...

  • AWS Data Engineer

    1 week ago

    Kolkata, India Tata Consultancy Services Full time

    Role** DeveloperRequired Technical Skill Set** Databricks, Python, PysparkDesired Experience Range** 4-6 YearsLocation of Requirement Kochi/ Kolkata, IndiaDesired Competencies (Technical/Behavioral Competency)Must-Have**(Ideally should not be more than 3-5 lines)3 years of experience in Databricks engineering solutions on AWS Cloud platforms using PySpark,...

  • Solutions Architect

    7 days ago

    Kolkata, India Tata Consultancy Services Full time

    Dear Candidates,Greetings from TCS!!!TCS is looking for Solutions ArchitectExperience: 10-12 yearsLocation: KolkataRequired technical skills: Azure data factory, Azure Databrics, Pyspark, SQL, DatawarehouseMust have skills:Hands-on experience in Azure data-services on development using Azure Databricks, Azure Data Factory, PySpark, Azure Functions, Azure...

  • AWS Data Engineer

    4 days ago

    kolkata, India Tata Consultancy Services Full time

    Role** DeveloperRequired Technical Skill Set** Databricks, Python, PysparkDesired Experience Range** 4-6 YearsLocation of Requirement Kochi/ Kolkata, IndiaDesired Competencies (Technical/Behavioral Competency)Must-Have**(Ideally should not be more than 3-5 lines)3 years of experience in Databricks engineering solutions on AWS Cloud platforms using PySpark,...

  • AWS Data Engineer

    7 days ago

    Kolkata, India Tata Consultancy Services Full time

    Role** DeveloperRequired Technical Skill Set** Databricks, Python, PysparkDesired Experience Range** 4-6 YearsLocation of Requirement Kochi/ Kolkata, IndiaDesired Competencies (Technical/Behavioral Competency)Must-Have**(Ideally should not be more than 3-5 lines)3 years of experience in Databricks engineering solutions on AWS Cloud platforms using PySpark,...

  • Senior Associate

    1 month ago

    KOLKATA, India Cognizant Full time

    Job SummaryWe are seeking a highly skilled Sr. Developer with 8 to 11 years of experience to join our team. The ideal candidate will have extensive experience in Databricks SQL Databricks Workflows and PySpark. Experience in the Property & Casualty Insurance domain is a plus. The role involves developing and optimizing data workflows ensuring data quality...

  • Principal Consultant-Senior Data Engineer

    2 months ago

    Kolkata, India Genpact Full time

    Genpact (NYSE: G) is a global professional services and solutions firm delivering outcomes that shape the future. Our 125,000+ people across 30+ countries are driven by our innate curiosity, entrepreneurial agility, and desire to create lasting value for clients. Powered by our purpose – the relentless pursuit of a world that works better for people –...

PySpark Developer

3 months ago

Kolkata, West Bengal, India Corporate Resources Full time
Job Description

1. Hands on experience in MS Azure Data bricks and Hadoop ecosystem components like DBFS, Parquet, Delta Tables, HDFS, Map Reduce programming, Kafka, Spark & Event Hub.

2. In depth understanding of Spark Architecture including Spark Core, Spark SQL, Data Frames, Spark Streaming, RDD caching, Spark MLib.

3. Hands on experience in Scripting languages like Scala & Python.

4. Hands on experience in Analysis, Design, Coding & Testing phases of SDLC with best practices.

5. Expertise in using Spark SQL with various data sources like JSON, Parquet and Key Value Pair.

6. Experience in creating tables, partitioning, bucketing, loading and aggregating data using Spark SQL/Scala.

7. Migrating the code from Traditional DW Environments to Apache Spark and Scala using Spark SQL, RDD.

8. Experience in transferring data from RDBMS/BLOB/ADLS to Data bricks using ADF.

9. Experience in Azure Database (PaaS) OR Azure SQL Data warehouse.

10. Experience in orchestrating the E2E data loads using the Azure Data Factory V2 / Logic Apps.

11. Experience in Cosmos DB.

12. Good knowledge on SQL Queries & Stored Procedures.

  • Industry
  • IT-Software / Software Services
  • Functional Area
  • IT Software - Application Programming, Maintenance
  • Job Role
  • Software Developer
  • Job Type
  • Permanent
Qualification
  • UG Qualification
  • B.Tech/B.E - Computers
  • PG Qualification
  • Any Post Graduate - Any Specialization
  • Doctorate
  • Doctorate Not Required - None
Desired Candidate Profile Please refer to the Job description above