Pyspark developer

4 weeks ago


gurgaon, India EXL Full time
Please find the JD below:
The ideal candidate will be responsible for developing high-quality applications.
Design, develop, maintain efficient and scalable solutions using PySpark
Ensure data quality and integrity by implementing robust testing, validation and cleansing processes
Integrate data from various sources, including databases, APIs, external datasets etc.
Optimize and tune PySpark jobs for performance and reliability
Document data engineering processes, workflows and best practices
Strong understanding of databases, data modelling, and ETL tools and processes
String programming skills in python and proficiency with PySpark, SQL
Experience with relational databases, Hadoop, Spark, Hive, Impala
Excellent communication and collaboration skills
  • Pyspark developer

    1 week ago


    gurgaon, India EXL Full time

    Please find the JD below: The ideal candidate will be responsible for developing high-quality applications. Design, develop, maintain efficient and scalable solutions using PySpark Ensure data quality and integrity by implementing robust testing, validation and cleansing processes Integrate data from various sources, including databases, APIs, external...

  • Senior Data Engineer

    3 months ago


    Gurgaon/Gurugram, India Muoro Full time

    Job Description : Key Responsibilities :Data Engineering & Development :- Design, develop, and maintain scalable data pipelines using Azure Databricks.- Write and optimize PySpark code for processing large datasets.- Implement ETL processes to ingest and transform data from various sources.Data Management :- Develop and maintain Delta Lake tables for...

  • Data Engineer

    4 months ago


    Gurgaon/Gurugram, India Intellismith pvt Ltd Full time

    Notice Period : Only immediate joinersMandatory skills : Python, SQL, Pyspark, Big data, ETL ToolsJob Description :- Building Big data platform, products & team from scratch- True big data problem - Billion of data records per day, Peta-byte storage & Fast response time.- Best in class technology stack - Hadoop, HDFS, Spark, Streaming, Presto, Alluxio &...

  • Big Data Developer

    7 days ago


    gurgaon, India LTIMindtree Full time

    Job descriptionNOTE:_-Please fill this form for quick response :-Big data Engineer/ Big data DeveloperExp;- 5+ yearsLocation:- GurgaonSkills;- Hadoop, Hive, SQL, Scala Spark/ Pyspark.Regards,Dhamodhar. GTalent Acquisition

  • Big Data Developer

    7 days ago


    Gurgaon, India LTIMindtree Full time

    Job descriptionNOTE:_-Please fill this form for quick response :- Big data Engineer/ Big data DeveloperExp;- 5+ yearsLocation:- GurgaonSkills;- Hadoop, Hive, SQL, Scala Spark/ Pyspark.Regards,Dhamodhar. GTalent

  • Data Engineer

    4 weeks ago


    gurgaon, India True Tech Professionals Full time

    Lead Data Engineer (Multiple Positions)Location: Remote - Gurgaon (Office visit - once in a while - as and when required)Experience:4 to 6 yearsKey Responsibilities:Data Pipeline Development: Design, implement, and maintain scalable data pipelines to extract, transform, and load (ETL) data from various sources into data warehouses or other storage...


  • Gurgaon, India Sun Life Financial Inc. Full time

    You are as unique as your background, experience and point of view. Here, you'll be encouraged, empowered and challenged to be your best self. You'll work with dynamic colleagues - experts in their fields - who are eager to share their knowledge with you. Your leaders will inspire and help you reach your potential and soar to new heights. Every day, you'll...

  • Big Data Developer

    1 week ago


    gurgaon, India Impetus Full time

    Location: Noida, Indore, Bangalore, Pune and Gurgaon Experience: 1 - 2 years Description: We are looking for Big Data developers having minimum experience of 1 year in Proficient in modern development using, passionate about technology, motivated for continuous learning and an individual who views every client interaction as an opportunity to create an...


  • Gurgaon, India True Tech Professionals Full time

    Job Title : Data Quality AnalystLocation : Gurgaon (Hybrid)Experience : 4+ YearsJob Description :We are looking for a highly motivated Data Quality Analyst with over 4 years of experience to join our team in Gurgaon. The ideal candidate should have a strong understanding of data quality management, validation, and data reconciliation concepts, as well as...


  • gurgaon, India True Tech Professionals Full time

    Job Title : Data Quality Analyst Location : Gurgaon (Hybrid) Experience : 4+ Years Job Description : We are looking for a highly motivated Data Quality Analyst with over 4 years of experience to join our team in Gurgaon. The ideal candidate should have a strong understanding of data quality management, validation, and data reconciliation concepts, as well as...

  • Big Data Developer

    1 week ago


    gurgaon, India Impetus Full time

    Location: Noida, Indore, Bangalore, Pune and GurgaonExperience: 1 - 2 yearsDescription:We are looking for Big Data developers having minimum experience of 1 year in Proficient in modern development using, passionate about technology, motivated for continuous learning and an individual who views every client interaction as an opportunity to create an...

  • Big Data Developer

    2 weeks ago


    gurgaon, India Impetus Full time

    Location: Noida, Indore, Bangalore, Pune and GurgaonExperience: 1 - 2 yearsDescription:We are looking for Big Data developers having minimum experience of 1 year in Proficient in modern development using, passionate about technology, motivated for continuous learning and an individual who views every client interaction as an opportunity to create an...

  • Big Data Developer

    23 hours ago


    Gurgaon, India Impetus Full time

    Location: Noida, Indore, Bangalore, Pune and Gurgaon Experience: 1 - 2 years Description: We are looking for Big Data developers having minimum experience of 1 year in Proficient in modern development using, passionate about technology, motivated for continuous learning and an individual who views every client interaction as an opportunity to create an...

  • Specialist Development

    2 months ago


    Gurgaon, India Sun Life Financial Inc. Full time

    You are as unique as your background, experience and point of view. Here, you'll be encouraged, empowered and challenged to be your best self. You'll work with dynamic colleagues - experts in their fields - who are eager to share their knowledge with you. Your leaders will inspire and help you reach your potential and soar to new heights. Every day, you'll...

  • Specialist Development

    2 months ago


    Gurgaon, India Sun Life Financial Inc. Full time

    You are as unique as your background, experience and point of view. Here, you'll be encouraged, empowered and challenged to be your best self. You'll work with dynamic colleagues - experts in their fields - who are eager to share their knowledge with you. Your leaders will inspire and help you reach your potential and soar to new heights. Every day, you'll...

  • Senior Data Engineer

    4 weeks ago


    gurgaon, India True Tech Professionals Full time

    Job Title: Senior Data EngineerLocation: Gurgaon (Hybrid)Experience Required: 6 to 9 yearsJob Summary:We are seeking a highly skilled Senior Data Engineer with expertise in PySpark, Python, ETL processes, and data pipeline development. The ideal candidate will have a strong background in Snowflake and hands-on experience working with AWS cloud. You will be...


  • gurgaon, India True Tech Professionals Full time

    Job Title : Data Quality AnalystLocation : Gurgaon (Hybrid)Experience : 4+ YearsJob Description :We are looking for a highly motivated Data Quality Analyst with over 4 years of experience to join our team in Gurgaon. The ideal candidate should have a strong understanding of data quality management, validation, and data reconciliation concepts, as well as...

  • Sr. Associate

    5 days ago


    Gurgaon, India Cognizant Full time

    Job SummaryWe are seeking a Sr. Developer with 4 to 6 years of experience to join our team. The ideal candidate will have expertise in Azure Synapse SQL Pool Azure Synapse Spark Pool SQL and PySpark. You will play a crucial role in developing and optimizing data solutions that drive our business forward.ResponsibilitiesDevelop and maintain data solutions...

  • Data Quality Engineer

    4 weeks ago


    gurgaon, India True Tech Professionals Full time

    Job Summary:We are seeking a meticulous and proactive Data Quality Engineer to join our dynamic DataEngineering team. The ideal candidate will possess a deep understanding of data quality,validation, and data reconciliation concepts. They will collaborate closely with our dataengineers to ensure the integrity and accuracy of our data. This role requires...

  • AWS Data Engineer

    7 days ago


    gurgaon, India True Tech Professionals Full time

    Job Title: AWS Data EngineerLocation: GurgaonMode: HybridExperience Required: 4 to 9 YearsKey Responsibilities:Design, develop, and maintain scalable data pipelines using AWS services.Leverage Python and PySpark for data processing and transformation.Work with AWS Glue for ETL processes, ensuring efficient data movement and...