Big Data Engineer with PySpark Expertise

4 weeks ago


Noida, Uttar Pradesh, India Freelance Full time

Freelance is seeking a highly skilled Big Data Engineer with extensive experience in PySpark programming. As a key member of our team, you will be responsible for designing and implementing scalable data processing solutions using PySpark.

Key Responsibilities:

  • Develop and maintain large-scale data processing pipelines using PySpark
  • Collaborate with cross-functional teams to identify business requirements and design data solutions
  • Optimize data processing performance and troubleshoot issues
  • Stay up-to-date with the latest PySpark features and best practices

Requirements:

  • Hands-on experience with PySpark and its ecosystem
  • Strong understanding of data processing concepts and algorithms
  • Excellent problem-solving skills and attention to detail
  • Ability to work in a fast-paced environment and meet deadlines

Nice to Have:

  • Experience with big data engineering and cloud platforms
  • Understanding of RESTful APIs and web technologies
  • Knowledge of AWS cloud platform and its services


  • Noida, Uttar Pradesh, India Freelance Full time

    Job Requirements:We are seeking a skilled Data Engineer with PySpark Expertise to join our team. The ideal candidate will have hands-on experience in core and advanced Python programming, as well as proficiency in various data processing packages like NumPy and Pandas.Key Responsibilities:• Develop and maintain large-scale data processing pipelines using...


  • Noida, Uttar Pradesh, India exl Full time

    Job Title: Data Engineer with Expertise in PySpark and AWSWe are seeking a highly skilled Data Engineer to join our team at EXL. The ideal candidate will have a strong background in data engineering, data processing, and cloud technologies.Responsibilities:1. Develop and maintain ETL pipelines using PySpark to process and transform large volumes of data...


  • Noida, Uttar Pradesh, India UnitedHealth Group Full time

    Optum is a global organization that delivers care, aided by technology to help millions of people live healthier lives. Our mission at UnitedHealth Group is to help people live healthier lives and make the health system work better for everyone. We are committed to mitigating our impact on the environment and enabling and delivering equitable care that...


  • Noida, Uttar Pradesh, India exl Full time

    Job Opportunity:We are seeking a skilled Data Engineer to join our team at EXL. The ideal candidate will have strong experience in designing, developing, and maintaining data infrastructure to support analytics.Key Responsibilities:1. Develop and maintain efficient ETL pipelines using PySpark for large volumes of data processing.2. Collaborate with analysts...


  • Noida, Uttar Pradesh, India exl Full time

    Job DescriptionWe are seeking an experienced Data Engineer Lead to join our team at EXL. As a key member of our data engineering group, you will be responsible for designing and implementing large-scale data architectures, leading cross-functional teams, and collaborating with stakeholders to drive business outcomes.Responsibilities:Collaborate with various...


  • Noida, Uttar Pradesh, India StaffSeek Full time

    Job OverviewStaffSeek is seeking a skilled Senior PySpark Developer to join our team in Noida.Key Responsibilities:Design and implement efficient PySpark solutions for large datasets.Collaborate with cross-functional teams to develop scalable data pipelines.Optimize PySpark applications for performance and scalability.Requirements:4-6 years of experience in...

  • Data Engineering Lead

    2 weeks ago


    Noida, Uttar Pradesh, India RateGain Full time

    About UsRateGain is a leading provider of software solutions that help travel and hospitality companies make data-driven decisions to increase revenue.We are proud to support 250,000+ hotel properties globally, providing 240 billion rate and availability updates & powering over 30 Million bookings.Our clients trust us because we offer end-to-end smart...


  • Greater Noida, Uttar Pradesh, India Coforge Full time

    Job Description:Coforge is seeking a highly skilled Big Data Architect to lead our cloud-based data engineering efforts. In this role, you will design and implement scalable data architectures using AWS technologies such as Dynamo DB, EKS, and Kafka.You will work closely with our development teams to ensure seamless data ingestion, processing, and storage on...


  • Noida, Uttar Pradesh, India Tech Mahindra Full time

    Job DescriptionWe are seeking a highly experienced Big Data Technical Lead to join our team at Tech Mahindra.The ideal candidate will have at least 10 years of experience in big data technologies, including Apache Hadoop, Apache Hive, Apache Spark, and Linux file handling.They will also have expertise in SQL, Scala programming language, and Agile...

  • Data Engineer

    3 weeks ago


    Noida, Uttar Pradesh, India exl Full time

    About the RoleWe are seeking a talented Data Engineer to join our dynamic team at EXL. The ideal candidate will have a strong background in data engineering, data processing, and cloud technologies.Key ResponsibilitiesDevelop and maintain ETL pipelines using PySpark to process and transform large volumes of data efficiently.Collaborate with analysts to...


  • Noida, Uttar Pradesh, India Genpact Full time

    About the RoleWe're on the search for a skilled Pyspark/Python Data Engineer to join our team at Genpact, a global professional services and solutions firm that's always pushing the boundaries of innovation. As a key member of our team, you'll be responsible for designing and implementing high-quality data solutions using PySpark/Python, collaborating with...


  • Noida, Uttar Pradesh, India Impetus Technologies Full time

    OverviewImpetus Technologies is a leading provider of innovative data solutions. We are seeking a highly skilled Senior Data Engineer to join our team and contribute to the design, development, and implementation of high-performance scalable solutions.About the RoleWe are looking for an experienced Big Data Developer who can architect and deliver solutions...


  • Noida, Uttar Pradesh, India BOLD Limited Full time

    BOLD Limited is a fast-growing product company that revolutionizes the online career world. We're looking for a Big Data Hadoop QA Engineer to join our team and contribute to creating transformational products that help people find jobs and companies hire the best candidates.Job Summary:As a Big Data Hadoop QA Engineer, you will be responsible for ensuring...


  • Noida, Uttar Pradesh, India Transaction Network Services Full time

    An exceptional group of professionals collaborate to drive TNS' success, both professionally and personally.OverviewA Cloud Architect is responsible for designing and implementing cloud-based infrastructure and applications. This includes tasks such as designing and implementing security and compliance measures, and ensuring the scalability and availability...

  • Data Engineer Expert

    19 hours ago


    Noida, Uttar Pradesh, India Genpact Full time

    Genpact is a global professional services and solutions firm delivering outcomes that shape the future. Our people across 30+ countries are driven by our innate curiosity, entrepreneurial agility, and desire to create lasting value for clients. Powered by our purpose – the relentless pursuit of a world that works better for people – we serve and...


  • Noida, Uttar Pradesh, India Transaction Network Services Full time

    About the RoleTransaction Network Services is seeking a highly skilled Cloud Engineer/Architect to join our team. As a Cloud Architect, you will be responsible for designing and implementing cloud-based infrastructure and applications.ResponsibilitiesDesign and ImplementationYou will design and implement cloud-based infrastructure and applications, ensuring...


  • Greater Noida, Uttar Pradesh, India Coforge Full time

    As a Senior Big Data Engineer at Coforge, you will play a pivotal role in designing and developing scalable solutions on the Amazon Web Services (AWS) platform. Your primary responsibility will be to architect and implement large-scale data processing systems that cater to our clients' ever-growing data needs.Candidates with hands-on experience in Big-Data...

  • Senior Data Architect

    2 weeks ago


    Noida, Uttar Pradesh, India Celebal Technologies Full time

    Data Engineering EssentialsJob DescriptionCelebal Technologies is seeking a highly skilled Data Engineer to deliver innovative data engineering and analytics projects. The ideal candidate will have a strong background in data engineering, with experience in Databricks, PySpark, Scala-Spark, and advanced SQL.Key ResponsibilitiesDesign, develop, and optimize...


  • Noida, Uttar Pradesh, India Transaction Network Services Full time

    An exceptionally talented group of individuals work together every day to drive TNS' success from both professional and personal perspectives. Overview A Cloud Architect is responsible for designing and implementing cloud-based infrastructure and applications, ensuring the scalability and availability of systems. This includes creating and maintaining...


  • Noida, Uttar Pradesh, India StaffSeek Full time

    Job Description for Senior PySpark DeveloperStaffSeek is seeking a highly skilled and experienced Senior PySpark Developer to join our team in Noida. As a Senior PySpark Developer, you will be responsible for developing and implementing PySpark solutions to process large datasets, collaborating with cross-functional teams to design and deliver efficient data...