Data Engineer, Pyspark

3 weeks ago

Gurugram Gurugram India NatWest Group Full time

Job Description Join us as a Data Engineer - We're looking for someone to build effortless, digital first customer experiences to help simplify our organisation and keep our data safe and secure - Day-to-day, you'll develop innovative, data-driven solutions through data pipelines, modelling and ETL design while inspiring to be commercially successful through insights - If you're ready for a new challenge, and want to bring a competitive edge to your career profile by delivering streaming data ingestions, this could be the role for you - We're offering this role at associate vice president level What you'll do Your daily responsibilities will include you developing a comprehensive knowledge of our data structures and metrics, advocating for change when needed for product development. You'll also provide transformation solutions and carry out complex data extractions. We'll expect you to develop a clear understanding of data platform cost levels to build cost-effective and strategic solutions. You'll also source new data by using the most appropriate tooling before integrating it into the overall solution to deliver it to our customers. You'll Also Be Responsible For - Driving customer value by understanding complex business problems and requirements to correctly apply the most appropriate and reusable tools to build data solutions - Participating in the data engineering community to deliver opportunities to support our strategic direction - Carrying out complex data engineering tasks to build a scalable data architecture and the transformation of data to make it usable to analysts and data scientists - Building advanced automation of data engineering pipelines through the removal of manual stages - Leading on the planning and design of complex products and providing guidance to colleagues and the wider team when required The skills you'll need To be successful in this role, you'll have an understanding of data usage and dependencies with wider teams and the end customer. You'll also have experience of extracting value and features from large scale data. We'll expect you to have at least seven years of experience in ETL technical design, data quality testing, cleansing and monitoring, data sourcing, exploration and analysis, and data warehousing and data modelling capabilities. You'll Also Need - Experience of using programming languages alongside knowledge of data and software engineering fundamentals - Experience in Oracle PL-SQL, PySpark, AWS S3, Glue, and Airflow - Good knowledge of modern code development practices - Great communication skills with the ability to proactively engage with a range of stakeholders

  • Data Engineer

    2 weeks ago

    Gurugram, India ACENET CONSULTING PRIVATE LIMITED Full time

    Experience : 4 to 6 years.Location : Gurgaon.About Us :AceNet Consulting is a fast-growing global business and technology consulting firm specializing in business strategy, digital transformation, technology consulting, product development, start-up advisory and fund-raising services to our global clients across banking & financial services, healthcare,...

  • Data Engineer

    2 days ago

    Gurugram, India SkillKart Full time

    We are seeking a skilled Data Engineer to join our team. The successful candidate will be responsible for maintaining and optimizing data pipelines, implementing robust data checks, and ensuring the accuracy and integrity of data flows. This role is critical in supporting data-driven decision-making processes, especially in the context of our...

  • Lead Data Analyst

    4 weeks ago

    Gurugram, India Insight Global, LLC Full time

    Job Description :Key Responsibilities :- Lead data-driven initiatives and mentor junior analysts within the analytics team.- Work cross-functionally with marketing, supply chain, and business units to deliver actionable insights.- Deploy analytics algorithms and tools on modern tech stacks for efficient data processing.- Develop data models, dashboards, and...

  • Manager-Data Engineering-Cloud Data Engineering

    3 weeks ago

    Gurugram, Gurugram, India EXL Full time

    Job Description Job Summary Data Engineer Consultant Job Description Data Engineer (DE) Consultant is responsible for designing, developing, and maintaining data assets and data related products by liaising with multiple stakeholders.. Qualifications And Skills - Strong knowledge on Python and Pyspark - Expectation is to have ability to write Pyspark scripts...

  • Lead GCP Data Engineer

    6 days ago

    Gurugram, Gurugram, India Impetus Full time

    Job Description Job Title: Lead Data Engineer GCP (BigQuery Composer Python PySpark) Location: Gurgaon Experience: 8+ years (data engineering / analytics engineering), with previous lead responsibilities About the Role: You will lead the design, build and operation of large-scale data platforms on the Google Cloud Platform. You will manage a team of data...

  • PySpark Developer

    3 weeks ago

    Gurugram, India Apex One Full time

    Job Description Key Skills & Responsibilities - Strong expertise in PySpark and Apache Spark for batch and real-time data processing. - Experience in designing and implementing ETL pipelines, including data ingestion, transformation, and validation. - Proficiency in Python for scripting, automation, and building reusable components. - Hands-on experience...

  • Data Engineer

    4 weeks ago

    Pune, Maharashtra, India, Maharashtra Tata Consultancy Services Full time

    Job Title :- Data Engineer - PysparkExperience: 5 to 8 YearsLocation: Pune/HyderabadJob DescriptionRequired Skills:5+ years of experience in Big data and pysparkMust-HaveGood work experience on Big Data Platforms like Hadoop, Spark, Scala, Hive, Impala, SQLGood-to-HaveGood Spark, Pyspark,Big Data experienceSpark UI/Optimization/debugging techniquesGood...

  • Pyspark-gurgaon

    1 week ago

    Gurugram, Haryana, India Cognizant Full time

    **Job Title: - Data Engineer with Pyspark** **Location: -**Gurgaon** **Drive date : 26th April 25 (Inperson)** **Job Type 3 days from office (Hybrid)** **Responsibilities** **Minimum 4 to 14 years of experience** **Mandatory Skills** 4+ years of exp in PySpark 2+ years of exp in AWS Glue/EMR Strong knowledge on SQL is required Excellent written &...

  • ▷ [Apply Now] Data Engineer

    1 week ago

    Gurugram, Gurugram, India Response Informatics Full time

    Job Description Databricks Data Engineer NP: Immediate joiner 30 days joiner Exp-6-9 yrs Location - Gurgaon Mandate- Spark, sql, pyspark, azure (all skills) Key Responsibilities: Design, build, and maintain scalable data pipelines using Databricks / Apache Spark. Develop and optimize data lake/warehouse architectures in Delta Lake. Implement ETL/ELT...

  • PySpark Data Engineer

    3 weeks ago

    India EXTRAGIG Full time

    🚀 Contract Assistant – Data Engineer Support (Remote, EST Hours) 🚀 📅 Start Date: Sept 10, 2025 ⏳ Duration: 6 months (extendable) 💰 Pay: $1,000/month 🕗 Work Hours: 8:00 AM – 5:30 PM EST We’re looking for a Contract Assistant to support a PySpark Data Engineer with daily activities. This is a remote contract role (not formal employment)....