Data Engineer, Pyspark

3 days ago

Gurugram Gurugram India NatWest Group Full time

Job Description Join us as a Data Engineer - We're looking for someone to build effortless, digital first customer experiences to help simplify our organisation and keep our data safe and secure - Day-to-day, you'll develop innovative, data-driven solutions through data pipelines, modelling and ETL design while inspiring to be commercially successful through insights - If you're ready for a new challenge, and want to bring a competitive edge to your career profile by delivering streaming data ingestions, this could be the role for you - We're offering this role at associate vice president level What you'll do Your daily responsibilities will include you developing a comprehensive knowledge of our data structures and metrics, advocating for change when needed for product development. You'll also provide transformation solutions and carry out complex data extractions. We'll expect you to develop a clear understanding of data platform cost levels to build cost-effective and strategic solutions. You'll also source new data by using the most appropriate tooling before integrating it into the overall solution to deliver it to our customers. You'll Also Be Responsible For - Driving customer value by understanding complex business problems and requirements to correctly apply the most appropriate and reusable tools to build data solutions - Participating in the data engineering community to deliver opportunities to support our strategic direction - Carrying out complex data engineering tasks to build a scalable data architecture and the transformation of data to make it usable to analysts and data scientists - Building advanced automation of data engineering pipelines through the removal of manual stages - Leading on the planning and design of complex products and providing guidance to colleagues and the wider team when required The skills you'll need To be successful in this role, you'll have an understanding of data usage and dependencies with wider teams and the end customer. You'll also have experience of extracting value and features from large scale data. We'll expect you to have at least seven years of experience in ETL technical design, data quality testing, cleansing and monitoring, data sourcing, exploration and analysis, and data warehousing and data modelling capabilities. You'll Also Need - Experience of using programming languages alongside knowledge of data and software engineering fundamentals - Experience in Oracle PL-SQL, PySpark, AWS S3, Glue, and Airflow - Good knowledge of modern code development practices - Great communication skills with the ability to proactively engage with a range of stakeholders

  • ▷ (High Salary) Data Engineer(Pyspark+SQL)

    1 week ago

    Gurugram, Gurugram, India Accolite Full time

    Job Description About The Role We are seeking an experienced Data Engineer to design, implement, and optimize a global data handling and synchronization solution across multiple regions. You will work with cloud-based databases, data lakes, and distributed systems, ensuring compliance with data residency and privacy requirements (e.g.,...

  • Lead Cloud Data Engineer

    4 weeks ago

    Gurugram, India upGrad Full time

    About the Job :We're hiring an cloud data engineering (preferably Azure) data pipelines and Spark. - Work with Databricks platform using Spark for big data processing and analytics. - Write optimized and efficient code using PySpark, Spark SQL and Python. - Develop and maintain ETL processes using Databricks notebooks and workflows. - Implement and...

  • Data Engineer

    4 weeks ago

    Gurugram, India ACENET CONSULTING PRIVATE LIMITED Full time

    Experience : 4 to 6 years.Location : Gurgaon.About Us :AceNet Consulting is a fast-growing global business and technology consulting firm specializing in business strategy, digital transformation, technology consulting, product development, start-up advisory and fund-raising services to our global clients across banking & financial services, healthcare,...

  • Snowflake Data Engineer

    4 weeks ago

    Gurugram, India Strategic HR Solutions Full time

    Job SummaryWe are seeking a highly skilled and hands-on Snowflake Data Engineer to join our data engineering team. This role requires a deep understanding of Snowflake's core components including Snowpipe, Streams, and Tasks, as well as strong experience with query profiling, data pipeline orchestration, and performance tuning. The ideal candidate will...

  • Azure Data Engineering Lead

    2 weeks ago

    Gurugram, India Techno Wise Full time

    Location : Gurugram (Work from Office 5 Days)Notice Period : Immediate to 45 DaysAbout the Role :We are looking for an experienced Azure Data Engineering Lead with strong expertise in Azure Data Factory, Databricks, PySpark, and SQL. This role requires both technical depth and leadership capability you will lead a team of 5+ engineers, architect and...

  • Lead Data Analyst

    7 days ago

    Gurugram, India Insight Global, LLC Full time

    Job Description :Key Responsibilities :- Lead data-driven initiatives and mentor junior analysts within the analytics team.- Work cross-functionally with marketing, supply chain, and business units to deliver actionable insights.- Deploy analytics algorithms and tools on modern tech stacks for efficient data processing.- Develop data models, dashboards, and...

  • Lead Data Engineer

    4 weeks ago

    Gurugram, India SUPERSOURCING TECHNOLOGIES PRIVATE LIMITED Full time

    About the Role:We are looking for an experienced Lead Data Engineer with deep expertise in Big Data technologies, particularly within the Google Cloud Platform (GCP) ecosystem. The ideal candidate should have a strong command of PySpark/Spark, SQL, and Python, and a proven track record in building, optimizing, and managing large- scale data pipelines and...

  • Python/Pyspark Developer

    2 weeks ago

    Gurugram, India DG Liger Consulting Full time

    We are looking for a skilled Python PySpark Developer with 34 years of experience in designing, developing, and maintaining big data solutions. The ideal candidate will have hands-on expertise in Python, PySpark, and data pipeline development, along with strong problem-solving skills and the ability to work in a collaborative environment.Key Responsibilities...

  • Data Engineer

    6 days ago

    Pune, Maharashtra, India, Maharashtra Tata Consultancy Services Full time

    Job Title :- Data Engineer - PysparkExperience: 5 to 8 YearsLocation: Pune/HyderabadJob DescriptionRequired Skills:5+ years of experience in Big data and pysparkMust-HaveGood work experience on Big Data Platforms like Hadoop, Spark, Scala, Hive, Impala, SQLGood-to-HaveGood Spark, Pyspark,Big Data experienceSpark UI/Optimization/debugging techniquesGood...

  • (15h Left) Data Engineer

    4 weeks ago

    Bengaluru, India NTT Data Full time

    Job Description Req ID:334009 NTT DATA strives to hire exceptional, innovative and passionate individuals who want to grow with us. If you want to be part of an inclusive, adaptable, and forward-thinking organization, apply now. We are currently seeking a Data Engineer (Talend &Pyspark) to join our team in Bangalore, Karntaka (IN-KA), India (IN). Job...