▷ (High Salary) Data Engineer(Pyspark+SQL)

7 days ago


Gurugram Gurugram India Accolite Full time

Job Description

About The Role

We are seeking an experienced Data Engineer to design, implement, and optimize a global data handling and synchronization solution across multiple regions. You will work with cloud-based databases, data lakes, and distributed systems, ensuring compliance with data residency and privacy requirements (e.g., GDPR).

Requirements

6+ years of experience as a Data Engineer in cloud environments (preferably Microsoft Azure).

Strong knowledge of Azure SQL, Data Lake, Data Factory, PySpark, and related services.

Experience in Spark Optimization.

Experience with distributed data architectures and data synchronization across regions.

Familiarity with data privacy, security, and compliance (GDPR, etc.).

Proficiency in Python, SQL, and ETL tools.

Excellent problem-solving and communication skills.

Hands-on and self-contributing.

Preferred

Experience with MS-SQL, Cosmos DB, Databricks, and event-driven architectures.

Knowledge of CI/CD and infrastructure-as-code (Azure DevOps, ARM/Bicep, Terraform).

Key Responsibilities

Design and implement data pipelines for global and regional data synchronization (Azure SQL, Data Lake, Data Factory, PySpark, etc.).

Develop solutions for secure handling of PII and non-PII data, ensuring compliance with GDPR and other regulations.

Build and optimize ETL processes for anonymization, transformation, global synchronization and distribution of data.

Collaborate with software architects and DevOps to integrate data flows with application logic and deployment pipelines.

Set up monitoring, alerting, and documentation for data processes within the existing frameworks.

Advise on best practices for data partitioning, replication, and schema evolution.



  • Gurugram, India upGrad Full time

    About the Job :We're hiring an cloud data engineering (preferably Azure) data pipelines and Spark. - Work with Databricks platform using Spark for big data processing and analytics. - Write optimized and efficient code using PySpark, Spark SQL and Python. - Develop and maintain ETL processes using Databricks notebooks and workflows. - Implement and...


  • Gurugram, India Techno Wise Full time

    Location : Gurugram (Work from Office 5 Days)Notice Period : Immediate to 45 DaysAbout the Role :We are looking for an experienced Azure Data Engineering Lead with strong expertise in Azure Data Factory, Databricks, PySpark, and SQL. This role requires both technical depth and leadership capability you will lead a team of 5+ engineers, architect and...


  • Gurugram, Gurugram, India NatWest Group Full time

    Job Description Join us as a Data Engineer - We're looking for someone to build effortless, digital first customer experiences to help simplify our organisation and keep our data safe and secure - Day-to-day, you'll develop innovative, data-driven solutions through data pipelines, modelling and ETL design while inspiring to be commercially successful through...


  • Gurugram, India Skeps Full time

    Responsibilities :- Develop and maintain scalable data pipelines using PySpark and Delta Lake, ensuring efficient processing of large, structured, and semi-structured datasets.- Analyse complex data sets using SQL, Python (Pandas, NumPy, scikit-learn, Seaborn) to identify trends, patterns, and opportunities for process improvement.- Continuously optimize the...

  • Data Engineer

    2 weeks ago


    Pune, India Barclays Full time

    Job Description Join us as a Data Engineer - Pyspark,SQL at Barclays, where you'll spearhead the evolution of our digital landscape, driving innovation and excellence. You'll harness cutting-edge technology to revolutionise our digital offerings, ensuring unparalleled customer experiences. As a part of team of developers, you will deliver technology stack,...

  • Data Scientist

    2 weeks ago


    Gurugram, Gurugram, India GSPANN Technologies, Inc Full time

    Job Description Python, PySpark, Machine Learning, pytest, Data Science, Power BI, Tableau, Data Modeling Description GSPANN is hiring an experienced Data Scientist to build Machine Learning (ML) models, analyze large datasets, and deliver actionable business insights. Expertise in Python/R, leading ML frameworks, and visualization tools like Power BI or...

  • Data Engineer

    3 weeks ago


    Gurugram, India ACENET CONSULTING PRIVATE LIMITED Full time

    Experience : 4 to 6 years.Location : Gurgaon.About Us :AceNet Consulting is a fast-growing global business and technology consulting firm specializing in business strategy, digital transformation, technology consulting, product development, start-up advisory and fund-raising services to our global clients across banking & financial services, healthcare,...

  • Lead Data Analyst

    5 days ago


    Gurugram, India Insight Global, LLC Full time

    Job Description :Key Responsibilities :- Lead data-driven initiatives and mentor junior analysts within the analytics team.- Work cross-functionally with marketing, supply chain, and business units to deliver actionable insights.- Deploy analytics algorithms and tools on modern tech stacks for efficient data processing.- Develop data models, dashboards, and...

  • Lead Data Engineer

    3 weeks ago


    Gurugram, India SUPERSOURCING TECHNOLOGIES PRIVATE LIMITED Full time

    About the Role:We are looking for an experienced Lead Data Engineer with deep expertise in Big Data technologies, particularly within the Google Cloud Platform (GCP) ecosystem. The ideal candidate should have a strong command of PySpark/Spark, SQL, and Python, and a proven track record in building, optimizing, and managing large- scale data pipelines and...

  • Data Engineer

    5 days ago


    Pune, Maharashtra, India, Maharashtra Tata Consultancy Services Full time

    Job Title :- Data Engineer - PysparkExperience: 5 to 8 YearsLocation: Pune/HyderabadJob DescriptionRequired Skills:5+ years of experience in Big data and pysparkMust-HaveGood work experience on Big Data Platforms like Hadoop, Spark, Scala, Hive, Impala, SQLGood-to-HaveGood Spark, Pyspark,Big Data experienceSpark UI/Optimization/debugging techniquesGood...