Data Engineer(Pyspark+SQL)

4 hours ago


Gurgaon, Haryana, India Accolite Full time ₹ 15,00,000 - ₹ 25,00,000 per year

About The Role
We are seeking an experienced Data Engineer to design, implement, and optimize a global data handling and synchronization solution across multiple regions. You will work with cloud-based databases, data lakes, and distributed systems, ensuring compliance with data residency and privacy requirements (e.g., GDPR).

Requirements
6+ years of experience as a Data Engineer in cloud environments (preferably Microsoft Azure).

Strong knowledge of Azure SQL, Data Lake, Data Factory, PySpark, and related services.

Experience in Spark Optimization.

Experience with distributed data architectures and data synchronization across regions.

Familiarity with data privacy, security, and compliance (GDPR, etc.).

Proficiency in Python, SQL, and ETL tools.

Excellent problem-solving and communication skills.

Hands-on and self-contributing.

Preferred
Experience with MS-SQL, Cosmos DB, Databricks, and event-driven architectures.

Knowledge of CI/CD and infrastructure-as-code (Azure DevOps, ARM/Bicep, Terraform).

Key Responsibilities
Design and implement data pipelines for global and regional data synchronization (Azure SQL, Data Lake, Data Factory, PySpark, etc.).

Develop solutions for secure handling of PII and non-PII data, ensuring compliance with GDPR and other regulations.

Build and optimize ETL processes for anonymization, transformation, global synchronization and distribution of data.

Collaborate with software architects and DevOps to integrate data flows with application logic and deployment pipelines.

Set up monitoring, alerting, and documentation for data processes within the existing frameworks.

Advise on best practices for data partitioning, replication, and schema evolution.


  • PySpark Developer

    3 weeks ago


    Gurgaon, Haryana, India NPG Consultants Full time

    We are seeking a highly skilled PySpark Developer with 7+ years of experience and expertise in Reltio MDM to join our data engineering team. You will design and implement scalable data processing solutions, integrate enterprise systems with Reltio, and ensure high-quality data governance.Key Responsibilities :- Develop and maintain PySpark data pipelines on...


  • Gurgaon, Haryana, India IDESLABS PRIVATE LIMITED Full time ₹ 15,00,000 - ₹ 25,00,000 per year

    We are looking for a skilled ETL Testing professional with 6-12 years of experience to join our team in Bengaluru. The ideal candidate will have expertise in database testing using SQL and experience working with Databricks.Roles and ResponsibilityDevelop and execute comprehensive test plans, test cases, and test scripts for ETL processes.Verify the accuracy...


  • Gurgaon, Haryana, India IDESLABS PRIVATE LIMITED Full time ₹ 15,00,000 - ₹ 25,00,000 per year

    At least 6-8 yrs of experience in ETL Testing with Automation Testing Expert in database testing using SQL. Must have worked on Databricks and aware of Databricks related concepts Check the data source locations and formats, perform a data count, and verify that the columns and data types meet the requirements. Test the accuracy of the data, and its...


  • Gurgaon, Haryana, India Recro Full time ₹ 15,00,000 - ₹ 30,00,000 per year

    We are seeking an experienced Senior AWS Data Engineer or Data Engineering Manager with 12 years of hands-on expertise in designing, building, and managing scalable data platforms on AWS. The ideal candidate will have deep knowledge of AWS services including Redshift, Glue, Lambda, Athena, S3, and strong proficiency in SQL and PySpark. Key...


  • Gurgaon, Haryana, India RBS Full time ₹ 1,50,00,000 - ₹ 2,50,00,000 per year

    Join us as a Software Engineer, PySparkThis is an opportunity for a technically minded individual to join us as a Software EngineerYou'll be designing, producing, testing and implementing working software, working across the lifecycle of the systemHone your existing software engineering skills and advance your career in this critical roleWe're offering this...

  • Gcp Data Engineer

    4 weeks ago


    Gurgaon, Haryana, India Infosys Limited Full time

    Job Description- Experienced Data Engineer with hands on experience on GCP offerings experienced in BigQuery/BigTable/Pyspark- Worked on prior data engineering projects leveraging GCP product offerings- Strong SQL background- Prior Amex experience is a big Plus


  • Gurgaon, Haryana, India Accolite Full time ₹ 12,00,000 - ₹ 36,00,000 per year

    About The RoleWe are looking for a Lead Data Engineer to architect and guide the design and implementation of a global data handling and synchronization platform. In addition to being hands-on, you will provide technical leadership to a small team of data engineers and advise on master data management (MDM) best practices, ensuring compliance with global...

  • Lead Data Engineer

    2 weeks ago


    Gurgaon, Haryana, India WOW Softech Full time ₹ 20,00,000 - ₹ 25,00,000 per year

    Exp- 8-15 years3+ years of hands on experience in Azure Data Engineering development project2+ years of experience in Databricks development2+ years of experience in PySpark.2+ years of experience in SQLProficient in SQL2+ years of experience in leading at least a 5+ member team in data engineering deliveryMust be fluent in communicationRole &...

  • Data Engineer

    8 hours ago


    Gurgaon, Haryana, India NAB Full time ₹ 15,00,000 - ₹ 25,00,000 per year

    • Bachelor's degree in Computer Science, Engineering, or related field.• 5–8 years of hands-on experience in data engineering.• Strong programming experience in Python, PySpark and databricks for big data processing.• Solid experience in SQL writing.• Proven experience working on AWS services such as S3, EMR.• Proficient in building and...

  • Senior Data Engineer

    3 weeks ago


    Gurgaon, Haryana, India Avisoft Full time

    About the RoleWe are seeking a highly skilled Senior Data Engineer to design, build, and optimize scalable data platforms that empower data-driven decision-making.This role requires deep technical expertise in modern data engineering frameworks, architectural patterns, and cloud-native solutions on AWS.You will be a key contributor to our data strategy,...