Data Engineer

2 hours ago

Gurugram Haryana India, IN GMG Full time

What we do:GMG is a global well-being company retailing, distributing and manufacturing a portfolio of leading international and home-grown brands across sport, food and health sectors. Its vision is to inspire people to win in ways that make the world better. Today, GMG’s investments span four key verticals: GMG Sports, GMG Food, GMG Health, and GMG Consumer Goods. Under the ownership and management of the Baker family, it has become a leading global company, affiliated with the world’s most successful and respected brands in the well-being sector. Working across the Middle East, North Africa, and Asia, GMG has introduced more than 120 brands into its markets.What will you do:We are seeking a highly skilled Data Engineer specializing in AWS and Databricks. The ideal candidate will design, build, and maintain scalable data pipelines, ensuring efficient data ingestion, processing, and integration from multiple sources. This role requires expertise in AWS services, PySpark, SQL, and Databricks, along with strong optimization, security, and cost management skills.Roles and Responsibilities:Data Engineering & Pipeline Development• Develop and manage ETL pipelines for structured, semi-structured, and unstructured data using AWS Glue, PySpark, and SQL.• Handle real-time event stream data ingestion and processing from multiple source systems.• Ensure efficient data integration into Databricks for advanced processing and analytics.Cloud & Infrastructure Management• Build and optimize backend systems leveraging AWS services (Glue, Athena, Lambda, SNS, S3).• Implement, configure, and manage Databricks environments, including clusters, notebooks, and libraries for performance optimization.• Ensure optimal resource utilization for AWS and Databricks clusters to improve efficiency and reduce costs.• Integrate Databricks with various cloud services while following governance and security best practices.Testing & CI/CD Best Practices• Write unit test cases and integration tests to ensure data pipeline reliability.• Establish best practices for Databricks CI/CD and implement automation for deployment.Optimization & Security• Apply performance tuning techniques to optimize queries, storage, and processing times.• Ensure compliance with security, governance, and industry best practices across AWS and Databricks environments.• Monitor system performance and proactively address issues to maintain high availability and reliability.Functional/Technical Competencies:Knowledge of Glue, PySpark, SQL, Athena, Lambda, SNS, S3Knowledge of Databricks : Cluster setup, Notebooks, Libraries, CI/CD, OptimizationData Processing: Event stream ingestion and batch processingTesting: Writing unit test cases and integration testsSecurity & Governance: AWS/Databricks governance standards and best practicesPerformance Optimization: Query tuning, cluster performance improvements, cost reductionStrong problem-solving and analytical skillsAbility to work in a fast-paced, cloud-based data environmentExcellent collaboration and communication skillsStrong attention to detail and commitment to best practicesEducational Qualification:Bachelor's in computer science or computer engineeringCertification in Data Engineering and AnalyticsExperience:Minimum 6 years' experience in Data engineering (Core development/design), in which 3+ years in AWS with command on (AWS glue, pyspark, SQL, Athena, lambda, SNS, S3) and 1+ year in Databricks.

  • Senior Data Engineer

    2 hours ago

    Gurugram, Haryana, India, IN Pacific Data Integrators Full time

    Role: Senior Data EngineerLocation: RemoteJob Type: Full-timeShift time: Open to work in EST shift (5PM to 2AM IST) Key ResponsibilitiesLead the design, development, and implementation of complex data integration solutions using Informatica Intelligent Data Management Cloud (IDMC).Develop, document, unit test, and maintain high-quality ETL applications that...

  • Data Engineer

    2 hours ago

    Gurugram, Haryana, India, IN Terra Technology Circle Consulting Private Limited Full time

    Job Title: Data EngineerExperience: 4–8 yearsLocation: GurugramEmployment Type: ContractualAbout the RoleWe are seeking a highly skilled and motivated Data Engineer to join our growing data and analytics team. In this role, you will design, build, and optimize scalable data pipelines and architectures to support analytics, machine learning, and business...

  • Data Engineer

    2 hours ago

    Gurugram, Haryana, India, IN Sirius AI Full time

    Data Engineer Job Description About Sirius AI Sirius AI is a US headquartered AI Consulting services and products company with operations in India. Sirius AI focuses on Financial Services enterprises and solutions / services delivered across multiple geographies. We are an innovation-driven AI and data driven consulting services firm with a high focus on...

  • Data Engineer

    3 hours ago

    Gurugram, Haryana, India, IN EXL Full time

    Key Responsibilities:Design and develop ETL/ELT pipelines using Azure Data Factory, Snowflake, and DBT.Build and maintain data integration workflows from various data sources to Snowflake.Write efficient and optimized SQL queries for data extraction and transformation.Work with stakeholders to understand business requirements and translate them into...

  • Data Engineer

    2 hours ago

    Gurugram, Haryana, India, IN IGT Solutions Full time

    Job Title: Senior Data EngineerExperience: 6 to 9 YearsLocation: Hybrid (Gurgaon)Employment Type: Full-timeJob Summary:We are seeking a highly skilled Senior Data Engineer with hands-on experience in Databricks, PySpark, ETL development, and SQL. The ideal candidate will be responsible for designing, developing, and optimizing scalable data pipelines and...

  • Data Engineer

    2 hours ago

    Gurugram, Haryana, India, IN Azilen Technologies Full time

    Job purpose:Manage and create design schema, SQL query tuning, and code review.Who you are:Min 4+ years of professional experience in the field of data engineering with knowledge of the data platform and DWH developmentMin. 2 years of hands-on experience in SSAS tabular modelsDesigned Data Ingestion and Orchestration Pipelines with Kafka and PythonProven...

  • Senior Data Engineer

    2 hours ago

    Gurugram, Haryana, India, IN dunnhumby Full time

    Retail Media is transforming how advertisers connect with consumers through personalized and targeted campaigns across retailers' digital and physical touchpoints. Retail Media Measurement plays a pivotal role in ensuring the effectiveness of these campaigns, driving value for advertisers, retailers, and consumers alike.This role focuses on designing,...

  • Data Engineer

    2 hours ago

    Gurugram, Haryana, India, IN NAB Full time

    Experience – 4 to 14 years Skills -• Proficient in executing ETL processes between data environments• Proficient at coding in SQL (additional knowledge in Python and R is highly regarded)• Proficient at creating analytics related documentation• Communication skills (written and verbal)• Stakeholder engagement skills• Commercial problem-solving...

  • Lead GCP Data Engineer

    2 hours ago

    Gurugram, Haryana, India, IN Impetus Full time

    Job Title: Lead Data Engineer – GCP (BigQuery • Composer • Python • PySpark)Location: GurgaonExperience: 8+ years (data engineering / analytics engineering), with previous lead responsibilitiesAbout the Role:You will lead the design, build and operation of large-scale data platforms on the Google Cloud Platform. You will manage a team of data...

  • GCP data Engineer

    2 hours ago

    Gurugram, Haryana, India, IN Impetus Full time

    Location: Gurgaon and BangaloreExperience: 8+ years (data engineering / analytics engineering), with previous lead responsibilitiesJob Descriptions for Big data or Cloud EngineerWe are looking for candidates with hands on experience in pyspark with GCP cloud.Qualifications3-10 years of IT experience range is preferred.Able to effectively use GCP managed...