Data Engineer

1 day ago

haryana, India GMG Full time

What we do: GMG is a global well-being company retailing, distributing and manufacturing a portfolio of leading international and home-grown brands across sport, food and health sectors. Its vision is to inspire people to win in ways that make the world better. Today, GMG’s investments span four key verticals: GMG Sports, GMG Food, GMG Health, and GMG Consumer Goods. Under the ownership and management of the Baker family, it has become a leading global company, affiliated with the world’s most successful and respected brands in the well-being sector. Working across the Middle East, North Africa, and Asia, GMG has introduced more than 120 brands into its markets. What will you do: We are seeking a highly skilled Data Engineer specializing in AWS and Databricks. The ideal candidate will design, build, and maintain scalable data pipelines, ensuring efficient data ingestion, processing, and integration from multiple sources. This role requires expertise in AWS services, PySpark, SQL, and Databricks, along with strong optimization, security, and cost management skills. Roles and Responsibilities: Data Engineering & Pipeline Development • Develop and manage ETL pipelines for structured, semi-structured, and unstructured data using AWS Glue, PySpark, and SQL. • Handle real-time event stream data ingestion and processing from multiple source systems. • Ensure efficient data integration into Databricks for advanced processing and analytics. Cloud & Infrastructure Management • Build and optimize backend systems leveraging AWS services (Glue, Athena, Lambda, SNS, S3). • Implement, configure, and manage Databricks environments, including clusters, notebooks, and libraries for performance optimization. • Ensure optimal resource utilization for AWS and Databricks clusters to improve efficiency and reduce costs. • Integrate Databricks with various cloud services while following governance and security best practices. Testing & CI/CD Best Practices • Write unit test cases and integration tests to ensure data pipeline reliability. • Establish best practices for Databricks CI/CD and implement automation for deployment. Optimization & Security • Apply performance tuning techniques to optimize queries, storage, and processing times. • Ensure compliance with security, governance, and industry best practices across AWS and Databricks environments. • Monitor system performance and proactively address issues to maintain high availability and reliability. Functional/Technical Competencies: Knowledge of Glue, PySpark, SQL, Athena, Lambda, SNS, S3 Knowledge of Databricks : Cluster setup, Notebooks, Libraries, CI/CD, Optimization Data Processing: Event stream ingestion and batch processing Testing: Writing unit test cases and integration tests Security & Governance: AWS/Databricks governance standards and best practices Performance Optimization: Query tuning, cluster performance improvements, cost reduction Strong problem-solving and analytical skills Ability to work in a fast-paced, cloud-based data environment Excellent collaboration and communication skills Strong attention to detail and commitment to best practices Educational Qualification: Bachelor's in computer science or computer engineering Certification in Data Engineering and Analytics Experience: Minimum 6 years' experience in Data engineering (Core development/design), in which 3+ years in AWS with command on (AWS glue, pyspark, SQL, Athena, lambda, SNS, S3) and 1+ year in Databricks.

  • Senior Data Engineer

    17 hours ago

    haryana, India Pacific Data Integrators Full time

    Role: Senior Data EngineerLocation: RemoteJob Type: Full-timeShift time: Open to work in EST shift (5PM to 2AM IST) Key ResponsibilitiesLead the design, development, and implementation of complex data integration solutions using Informatica Intelligent Data Management Cloud (IDMC).Develop, document, unit test, and maintain high-quality ETL applications that...

  • Data Engineer

    20 hours ago

    haryana, India Terra Technology Circle Consulting Private Limited Full time

    Job Title: Data EngineerExperience: 4–8 yearsLocation: GurugramEmployment Type: ContractualAbout the RoleWe are seeking a highly skilled and motivated Data Engineer to join our growing data and analytics team. In this role, you will design, build, and optimize scalable data pipelines and architectures to support analytics, machine learning, and business...

  • Data Engineer-Cloud Engineer-Cloud Data Engineer

    21 hours ago

    haryana, India EXL Full time

    DescriptionData Engineers design and build data systems and pipelines. Responsibilities include developing data processing workflows, optimizing data storage, and ensuring data accuracy. Design and deployment of analytical models and dashboards to uncover insights, predict trends and inform decision-making.Collaborate and provide data support to...

  • Data Engineer

    24 hours ago

    haryana, India IGT Solutions Full time

    Job Title: Senior Data EngineerExperience: 6 to 9 YearsLocation: Hybrid (Gurgaon)Employment Type: Full-timeJob Summary:We are seeking a highly skilled Senior Data Engineer with hands-on experience in Databricks, PySpark, ETL development, and SQL. The ideal candidate will be responsible for designing, developing, and optimizing scalable data pipelines and...

  • Data Engineer

    1 week ago

    haryana, India Talent Worx Full time

    Position: Data Engineer (Sr. Analyst)JOB SUMMARYThe Data Engineer will have responsibility to use various methods to transform raw data into usefuldata systems and should have strong analytical skills and the ability to combine data from differentsources. The person must have familiarity with several programming languages and knowledge oflearning machine...

  • Data Engineer

    23 hours ago

    haryana, India Azilen Technologies Full time

    Job purpose:Manage and create design schema, SQL query tuning, and code review.Who you are:Min 4+ years of professional experience in the field of data engineering with knowledge of the data platform and DWH developmentMin. 2 years of hands-on experience in SSAS tabular modelsDesigned Data Ingestion and Orchestration Pipelines with Kafka and PythonProven...

  • Data Engineer

    19 hours ago

    haryana, India CashKaro.com Full time

    Company Overview:CashKaro is India’s #1 cashback platform, trusted by over 25 million users! We drive more sales for Amazon, Flipkart, Myntra, and Ajio than any other paid channels, including Google and Meta. Backed by legendary investor Ratan Tata and a recent $16 million boost from Affle, we’re on a rocket ship journey—already surpassing ₹300 crore...

  • Principal Data Engineer

    20 hours ago

    haryana, India MakeMyTrip Full time

    Role: Principal Data EngineerLocation: GurgaonYears of Experience: 8-10 YearsAbout Role:We are looking for experienced Data engineers with excellent problem-solving skills to develop machine-learning powered Data Products design to enhance customer experiences.About us:Nurtured from the seed of a single great idea - to empower the traveler - MakeMyTrip went...

  • Senior Data Engineer

    23 hours ago

    haryana, India Atomic North Full time

    Position: Senior Data Engineer (Azure)Experience: 6+ yearsSkills: Azure Databricks, PySpark, Python, SQL, Azure Data Factory, Data Modelling, Data Migration, Data WarehousingLocation: India (Remote / Hybrid options available)Interview Mode: VirtualNotice Period: Immediate to 30 Days💼 Key ResponsibilitiesDesign and develop data pipelines and ETL workflows...

  • Lead Data Engineer

    24 hours ago

    haryana, India MakeMyTrip Full time

    Role: Lead Data EngineerLocation: GurgaonYears of Experience: 6 -8 YearsAbout the function:At MakeMyTrip (MMT), technology is at the heart of everything we do. As a leading player in the travel industry, we leverage cutting-edge solutions like AI, machine learning, and cloud infrastructure to create seamless and innovative travel experiences. We prioritize a...