Data Engineer

24 hours ago

Gurgaon, India GMG Full time

What we do:GMG is a global well-being company retailing, distributing and manufacturing a portfolio of leading international and home-grown brands across sport, food and health sectors. Its vision is to inspire people to win in ways that make the world better. Today, GMG’s investments span four key verticals: GMG Sports, GMG Food, GMG Health, and GMG Consumer Goods. Under the ownership and management of the Baker family, it has become a leading global company, affiliated with the world’s most successful and respected brands in the well-being sector. Working across the Middle East, North Africa, and Asia, GMG has introduced more than 120 brands into its markets.What will you do:We are seeking a highly skilled Data Engineer specializing in AWS and Databricks. The ideal candidate will design, build, and maintain scalable data pipelines, ensuring efficient data ingestion, processing, and integration from multiple sources. This role requires expertise in AWS services, PySpark, SQL, and Databricks, along with strong optimization, security, and cost management skills.Roles and Responsibilities:Data Engineering & Pipeline Development• Develop and manage ETL pipelines for structured, semi-structured, and unstructured data using AWS Glue, PySpark, and SQL.• Handle real-time event stream data ingestion and processing from multiple source systems.• Ensure efficient data integration into Databricks for advanced processing and analytics.Cloud & Infrastructure Management• Build and optimize backend systems leveraging AWS services (Glue, Athena, Lambda, SNS, S3).• Implement, configure, and manage Databricks environments, including clusters, notebooks, and libraries for performance optimization.• Ensure optimal resource utilization for AWS and Databricks clusters to improve efficiency and reduce costs.• Integrate Databricks with various cloud services while following governance and security best practices.Testing & CI/CD Best Practices• Write unit test cases and integration tests to ensure data pipeline reliability.• Establish best practices for Databricks CI/CD and implement automation for deployment.Optimization & Security• Apply performance tuning techniques to optimize queries, storage, and processing times.• Ensure compliance with security, governance, and industry best practices across AWS and Databricks environments.• Monitor system performance and proactively address issues to maintain high availability and reliability.Functional/Technical Competencies:- Knowledge of Glue, PySpark, SQL, Athena, Lambda, SNS, S3- Knowledge of Databricks : Cluster setup, Notebooks, Libraries, CI/CD, Optimization- Data Processing: Event stream ingestion and batch processing- Testing: Writing unit test cases and integration tests- Security & Governance: AWS/Databricks governance standards and best practices- Performance Optimization: Query tuning, cluster performance improvements, cost reduction- Strong problem-solving and analytical skills- Ability to work in a fast-paced, cloud-based data environment- Excellent collaboration and communication skills- Strong attention to detail and commitment to best practicesEducational Qualification:- Bachelor's in computer science or computer engineering- Certification in Data Engineering and AnalyticsExperience:Minimum 6 years' experience in Data engineering (Core development/design), in which 3+ years in AWS with command on (AWS glue, pyspark, SQL, Athena, lambda, SNS, S3) and 1+ year in Databricks.

  • Senior/Lead Data Engineer

    4 days ago

    Gurgaon, Haryana, India Eucloid Data Solutions Full time ₹ 12,00,000 - ₹ 36,00,000 per year

    Role: Senior Lead Data EngineerAbout The Role:Eucloid is looking for a senior/ lead Data Engineer to join our Data Platform team supporting various business applications. The ideal candidate will support development of data infrastructure on Databricks for our clients by participating in activities which may include starting from up- stream and down-stream...

  • Senior Data Engineer

    2 days ago

    Gurgaon, India Pacific Data Integrators Full time

    Role: Senior Data Engineer Location: Remote Job Type: Full-time Shift time: Open to work in EST shift (5PM to 2AM IST) Key Responsibilities Lead the design, development, and implementation of complex data integration solutions using Informatica Intelligent Data Management Cloud (IDMC). Develop, document, unit test, and maintain high-quality ETL applications...

  • Senior Data Engineer

    6 days ago

    Gurgaon, Haryana, India Pacific Data Integrators Full time ₹ 12,00,000 - ₹ 36,00,000 per year

    Role: Senior Data EngineerLocation: RemoteJob Type: Full-timeShift time: Open to work in EST shift (5PM to 2AM IST)Key ResponsibilitiesLead the design, development, and implementation of complex data integration solutions using Informatica Intelligent Data Management Cloud (IDMC).Develop, document, unit test, and maintain high-quality ETL applications that...

  • Data Scientist

    2 weeks ago

    Gurgaon, Haryana, India Data Sutram Full time ₹ 20,00,000 - ₹ 25,00,000 per year

    *Data Sutram,*funded by India Infoline (IIFL), Indian Angel Network (IAN) and 100x.VC (led by Sanjay Mehta), is an alternate data company, using external data feeds to create every location's DNA that is utilized in various use cases like credit underwriting, location profiling, site selection, etc. It is one of the fastest-growing companies in the space of...

  • Data Engineer Advisor

    3 days ago

    Gurgaon, Haryana, India NTT DATA, Inc. Full time ₹ 12,00,000 - ₹ 24,00,000 per year

    We are currently seeking a Data Engineer Advisor to join our team in Gurgaon, Haryna (IN-HR), India (IN).Technical Support:Provide L1, L2 and L3 support for software applications. Troubleshoot and resolve application-related issues for end-users. Collaborate with developers, IT teams, and external vendors to address issues and implement fixes.Escalate...

  • Senior Data Engineer

    1 day ago

    gurgaon district, India Pacific Data Integrators Full time

    Role: Senior Data Engineer Location: Remote Job Type: Full-time Shift time: Open to work in EST shift (5PM to 2AM IST) Key Responsibilities Lead the design, development, and implementation of complex data integration solutions using Informatica Intelligent Data Management Cloud (IDMC). Develop, document, unit test, and maintain high-quality ETL applications...

  • Senior data engineer

    5 hours ago

    Gurgaon, India Pacific Data Integrators Full time

    Role: Senior Data EngineerLocation: RemoteJob Type: Full-timeShift time: Open to work in EST shift (5 PM to 2 AM IST)Key Responsibilities- Lead the design, development, and implementation of complex data integration solutions using Informatica Intelligent Data Management Cloud (IDMC).- Develop, document, unit test, and maintain high-quality ETL applications...

  • Senior Data Engineer

    8 hours ago

    Gurgaon, India Pacific Data Integrators Full time

    Role: Senior Data EngineerLocation: RemoteJob Type: Full-timeShift time: Open to work in EST shift (5PM to 2AM IST)Key Responsibilities- Lead the design, development, and implementation of complex data integration solutions using Informatica Intelligent Data Management Cloud (IDMC).- Develop, document, unit test, and maintain high-quality ETL applications...

  • Senior data engineer

    1 hour ago

    Gurgaon, India Pacific Data Integrators Full time

    Role: Senior Data EngineerLocation: RemoteJob Type: Full-timeShift time: Open to work in EST shift (5 PM to 2 AM IST)Key Responsibilities- Lead the design, development, and implementation of complex data integration solutions using Informatica Intelligent Data Management Cloud (IDMC).- Develop, document, unit test, and maintain high-quality ETL applications...

  • Senior Tableau Data Consultant

    7 days ago

    Gurgaon, Haryana, India Eucloid Data Solutions Full time ₹ 6,00,000 - ₹ 18,00,000 per year

    We are looking for a high-energy individual for the role of Data Consultant – Tableau Expert at Eucloid. The candidate will collaborate with client stakeholders on multiple projects, primarily focusing on building impactful visualizations and dashboards that drive business decisions.The candidate is expected to lead the following work-streams: Partner...