Data Engineer

23 hours ago

Chennai, Tamil Nadu, India GMG Full time ₹ 15,00,000 - ₹ 20,00,000 per year

What we do: GMG is a global well-being company retailing, distributing and manufacturing a portfolio of leading international and home-grown brands across sport, food and health sectors. Its vision is to inspire people to win in ways that make the world better.

Today, GMG's investments span four key verticals: GMG Sports, GMG Food, GMG Health, and GMG Consumer Goods. Under the ownership and management of the Baker family, it has become a leading global company, affiliated with the world's most successful and respected brands in the well-being sector.

Working across the Middle East, North Africa, and Asia, GMG has introduced more than 120 brands into its markets.

What will you do: We are seeking a highly skilled Data Engineer specializing in AWS and Databricks. The ideal candidate will design, build, and maintain scalable data pipelines, ensuring efficient data ingestion, processing, and integration from multiple sources. This role requires expertise in AWS services, PySpark, SQL, and Databricks, along with strong optimization, security, and cost management skills.

Roles and Responsibilities: Data Engineering & Pipeline Development

  • Develop and manage ETL pipelines for structured, semi-structured, and unstructured data using AWS Glue, PySpark, and SQL.
  • Handle real-time event stream data ingestion and processing from multiple source systems.
  • Ensure efficient data integration into Databricks for advanced processing and analytics.

Cloud & Infrastructure Management

  • Build and optimize backend systems leveraging AWS services (Glue, Athena, Lambda, SNS, S3).
  • Implement, configure, and manage Databricks environments, including clusters, notebooks, and libraries for performance optimization.
  • Ensure optimal resource utilization for AWS and Databricks clusters to improve efficiency and reduce costs.
  • Integrate Databricks with various cloud services while following governance and security best practices.

Testing & CI/CD Best Practices

  • Write unit test cases and integration tests to ensure data pipeline reliability.
  • Establish best practices for Databricks CI/CD and implement automation for deployment.

Optimization & Security

  • Apply performance tuning techniques to optimize queries, storage, and processing times.
  • Ensure compliance with security, governance, and industry best practices across AWS and Databricks environments.
  • Monitor system performance and proactively address issues to maintain high availability and reliability.

Functional/Technical Competencies: Knowledge of Glue, PySpark, SQL, Athena, Lambda, SNS, S3 Knowledge of Databricks : Cluster setup, Notebooks, Libraries, CI/CD, Optimization

Data Processing: Event stream ingestion and batch processing Testing: Writing unit test cases and integration tests Security & Governance: AWS/Databricks governance standards and best practices

Performance Optimization: Query tuning, cluster performance improvements, cost reduction Strong problem-solving and analytical skills Ability to work in a fast-paced, cloud-based data environment

Excellent collaboration and communication skills Strong attention to detail and commitment to best practices

Educational Qualification: Bachelor's in computer science or computer engineering Certification in Data Engineering and Analytics

Experience: Minimum 6 years' experience in Data engineering (Core development/design), in which 3 years in AWS with command on (AWS glue, pyspark, SQL, Athena, lambda, SNS, S3) and 1 year in Databricks.

  • Data Engineer

    3 weeks ago

    Chennai, Tamil Nadu, India Quantrail Data Full time

    Location: Chennai, India (On-site)Duration: 3 monthsStipend: UnpaidEligibility: 2025 graduates onlyConversion: Opportunity for a full-time role based on performance Note: Please apply only if you are serious about joining us. This is a learning-focused internship, and we expect interns to be committed to upskilling themselves and contributing to real-world...

  • Data Engineer

    21 hours ago

    Chennai, Tamil Nadu, India Quantrail Data Full time US$ 60,000 - US$ 1,00,000 per year

    Location: Chennai, India (On-site)Duration: 3 monthsStipend: UnpaidEligibility:2025 graduates onlyConversion: Opportunity for a full-time role based on performance Note: Please apply only if you are serious about joining us. This is a learning-focused internship, and we expect interns to be committed to upskilling themselves and contributing to real-world...

  • Data Engineer

    20 hours ago

    Chennai, Tamil Nadu, India NTT DATA Full time US$ 80,000 - US$ 1,20,000 per year

    Req ID: 336026NTT DATA strives to hire exceptional, innovative and passionate individuals who want to grow with us. If you want to be part of an inclusive, adaptable, and forward-thinking organization, apply now. We are currently seeking a Data Engineer - Azure to join our team in Chennai, Tamil Nādu (IN-TN), India (IN). "Job Duties: Key Responsibilities:...

  • Career Opportunity

    4 days ago

    Chennai, Tamil Nadu, India beBeeData Engineer Full time ₹ 1,04,000 - ₹ 1,30,878

    Job Summary">This role is responsible for participating as an individual contributor in project teams, troubleshooting operational issues, and providing technical solutions to operational problems.The ideal candidate will have experience with Python, SQL, and Bash Scripting, as well as knowledge of data pipeline fundamentals and general understanding of...

  • Data Engineer

    2 hours ago

    Chennai, Tamil Nadu, India CustomerLabs ❤️ 1P Data OPs Full time ₹ 9,00,000 - ₹ 12,00,000 per year

    As a Data Engineer (GCP) at CustomerLabs Inc., you will play a crucial role in designing, developing, and maintaining our data infrastructure on Google Cloud Platform. You will be responsible for ensuring the reliability, scalability, and efficiency of our data pipelines to support our analytics and machine learning initiatives.Key ResponsibilitiesDesign and...

  • Data Engineer

    2 weeks ago

    Chennai, Tamil Nadu, India NTT DATA North America Full time ₹ 15,00,000 - ₹ 20,00,000 per year

    Req ID: NTT DATA strives to hire exceptional, innovative and passionate individuals who want to grow with us. If you want to be part of an inclusive, adaptable, and forward-thinking organization, apply now.We are currently seeking a Data Engineer - Azure to join our team in Chennai, Tamil Nādu (IN-TN), India (IN)."Job Duties: Key Responsibilities:•  ...

  • Data Engineer

    19 hours ago

    Chennai, Tamil Nadu, India NTT DATA North America Full time US$ 80,000 - US$ 1,20,000 per year

    Req ID:336025NTT DATA strives to hire exceptional, innovative and passionate individuals who want to grow with us. If you want to be part of an inclusive, adaptable, and forward-thinking organization, apply now.We are currently seeking a Data Engineer - Azure to join our team in Chennai, Tamil Nādu (IN-TN), India (IN)."Job Duties: Key...

  • GCP Data Engineer

    2 days ago

    Chennai, Tamil Nadu, India CustomerLabs 1P Data OPs Full time

    Position Overview:"Yesterday is history, tomorrow is a mystery, but today is a gift. That's why we call itthe present." - Master OogwayJoin CustomerLabs' dynamic data team as a Data Engineer and play a pivotal role intransforming raw marketing data into actionable insights that power our digitalmarketing platform. As a key member of our data infrastructure...

  • GCP Data Engineer

    19 hours ago

    Chennai, Tamil Nadu, India CustomerLabs ❤️ 1P Data OPs Full time US$ 90,000 - US$ 1,20,000 per year

    Data Engineer Job DescriptionPosition Overview Yesterday is history, tomorrow is a mystery, but today is a gift. That's why we call it the present.- Master OogwayJoin CustomerLabs' dynamic data team as a Data Engineer and play a pivotal role in transforming raw marketing data into actionable insights that power our digital marketing platform. As a key member...

  • Data Engineer for Azure DevOps

    20 hours ago

    Chennai, Tamil Nadu, India NTT DATA Full time ₹ 15,00,000 - ₹ 20,00,000 per year

    Req ID: 336023NTT DATA strives to hire exceptional, innovative and passionate individuals who want to grow with us. If you want to be part of an inclusive, adaptable, and forward-thinking organization, apply now. We are currently seeking a Data Engineer for Azure DevOps to join our team in Chennai, Tamil Nādu (IN-TN), India (IN). "Job Duties: 7+ years of...