Data Engineer

2 days ago


Anand, India Glencore Full time

Data Engineer


Department: Surveillance Technology

Chennai


This role sits within the IT function and will be mainly responsible for driving the definition, alignment and execution of the global trade surveillance vision and strategy for Glencore, including production of a global roadmap for Glencore trade surveillance rollout, managing all impacts from new business initiatives, and overseeing BAU support on behalf of global Compliance.

An experienced data engineer is required for the Surveillance IT to develop ingestion pipelines and frameworks across the application portfolio, which supports Trade surveillance analysts with strategy and decision-making. The team has recently developed a new data lake house and ingestion architecture in the Azure Synapse stack and are entering a phase of hardening and re-engineering to increase the speed, ease and quality of ingestion across the portfolio. This will include the later extension of the pipeline to a Kappa like architecture to support more real time data.


The ideal candidate disposes of:


  • Bachelor's degree in information systems, Computer Science, Engineering, or related field, or the equivalent combination of education, training and experience.
  • Reasonable experience in relevant role.
  • Good communicator, with good interpersonal skills and the ability to convey technical issues to all levels
  • Experience in Agile methodologies and in working in SCRUM, KANBAN or similar.
  • Demonstrated ability to pick up new skills and business concepts quickly.
  • Ability to accept change and adapt to organizational change and shifting priorities.
  • High work standards with a quality orientation and good attention to detail
  • Working as part of a team whilst showing an ability to work on own initiative
  • Good problem solving and ability to think quickly under pressure.


Essential Technical Skills


  • Strong Python, Pyspark, Synapse, Data Bricks or similar.
  • SQL
  • Data Pipelines, Big Data, Data architectures
  • CI/CD and associated tools
  • Test automation, PyTest


Desirable skills and experience


  • Experience in Azure/ Cloud, App services, Azure functions, Cosmos DB and Synapse
  • Some understanding of operations or trading in the commodities context, in particular Oil, Gas, Shipping and related activities
  • Jenkins, Octopus, Git
  • DevOps; Docker.
  • TDD and automation, Specflow, BDD.


  • Data Engineer

    2 days ago


    Anand, India Ness Digital Engineering Full time

    Why NessWe know that people are our greatest asset. Our staff’s professionalism, innovation, teamwork, and dedication to excellence have helped us become one of the world’s leading technology companies. It is these qualities that are vital to our continued success. As a Ness employee, you will be working on products and platforms for some of the most...

  • Data and AI Engineer

    4 weeks ago


    Anand, India Smart Tech LLC Full time

    Company Description:Smart Tech LLC specializes in developing AI-driven solutions to address the world's most challenging data and AI problems. We are on a mission to collaborate with the brightest minds to create real-world solutions that enhance the lives of millions and contribute to a sustainable world.Role Description:This is a remote contract role for a...


  • Anand, Gujarat, India Mitra AI Full time

    Mitra AI is a global technology company specializing in AI-driven solutions, cloud engineering, enterprise integration, and workflow automation.As a Senior Software Engineer at Mitra Innovation, you will be part of our Compliance Technology Engineering team, working closely with business and technology experts to deliver technical capabilities that support...


  • Anand, India Allegis Partners Full time

    You enjoy the challenge of solving complex big data analytics problems using state-of-the-art technologies as part of a growing global team of data engineering professionals. You are a self-starter with strong problem-solving skills and capable of owning and implementing solutions from start to finish. Key qualifications include:Bachelor's degree level or...

  • Data Engineer/DBA

    2 days ago


    Anand, India DXFactor Full time

    DXFactor is a "Great place to work certified company"We are looking for a Data Engineer / DBA. This will be a remote role with Pune as a base location.DXFactor is a US-based tech company working with fortune 500 customers across the globe.We have our presence in:USIndia (Ahmedabad, Bangalore, Pune)Web-site: www.DXFactor.comProfile: Data Engineer / DBAJob...

  • Data Scientist

    2 days ago


    Anand, India RapidCanvas Full time

    Who we are looking for:We are seeking a versatile Data Scientist to join our product team at RapidCanvas. In this role, you will work to bring powerful data science capabilities to our platform's UI, making it accessible and valuable for business users. Your contributions will be critical in simplifying complex data science processes for non-technical users,...


  • Anand, India GeoServe Full time

    We are looking for a passionate, detail-oriented Data Analyst who is skilled at transforming complex data into actionable insights. The ideal candidate will be able to independently break down large datasets into manageable pieces, identify trends, detect patterns, and effectively communicate findings. This role requires a strong technical understanding,...


  • Anand, India Vrinda Global Full time

     Play a key advisory role to Business leaders by managing analytics scope and deliverytimelines Synthesize data into business intelligence, communicating results clearly andrecommending courses of action based on data insights. Apply advanced and predictive analysis, people metrics and reporting to develop strategicand operational insights for...


  • Anand, India ACL Digital Full time

    Job Description: Data Research ExecutiveThe Data Research Specialist will support the sales teams by conducting extensive research activities and building accurate databases to facilitate targeted campaigns and outreach efforts.Preferred qualifications:Any bachelor's degree (BCA, BBA, B.Com, BE) or Diploma in a relevant fieldDesired experience in the...


  • Anand, India MakeMyTrip Full time

    Requirements:MakeMyTrip-GoIbibo data science group is looking for seasoned data scientist expert for hotel ranking recommendation systems.An ideal candidate would:· Build, deploy & monitor state of the art DL and ML ranking search models, learning to rank algorithms, position and click debiasing strategies, multi-objective ranking boosting algorithms.·...


  • Anand, Gujarat, India Tata Consultancy Services Full time

    At Tata Consultancy Services, we're proud to offer a unique opportunity for a seasoned Palantir Sr. Developer to join our team of exceptional professionals.About Us:TCS is a global leader in IT services and consulting, driven by a passion to transform businesses and societies through the power of technology.Job Description:We're looking for a skilled...


  • Anand, Gujarat, India Intuition IT – Intuitive Technology Recruitment Full time

    Job DescriptionWe are seeking a highly skilled Data Scientist to lead our data-driven initiatives. As a key member of our team, you will be responsible for developing and implementing advanced statistical models using Python and Pyspark.The ideal candidate will have experience in building Churn Models, KPI Forecasting Models, and Predictive Modelling. You...


  • Anand, India Oracle Full time

    Job Title : AI/ML Engineer Job Location : BengaluruExp Range : 5-15 years Position Overview : We are looking for AI/ML Engineer who has good experience in machine learning , statistical algorithms , with exposure on database development , some exposure on PL/SQL will be an added advantage Roles & Responsibilities : As a member of team you will be pioneering...


  • Anand, India Maritime Stealth Startup Full time

    AI Engineer at Innovative Maritime StartupSummary: Join our Canada-based maritime tech startup as an AI Engineer! With operations based in India, we’re on a mission to revolutionize the maritime industry through pioneering technology. We’re looking for an AI Engineer with significant AI experience (2+ years) and a total of 4+ years in software...


  • Anand, Gujarat, India GIOS Technology Full time

    We are seeking an exceptional Cloud Engineer with expertise in Google Cloud Platform (GCP) and Terraform to join our team at GIOS Technology.As a Cloud Engineer, you will play a crucial role in designing, implementing, and managing cloud-based infrastructure using GCP data engineering services including Big Query, Data Flow, Pub/Sub, Cloud Storage, and other...


  • Anand, India CommerceIQ Full time

    As Senior Director of Engineering - Platform you will be responsible for building a future ready ECommerce management platform that powers global Brands like Coca Cola, Pepsi, Nestle, Mondelez and many more. You will be responsible for setting the tech and platform vision working backwards from customer and product strategy. You will be hiring, mentoring and...


  • Anand, Gujarat, India Dimitra Technology Full time

    About Dimitra TechnologyWe are a leading provider of data analytics solutions for precision agriculture, developing innovative data science models and deploying them as applications for the agricultural industry.Our team is looking for a skilled Data Scientist and Full Stack Developer to join us in deploying our data science models and developing their...

  • Cloud Engineer

    6 days ago


    Anand, India Tata Consultancy Services Full time

    Locations: Kolkata/Bangalore/Pune/Bhubaneswar /DelhiExperience: 5-10 years5+ years of professional experience working with AWS technologies, including S3, Lambda, databases, and SQL. Proficiency in programming languages, particularly Python, and a willingness to further enhance coding skills. Understanding of databases and SQL for data manipulation and...

  • AI Engineer

    1 month ago


    Anand, India Datamatics Full time

    We are looking for AI Engineer with Computer Vision / Vision Analytics with 5 Years of exposure. Role: AI Engineer - Computer VisionLocation: Bangalore Key Responsibilities:Hands-on experience in developing AI and machine learning solutions.Proficiency in programming languages such as Python, and familiarity with AI libraries/frameworks (e.g., Computer...


  • Anand, Gujarat, India Yoonify Inc Full time

    Yoonify Inc is seeking a talented Senior Backend Systems Engineer to join our dynamic team.We are looking for an expert in designing, developing, and maintaining high-performance backend services and APIs using Python, Fast API, and Django. If you have a strong passion for building scalable systems and enjoy working in a fast-paced environment, we want to...