Data Engineer
2 days ago
Data Engineer
Department: Surveillance Technology
Chennai
This role sits within the IT function and will be mainly responsible for driving the definition, alignment and execution of the global trade surveillance vision and strategy for Glencore, including production of a global roadmap for Glencore trade surveillance rollout, managing all impacts from new business initiatives, and overseeing BAU support on behalf of global Compliance.
An experienced data engineer is required for the Surveillance IT to develop ingestion pipelines and frameworks across the application portfolio, which supports Trade surveillance analysts with strategy and decision-making. The team has recently developed a new data lake house and ingestion architecture in the Azure Synapse stack and are entering a phase of hardening and re-engineering to increase the speed, ease and quality of ingestion across the portfolio. This will include the later extension of the pipeline to a Kappa like architecture to support more real time data.
The ideal candidate disposes of:
- Bachelor's degree in information systems, Computer Science, Engineering, or related field, or the equivalent combination of education, training and experience.
- Reasonable experience in relevant role.
- Good communicator, with good interpersonal skills and the ability to convey technical issues to all levels
- Experience in Agile methodologies and in working in SCRUM, KANBAN or similar.
- Demonstrated ability to pick up new skills and business concepts quickly.
- Ability to accept change and adapt to organizational change and shifting priorities.
- High work standards with a quality orientation and good attention to detail
- Working as part of a team whilst showing an ability to work on own initiative
- Good problem solving and ability to think quickly under pressure.
Essential Technical Skills
- Strong Python, Pyspark, Synapse, Data Bricks or similar.
- SQL
- Data Pipelines, Big Data, Data architectures
- CI/CD and associated tools
- Test automation, PyTest
Desirable skills and experience
- Experience in Azure/ Cloud, App services, Azure functions, Cosmos DB and Synapse
- Some understanding of operations or trading in the commodities context, in particular Oil, Gas, Shipping and related activities
- Jenkins, Octopus, Git
- DevOps; Docker.
- TDD and automation, Specflow, BDD.
-
Data Engineer
2 days ago
Anand, India Ness Digital Engineering Full timeWhy NessWe know that people are our greatest asset. Our staff’s professionalism, innovation, teamwork, and dedication to excellence have helped us become one of the world’s leading technology companies. It is these qualities that are vital to our continued success. As a Ness employee, you will be working on products and platforms for some of the most...
-
Data and AI Engineer
4 weeks ago
Anand, India Smart Tech LLC Full timeCompany Description:Smart Tech LLC specializes in developing AI-driven solutions to address the world's most challenging data and AI problems. We are on a mission to collaborate with the brightest minds to create real-world solutions that enhance the lives of millions and contribute to a sustainable world.Role Description:This is a remote contract role for a...
-
Data Engineering Expert for Big Data Solutions
2 weeks ago
Anand, Gujarat, India Mitra AI Full timeMitra AI is a global technology company specializing in AI-driven solutions, cloud engineering, enterprise integration, and workflow automation.As a Senior Software Engineer at Mitra Innovation, you will be part of our Compliance Technology Engineering team, working closely with business and technology experts to deliver technical capabilities that support...
-
Senior Data Engineer
6 days ago
Anand, India Allegis Partners Full timeYou enjoy the challenge of solving complex big data analytics problems using state-of-the-art technologies as part of a growing global team of data engineering professionals. You are a self-starter with strong problem-solving skills and capable of owning and implementing solutions from start to finish. Key qualifications include:Bachelor's degree level or...
-
Data Engineer/DBA
2 days ago
Anand, India DXFactor Full timeDXFactor is a "Great place to work certified company"We are looking for a Data Engineer / DBA. This will be a remote role with Pune as a base location.DXFactor is a US-based tech company working with fortune 500 customers across the globe.We have our presence in:USIndia (Ahmedabad, Bangalore, Pune)Web-site: www.DXFactor.comProfile: Data Engineer / DBAJob...
-
Data Scientist
2 days ago
Anand, India RapidCanvas Full timeWho we are looking for:We are seeking a versatile Data Scientist to join our product team at RapidCanvas. In this role, you will work to bring powerful data science capabilities to our platform's UI, making it accessible and valuable for business users. Your contributions will be critical in simplifying complex data science processes for non-technical users,...
-
GeoServe | Data Analyst
1 day ago
Anand, India GeoServe Full timeWe are looking for a passionate, detail-oriented Data Analyst who is skilled at transforming complex data into actionable insights. The ideal candidate will be able to independently break down large datasets into manageable pieces, identify trends, detect patterns, and effectively communicate findings. This role requires a strong technical understanding,...
-
Director– Data Analytics
1 month ago
Anand, India Vrinda Global Full time Play a key advisory role to Business leaders by managing analytics scope and deliverytimelines Synthesize data into business intelligence, communicating results clearly andrecommending courses of action based on data insights. Apply advanced and predictive analysis, people metrics and reporting to develop strategicand operational insights for...
-
ACL Digital | Data Research Analyst
3 days ago
Anand, India ACL Digital Full timeJob Description: Data Research ExecutiveThe Data Research Specialist will support the sales teams by conducting extensive research activities and building accurate databases to facilitate targeted campaigns and outreach efforts.Preferred qualifications:Any bachelor's degree (BCA, BBA, B.Com, BE) or Diploma in a relevant fieldDesired experience in the...
-
Principal Data Scientist
2 weeks ago
Anand, India MakeMyTrip Full timeRequirements:MakeMyTrip-GoIbibo data science group is looking for seasoned data scientist expert for hotel ranking recommendation systems.An ideal candidate would:· Build, deploy & monitor state of the art DL and ML ranking search models, learning to rank algorithms, position and click debiasing strategies, multi-objective ranking boosting algorithms.·...
-
Senior Data Engineer
2 days ago
Anand, Gujarat, India Tata Consultancy Services Full timeAt Tata Consultancy Services, we're proud to offer a unique opportunity for a seasoned Palantir Sr. Developer to join our team of exceptional professionals.About Us:TCS is a global leader in IT services and consulting, driven by a passion to transform businesses and societies through the power of technology.Job Description:We're looking for a skilled...
-
Senior Data Science Expert
4 weeks ago
Anand, Gujarat, India Intuition IT – Intuitive Technology Recruitment Full timeJob DescriptionWe are seeking a highly skilled Data Scientist to lead our data-driven initiatives. As a key member of our team, you will be responsible for developing and implementing advanced statistical models using Python and Pyspark.The ideal candidate will have experience in building Churn Models, KPI Forecasting Models, and Predictive Modelling. You...
-
Machine Learning Engineer
1 month ago
Anand, India Oracle Full timeJob Title : AI/ML Engineer Job Location : BengaluruExp Range : 5-15 years Position Overview : We are looking for AI/ML Engineer who has good experience in machine learning , statistical algorithms , with exposure on database development , some exposure on PL/SQL will be an added advantage Roles & Responsibilities : As a member of team you will be pioneering...
-
Artificial Intelligence Engineer
2 weeks ago
Anand, India Maritime Stealth Startup Full timeAI Engineer at Innovative Maritime StartupSummary: Join our Canada-based maritime tech startup as an AI Engineer! With operations based in India, we’re on a mission to revolutionize the maritime industry through pioneering technology. We’re looking for an AI Engineer with significant AI experience (2+ years) and a total of 4+ years in software...
-
Cloud Engineering Expert for GCP and Terraform
2 weeks ago
Anand, Gujarat, India GIOS Technology Full timeWe are seeking an exceptional Cloud Engineer with expertise in Google Cloud Platform (GCP) and Terraform to join our team at GIOS Technology.As a Cloud Engineer, you will play a crucial role in designing, implementing, and managing cloud-based infrastructure using GCP data engineering services including Big Query, Data Flow, Pub/Sub, Cloud Storage, and other...
-
Senior Director of Software Engineering
3 days ago
Anand, India CommerceIQ Full timeAs Senior Director of Engineering - Platform you will be responsible for building a future ready ECommerce management platform that powers global Brands like Coca Cola, Pepsi, Nestle, Mondelez and many more. You will be responsible for setting the tech and platform vision working backwards from customer and product strategy. You will be hiring, mentoring and...
-
Anand, Gujarat, India Dimitra Technology Full timeAbout Dimitra TechnologyWe are a leading provider of data analytics solutions for precision agriculture, developing innovative data science models and deploying them as applications for the agricultural industry.Our team is looking for a skilled Data Scientist and Full Stack Developer to join us in deploying our data science models and developing their...
-
Cloud Engineer
6 days ago
Anand, India Tata Consultancy Services Full timeLocations: Kolkata/Bangalore/Pune/Bhubaneswar /DelhiExperience: 5-10 years5+ years of professional experience working with AWS technologies, including S3, Lambda, databases, and SQL. Proficiency in programming languages, particularly Python, and a willingness to further enhance coding skills. Understanding of databases and SQL for data manipulation and...
-
AI Engineer
1 month ago
Anand, India Datamatics Full timeWe are looking for AI Engineer with Computer Vision / Vision Analytics with 5 Years of exposure. Role: AI Engineer - Computer VisionLocation: Bangalore Key Responsibilities:Hands-on experience in developing AI and machine learning solutions.Proficiency in programming languages such as Python, and familiarity with AI libraries/frameworks (e.g., Computer...
-
Senior Backend Systems Engineer
3 days ago
Anand, Gujarat, India Yoonify Inc Full timeYoonify Inc is seeking a talented Senior Backend Systems Engineer to join our dynamic team.We are looking for an expert in designing, developing, and maintaining high-performance backend services and APIs using Python, Fast API, and Django. If you have a strong passion for building scalable systems and enjoy working in a fast-paced environment, we want to...