Senior Data Engineer

Job Title

Senior Data Engineer

Job Description
If you are passionate about unlocking the power to gain next level insights into a great variety of data, powering data driven decision making through advanced analytics and data science practises, you might have just found your perfect next career step.

In this job you will have versatile responsibilities, combining your technical skills with business understanding, teaming up with other professionals inside the Vanderlande Data Driven Insights (DDI) Ecosystem. Within the DDI team you are the senior data engineer of the part of our team based in Pune, other team members are based in Europe.

You collaborate with a divers and varying group of fellow engineers, subject matter experts and stakeholders. As Senior Data Engineer you are responsible for the data side of fast prototyping for advanced analytics use cases. You will be working side by side with our Product Managers Analytics, our Advanced Analytics Data Scientist and the other team members of the DDI team. The team has full stack capabilities and is end to end able to make your work reach our users rapidly.

Please feel encouraged to join our very motivated, high-performing and fun DDI team of data and insight enthusiasts, responsible for realizing the Decision Intelligence Roadmap of Vanderlande's Innovate to Sell Engine.

Key Responsibilities

• You will be developing, testing, and documenting data models and data collection for advanced analytics prototyping. This data, originating from a variety of data sources and types, is collected and used on our Central Data Platform on Azure, where it is made available in a fast accessible and safe way to support a multitude of insight use cases.
• You will develop scalable data pipelines to transform and aggregate data for learning purpose and to support business use, while following data engineering best practices and Central Data Platform design guidelines (which you can can influence, 'everyday better').
• You will be challenging the status quo of our ecosystem to continuously keep improving the solutions and technologies used, striving for an ever-increasing degree of automation.
• You will develop and optimize ETL/ELT processes for batch and real-time data ingestion, ensuring data quality and reliability.
• You will design and implement data models to support transactional and analytical use cases.
• You will enable metadata management, data lineage tracking, and cataloguing to improve data transparency and accessibility.
• You will drive the integration of emerging technologies, such as machine learning, real-time analytics and AI frameworks.
• You will contribute to the adoption of tools like Large Language Models (LLMs) and Generative AI for innovative data solutions.
• You will design cloud-native architectures on platforms like Azure, ensuring cost efficiency and scalability.
• You will leverage tools such as Databricks, Snowflake, Spark, and Delta Lake to enhance data engineering processes.
• You will collaborate with cross-functional teams to translate business requirements into technical solutions.
• You will work closely with other team members, fostering a culture of knowledge-sharing and continuous learning.
• You will be following agile methodologies to influence the product vision and roadmap, aligning these with organizational goals and stakeholder needs.

Key Competences

• 6-9 years of work experience inside the field of Data Engineering & Advanced Analytics, in the last role(s) working with Databricks within cloud context (Azure is a plus).
• Ability to cooperate & coordinate with a multitude of Data Producers to ensure the right level of availability and reliability of data.
• Experience in data analytics and data development, with strong understanding of data base systems (like SQL, NoSQL) and data-interchange formats (like JSON).
• Mastering and recently worked in and environment with Microsoft Azure and Databricks/Unity Catalog as major building blocks. Experience with Databricks AI/BI Genie is a plus.
• Ability to quickly learn about the business processes in DMLS and the other Vanderlande Domains for which the data insights are created and/or used.
• Ability to actively raise data insight literacy in Vanderlande DMLS and with its stakeholders.
• Senior level analytical skills combined with strong communication and problem-solving skills.
• Proven ability to quickly get up to speed in our ecosystem and become a major contributor fast.
• You love working in fast-paced agile development and know your way around working in a larger enterprise, appreciating the dynamics involved.