Senior Data Modelling Engineer

3 weeks ago

Bikaner, Rajasthan, India The Institute of Clever Stuff Full time

Where: India (fully remote)

Business Hours: UK hours

Process:

1. ICS 1st Interview (30 minutes)

2. CV shared with client, followed by 1-2 further rounds

Context of work:

  • The client is a global energy company undergoing a significant transformation to support the energy transition. We work within their Customers & Products (C&P) division, serving both B2C and B2B customers across key markets such as the UK, US, Germany, Spain, and Poland.
  • This business unit includes mobility (fuel and EV), convenience retail, and loyalty.

Required Skills and Experience:

  • Proven experience in data modelling and data pipeline development.
  • Proficiency with tools like ER Studio, STTM, AWS Glue, Redshift & Athena, and Power BI.
  • Strong SQL and experience with generating DDL scripts.
  • Experience working in SAP data environments.
  • Experience in any of these domain areas is highly desirable: Logistics, Supply Planning, Exports and IFOT.
  • Familiarity with cloud platforms, particularly AWS.
  • Hands-on experience with DevOps and Agile methodologies (e.g., Azure ADO).
  • Strong communication and documentation skills.
  • Ability to work collaboratively with cross-functional teams.

Key Responsibilities

Data Modelling

  • Initiate and manage Gap Analysis and Source-to-Target Mapping Exercises.
  • Gain a comprehensive understanding of the EA extract.
  • Map the SAP source used in EA extracts to the AWS Transform Zone, AWS Conform Zone, and AWS Enrich Zone.
  • Develop a matrix view of all Excel/Tableau reports to identify any missing fields or tables from SAP in the Transform Zone.
  • Engage with SME's to finalise the Data Model (DM).
  • Obtain email confirmation and approval for the finalised DM.
  • Perform data modelling using ER Studio and STTM.
  • Generate DDL scripts for data engineers to facilitate implementation.

Data Engineering

  • Set up infrastructure for pipelines – this includes Glue Jobs, crawlers, scheduling, step functions, etc.
  • Build, deploy, test and run pipelines on demand in lower environments.
  • Verify data integrity: no duplicates, all columns in final table etc.
  • Write unit tests for methods used in the pipeline and use standard tools for testing.
  • Code formatting and linting.
  • Collaborate with other Modelling Engineers to align on the correct approach.
  • Update existing pipelines for CZ tables (e.g., Serverless Data Lake Framework (SDLF)) where necessary with new columns if they are required for EZ tables.
  • Raise DDP requests to register databases and tables, and to load data into the raw zone.

Other

  • Create comprehensive good documentation. Ensure each task is accompanied by detailed notes specific to its functional area for clear tracking and reference.
  • Analyse and manage bugs and change requests raised by business/SMEs.
  • Collaborate with Data Analysts and Virtual Engineers (VE) to refine and enhance semantic modelling in Power BI.
  • Plan out work using Microsoft Azure, ADO. Dependencies, status and effort are correctly reflected.

  • Senior Data Architect

    18 hours ago

    Bikaner, Rajasthan, India beBeeData Full time ₹ 90,00,000 - ₹ 1,20,00,000

    Job Title: Senior Data Architect">We are seeking a seasoned Senior Data Architect to join our elite team of experts. This is an exceptional opportunity for a highly skilled individual to design and implement large-scale data processing systems that drive business growth through advanced analytics and intelligence.Key Responsibilities:Design and develop...

  • Senior Data Engineering Specialist

    18 hours ago

    Bikaner, Rajasthan, India beBeeDataEngineer Full time US$ 1,50,000 - US$ 2,50,000

    As a Senior Data Engineer, you will have the opportunity to work on an application for a large retailer.Required Skills & Experience5+ years of experience as a Data EngineerExpertise in Python, Pyspark and SQLHands-on Python/PySpark coding experienceStrong Big Data experience, GCP preferredTelemetry experienceStreaming experience with analytics and data...

  • Senior Data Architect

    18 hours ago

    Bikaner, Rajasthan, India beBeeDataEngineer Full time ₹ 1,00,00,000 - ₹ 2,00,00,000

    Job Title: Senior Data EngineerExperience: 4–7 YearsLocation: [Remote]Employment Type: Full-TimeWe are seeking a highly skilled data engineer with expertise in SQL, Python, and Java. The ideal candidate will play a critical role in data extraction, integration, and advanced analysis by leveraging both traditional programming and emerging technologies.Key...

  • Data Scientist Engineer

    9 hours ago

    Bikaner, Rajasthan, India beBeeMachineLearning Full time US$ 1,20,000 - US$ 1,70,000

    Job OpportunityWe are seeking an accomplished Data Scientist Engineer to spearhead the development of cutting-edge machine learning models that drive business growth.About the Role:Design and deploy machine learning models for predictive analytics, classification, clustering, and deep learning tasks.Develop and optimize data pipelines using Python, ensuring...

  • Senior Data Architect

    4 weeks ago

    Bikaner, Rajasthan, India Grow Asia Full time

    Job Title:  Senior Data Architect – Fintech Data Lakes  Location:  Remote Department: Enterprise Data & Analytics / Technology Reports to: Chief Data Officer (CDO) or Head of Data Engineering Role HighlightsSenior-level technical architect, strong cloud experience (GCP + Azure)Specialized in data lakes, compliance, real-time & batch...

  • Senior Data Engineer Position Available

    18 hours ago

    Bikaner, Rajasthan, India beBeeDataEngineer Full time ₹ 1,00,00,000 - ₹ 2,00,00,000

    Data Engineering Role OverviewWe are seeking an experienced data engineer to join our team.The ideal candidate will have a strong background in data engineering, architecture, and design, with expertise in data integration, processing, and storage.They should also have knowledge of data visualization tools, cloud data platforms, and industry-standard tools...

  • Sr. Staff Data Engineer

    3 weeks ago

    Bikaner, Rajasthan, India Aurigo Software Technologies Full time

    Senior Staff Data Engineer (Agentic AI Engineer)Location: Bengaluru, IndiaExperience: 5+ years Role Summary: Aurigo is leading the charge in transforming enterprise SaaS for infrastructure, and AI is at the core of this revolution. With Aurigo Lumina, our AI copilot, we are redefining how infrastructure owners interact with Masterworks, driving smarter,...

  • Data Engineer With Yardi

    3 weeks ago

    Bikaner, Rajasthan, India BlockTXM Inc Full time

    Required Skills & QualificationsHands-on experience with Yardi Voyager, Yardi Data Connect, or similar Yardi modules.Strong technical expertise in SQL scripting and database management.Experience in ETL/ELT pipeline development and integration of ERP or financial platforms.Familiarity with data visualization and business intelligence tools such as Power BI...

  • Data Engineering Specialist

    22 hours ago

    Bikaner, Rajasthan, India beBeeDataEngineer Full time ₹ 15,00,000 - ₹ 30,00,000

    Key Responsibilities:Develop and implement ETL/ELT pipelines using AWS Glue, Lambda, and DBT for efficient data integration.Design scalable and high-performing data models in Snowflake to meet business needs.Write optimized SQL queries for data extraction, transformation, and loading to ensure timely delivery.Collaborate with stakeholders to understand data...

  • Senior Data Architect

    18 hours ago

    Bikaner, Rajasthan, India beBeeData Full time ₹ 20,00,000 - ₹ 25,00,000

    Data Engineering Lead">Key Responsibilities:We are looking for a Data Engineering Lead to design, develop and maintain large-scale data pipelines on Databricks.The successful candidate will lead the architecture and implementation of scalable, secure and high-performance data solutions.This role requires collaboration with business stakeholders, data...