Senior Data Engineer

1 month ago

Gurugram, India Circle K Full time
JOB DESCRIPTION

Job Description

Alimentation Couche-Tard Inc., (ACT) is a global Fortune 200 company. A leader in the convenience store and fuel space with over 14,200 stores in 26 countries, serving more than 6 million customers each day. It is an exciting time to be a part of the growing Data Engineering team at Circle K. We are driving a well-supported cloud-first strategy to unlock the power of data across the company and help teams to discover, value and act on insights from data across the globe. With our strong data pipeline, this position will play a key role partnering with our Technical Development stakeholders to enable analytics for long term success.
We are looking for a Senior Data Engineer with a collaborative, “can-do” attitude who is committed & strives with determination and motivation to make their team successful. A Sr. Data Engineer who has experience architecting and implementing technical solutions as part of a greater data transformation strategy. This role is responsible for hands on sourcing, manipulation, and delivery of data from enterprise business systems to data lake and data warehouse. This role will help drive Circle K’s next phase in the digital journey by modeling and transforming data to achieve actionable business outcomes. The Sr. Data Engineer will create, troubleshoot and support ETL pipelines and the cloud infrastructure involved in the process, will be able to support the visualizations team.
Responsibilities
 

Collaborate with business stakeholders and other technical team members to acquire and migrate data sources that are most relevant to business needs and goals. Demonstrate deep technical and domain knowledge of relational and non-relation databases, Data Warehouses, Data lakes among other structured and unstructured storage options. Determine solutions that are best suited to develop a pipeline for a particular data source. Develop data flow pipelines to extract, transform, and load data from various data sources in various forms, including custom ETL pipelines that enable model and product development. Efficient in ETL/ELT development using Azure cloud services, Testing and operation/support process (RCA of production issues, Code/Data Fix Strategy, Monitoring and maintenance). Write custom scripts to extract data from unstructured/semi-structured sources. Provide clear documentation for delivered solutions and processes, integrating documentation with the appropriate corporate stakeholders. Identify and implement internal process improvements for data management (automating manual processes, optimizing data delivery, re-designing infrastructure for greater scalability). Stay current with and adopt new tools and applications to ensure high quality and efficient solutions. Build cross-platform data strategy to aggregate multiple sources and process development datasets. Proactive in stakeholder communication, mentor/guide junior resources by doing regular KT/reverse KT and help them in identifying production bugs/issues if needed and provide resolution recommendation.

Qualifications
 

Bachelor’s degree in computer engineering, Computer Science or related discipline, master’s degree preferred. 7+ years of ETL design, development, and performance tuning using ETL tools such as SSIS/ADF in a multidimensional Data Warehousing environment. 7+ years of advanced SQL Programming: PL/SQL, T-SQL 5+ years of Enterprise Data & Analytics solution architecture 5+ years of strong and extensive hands-on experience in Azure, preferably data heavy / analytics applications leveraging relational and NoSQL databases, Data Warehouse and Big Data 5+ years of experience with Azure Data Factory, Azure Synapse Analytics, Azure Analysis Services, Azure Databricks, Blob Storage, Databricks/Spark, Azure SQL DW/Synapse, and Azure functions. 5+ years of experience in defining and enabling data quality standards for auditing, and monitoring. Strong analytical abilities and a strong intellectual curiosity. In-depth knowledge of relational database design, data warehousing and dimensional data modeling concepts. Deep understanding of REST and good API design. Strong collaboration and teamwork skills & excellent written and verbal communications skills. Self-starter and motivated with ability to work in a fast-paced development environment. Agile experience highly desirable. Proficiency in the development environment, including IDE, database server, GIT, Continuous Integration, unit-testing tool, and defect management tools. Working experience with Python, Spark, Pyspark. Strong Leadership capabilities.

Preferred
 

Strong Knowledge of Data Engineering concepts (Data pipelines creation, Data Warehousing, Data Marts/Cubes, Data Reconciliation and Audit, Data Management). Working Knowledge of Dev-Ops processes (CI/CD), Git/Jenkins version control tool, Master Data Management (MDM) and Data Quality tools. Strong Experience in ETL/ELT development, QA and operation/support process (RCA of production issues, Code/Data Fix Strategy, Monitoring and maintenance). Hands on experience in Databases like (Azure SQL DB, MySQL/, Cosmos DB , File system (Blob Storage), Python/Unix shell Scripting. ADF, Databricks and Azure certification is a plus.

Technologies we use:  Databricks, Azure SQL DW/Synapse, Azure Tabular, Azure Data Factory, Azure Functions, Azure Containers, Docker, DevOps, Python, PySpark, Scripting (Powershell, Bash), Git, Terraform, Power BI, Snowflake.
 

#LI-DS1

No locations found

Save job

  • Senior Data Engineer

    12 hours ago

    Gurugram, India RoundCircle Full time

    Round Circle is a leading technology company dedicated to leveraging data-driven insights to fuel innovation and drive business growth. We are seeking a highly skilled and experienced Senior Data Engineer to join our dynamic team. As a Senior Data Engineer, you will play a pivotal role in designing, developing, and optimizing our data infrastructure,...

  • Senior Data Engineer

    1 week ago

    Gurugram, India RoundCircle Full time

    Round Circle is a leading technology company dedicated to leveraging data-driven insights to fuel innovation and drive business growth. We are seeking a highly skilled and experienced Senior Data Engineer to join our dynamic team. As a Senior Data Engineer, you will play a pivotal role in designing, developing, and optimizing our data infrastructure,...

  • Eucloid - Senior Data Consultant

    4 weeks ago

    Gurugram, India Eucloid Data Solutions Pvt Ltd Full time

    Senior Data description:We are looking for a high-energy individual for the role of Senior Data Analyst at Eucloid. The candidate will collaborate with client stakeholders on multiple projects in the eCommerce team. The candidate is expected to lead following work-streams:- Drive client meetings with data-driven insights and observations on key website/app...

  • Eucloid - Senior Data Engineer - Azure Databricks

    1 month ago

    gurugram, India Eucloid Data Solutions Pvt Ltd Full time

    Job Role : Sr. Data Engineer (Databricks) About Eucloid :Eucloid Data Solutions is a fast-growing AI-consulting firm that enables business growth for its clients through advanced Data Analytics, Machine Learning and Data engineering. Eucloid offers bespoke, full stackand datadriven approach to solve highly complex and large-scale business problems for some...

  • Eucloid - Senior Data Engineer - Azure Databricks

    3 weeks ago

    Gurugram, India Eucloid Data Solutions Pvt Ltd Full time

    Job Role : Sr. Data Engineer (Databricks)About Eucloid :Eucloid Data Solutions is a fast-growing AI-consulting firm that enables business growth for its clients through advanced Data Analytics, Machine Learning and Data engineering. Eucloid offers bespoke, full stackand datadriven approach to solve highly complex and large-scale business problems for some of...

  • Eucloid - Senior Data Engineer - Azure Databricks

    2 weeks ago

    gurugram, India Eucloid Data Solutions Pvt Ltd Full time

    Job Role : Sr. Data Engineer (Databricks) About Eucloid :Eucloid Data Solutions is a fast-growing AI-consulting firm that enables business growth for its clients through advanced Data Analytics, Machine Learning and Data engineering. Eucloid offers bespoke, full stackand datadriven approach to solve highly complex and large-scale business problems for some...

  • Senior Data Engineer

    11 hours ago

    Gurugram, India True Tech Professionals Full time

    Lead Data EngineerLocation: Remote - Gurgaon (Office visit - once in a while - as and when required)Experience: 7+ yearsAre you passionate about leveraging data to drive business decisions? Do you thrive in a collaborative environment where your expertise in data engineering can make a significant impact? If so, we're looking for you to join our team as a...

  • Senior Data Engineer

    1 week ago

    Gurugram, India True Tech Professionals Full time

    Lead Data EngineerLocation: Remote - Gurgaon (Office visit - once in a while - as and when required)Experience: 7+ yearsAre you passionate about leveraging data to drive business decisions? Do you thrive in a collaborative environment where your expertise in data engineering can make a significant impact? If so, we're looking for you to join our team as a...

  • Senior Data Engineer

    7 days ago

    gurugram, India True Tech Professionals Full time

    Lead Data Engineer Location: Remote - Gurgaon (Office visit - once in a while - as and when required) Experience: 7+ years Are you passionate about leveraging data to drive business decisions? Do you thrive in a collaborative environment where your expertise in data engineering can make a significant impact? If so, we're looking for you to join our team...

  • Senior Data Engineer

    1 month ago

    gurugram, India Optivalue tek consulting Full time

    Company Description : OptiValueTek is a leading provider of IT solutions specializing in Application & Process Integration, API Management, Data Engineering, Data Science/MLOps, DevOps & SRE, Cloud Solutions, and Web/Mobile & Application Development. With a focus on innovation, we have developed in-house tools/accelerators for Test Automation, API...

  • Senior Data Engineer

    1 week ago

    gurugram, India Optivalue tek consulting Full time

    Company Description : OptiValueTek is a leading provider of IT solutions specializing in Application & Process Integration, API Management, Data Engineering, Data Science/MLOps, DevOps & SRE, Cloud Solutions, and Web/Mobile & Application Development. With a focus on innovation, we have developed in-house tools/accelerators for Test Automation, API...

  • Senior Data Engineer

    1 month ago

    Gurugram, India Optivalue tek consulting Full time

    Company Description : OptiValueTek is a leading provider of IT solutions specializing in Application & Process Integration, API Management, Data Engineering, Data Science/MLOps, DevOps & SRE, Cloud Solutions, and Web/Mobile & Application Development. With a focus on innovation, we have developed in-house tools/accelerators for Test Automation, API...

  • Senior Data Engineer

    3 weeks ago

    Gurugram, India Optivalue tek consulting Full time

    Company Description : OptiValueTek is a leading provider of IT solutions specializing in Application & Process Integration, API Management, Data Engineering, Data Science/MLOps, DevOps & SRE, Cloud Solutions, and Web/Mobile & Application Development. With a focus on innovation, we have developed in-house tools/accelerators for Test Automation, API...

  • Senior Data Engineer

    1 week ago

    Gurugram, India Valiance Solutions Full time

    About Valiance:Valiance is a niche AI consulting firm dedicated to transforming businesses by leveraging the power of data science, AI, and cloud technologies. With a team of over 120 professionals, we provide cutting-edge solutions to clients in the US and India.Job Overview:We are seeking a highly skilled and experienced Senior AWS Data Engineer to join...

  • Senior Data Engineer

    1 week ago

    gurugram, India Valiance Solutions Full time

    About Valiance: Valiance is a niche AI consulting firm dedicated to transforming businesses by leveraging the power of data science, AI, and cloud technologies. With a team of over 120 professionals, we provide cutting-edge solutions to clients in the US and India. Job Overview: We are seeking a highly skilled and experienced Senior AWS Data Engineer to...

  • Senior Big Data Engineer

    22 hours ago

    gurugram, India PAR Technology Full time

    Title Senior Big Data Engineer Reporting Manager, Big Data Job location Jaipur/Gurugram About the role Sr Big Data Engineer is critical in leading Punchh’s data innovations. By leveraging prior industrial experience in big data, he/she will help create cutting-edge data and analytics products for Punchh’s business partners. This role requires close...

  • Senior Big Data Engineer

    15 hours ago

    Gurugram, India PAR Technology Full time

    TitleSenior Big Data EngineerReportingManager, Big DataJob locationJaipur/GurugramAbout the role Sr Big Data Engineer is critical in leading Punchh’s data innovations. By leveraging prior industrial experience in big data, he/she will help create cutting-edge data and analytics products for Punchh’s business partners.This role requires close...

  • Senior Big Data Engineer

    11 hours ago

    Gurugram, India PAR Technology Full time

    TitleSenior Big Data EngineerReportingManager, Big DataJob locationJaipur/GurugramAbout the role Sr Big Data Engineer is critical in leading Punchh’s data innovations. By leveraging prior industrial experience in big data, he/she will help create cutting-edge data and analytics products for Punchh’s business partners.This role requires close...

  • Senior Data Engineer

    2 weeks ago

    gurugram, India The Economist Full time

    Introduction Job Title: Senior Data Engineer Business Unit: Technology / Engineering Location: London Direct Reports:  0 Reporting Manager Title: Bogdan Vrusias Date Prepared: 01 / 05 / 2024 Who we are We are an organisation that exists to drive progress. That's the “red thread” that connects everyone at...

  • Senior Data Engineer

    14 hours ago

    Gurugram, India The Economist Full time

    Introduction Job Title: Senior Data Engineer Business Unit: Technology / Engineering Location: London Direct Reports:  0 Reporting Manager Title: Bogdan Vrusias Date Prepared: 01 / 05 / 2024 Who we are We are an organisation that exists to drive progress. That's the “red thread” that connects everyone at The Economist Group...