Senior Data Engineer

1 month ago

gurugram, India Circle K Full time
JOB DESCRIPTION

Job Description

Alimentation Couche-Tard Inc., (ACT) is a global Fortune company. A leader in the convenience store and fuel space with over 14, stores in 26 countries, serving more than 6 million customers each day. It is an exciting time to be a part of the growing Data Engineering team at Circle K. We are driving a well-supported cloud-first strategy to unlock the power of data across the company and help teams to discover, value and act on insights from data across the globe. With our strong data pipeline, this position will play a key role partnering with our Technical Development stakeholders to enable analytics for long term success.
We are looking for a Senior Data Engineer with a collaborative, “can-do” attitude who is committed & strives with determination and motivation to make their team successful. A Sr. Data Engineer who has experience architecting and implementing technical solutions as part of a greater data transformation strategy. This role is responsible for hands on sourcing, manipulation, and delivery of data from enterprise business systems to data lake and data warehouse. This role will help drive Circle K’s next phase in the digital journey by modeling and transforming data to achieve actionable business outcomes. The Sr. Data Engineer will create, troubleshoot and support ETL pipelines and the cloud infrastructure involved in the process, will be able to support the visualizations team.
Responsibilities
 

Collaborate with business stakeholders and other technical team members to acquire and migrate data sources that are most relevant to business needs and goals. Demonstrate deep technical and domain knowledge of relational and non-relation databases, Data Warehouses, Data lakes among other structured and unstructured storage options. Determine solutions that are best suited to develop a pipeline for a particular data source. Develop data flow pipelines to extract, transform, and load data from various data sources in various forms, including custom ETL pipelines that enable model and product development. Efficient in ETL/ELT development using Azure cloud services, Testing and operation/support process (RCA of production issues, Code/Data Fix Strategy, Monitoring and maintenance). Write custom scripts to extract data from unstructured/semi-structured sources. Provide clear documentation for delivered solutions and processes, integrating documentation with the appropriate corporate stakeholders. Identify and implement internal process improvements for data management (automating manual processes, optimizing data delivery, re-designing infrastructure for greater scalability). Stay current with and adopt new tools and applications to ensure high quality and efficient solutions. Build cross-platform data strategy to aggregate multiple sources and process development datasets. Proactive in stakeholder communication, mentor/guide junior resources by doing regular KT/reverse KT and help them in identifying production bugs/issues if needed and provide resolution recommendation.

Qualifications
 

Bachelor’s degree in computer engineering, Computer Science or related discipline, master’s degree preferred. 7+ years of ETL design, development, and performance tuning using ETL tools such as SSIS/ADF in a multidimensional Data Warehousing environment. 7+ years of advanced SQL Programming: PL/SQL, T-SQL 5+ years of Enterprise Data & Analytics solution architecture 5+ years of strong and extensive hands-on experience in Azure, preferably data heavy / analytics applications leveraging relational and NoSQL databases, Data Warehouse and Big Data 5+ years of experience with Azure Data Factory, Azure Synapse Analytics, Azure Analysis Services, Azure Databricks, Blob Storage, Databricks/Spark, Azure SQL DW/Synapse, and Azure functions. 5+ years of experience in defining and enabling data quality standards for auditing, and monitoring. Strong analytical abilities and a strong intellectual curiosity. In-depth knowledge of relational database design, data warehousing and dimensional data modeling concepts. Deep understanding of REST and good API design. Strong collaboration and teamwork skills & excellent written and verbal communications skills. Self-starter and motivated with ability to work in a fast-paced development environment. Agile experience highly desirable. Proficiency in the development environment, including IDE, database server, GIT, Continuous Integration, unit-testing tool, and defect management tools. Working experience with Python, Spark, Pyspark. Strong Leadership capabilities.

Preferred
 

Strong Knowledge of Data Engineering concepts (Data pipelines creation, Data Warehousing, Data Marts/Cubes, Data Reconciliation and Audit, Data Management). Working Knowledge of Dev-Ops processes (CI/CD), Git/Jenkins version control tool, Master Data Management (MDM) and Data Quality tools. Strong Experience in ETL/ELT development, QA and operation/support process (RCA of production issues, Code/Data Fix Strategy, Monitoring and maintenance). Hands on experience in Databases like (Azure SQL DB, MySQL/, Cosmos DB etc.), File system (Blob Storage), Python/Unix shell Scripting. ADF, Databricks and Azure certification is a plus.

Technologies we use:  Databricks, Azure SQL DW/Synapse, Azure Tabular, Azure Data Factory, Azure Functions, Azure Containers, Docker, DevOps, Python, PySpark, Scripting (Powershell, Bash), Git, Terraform, Power BI, Snowflake.
 

#LI-DS1

No locations found

Save job

  • Senior Data Engineer

    1 week ago

    gurugram, India True Tech Professionals Full time

    Senior Data Engineer Location: Gurgaon (Hybrid Mode) Experience: 5 years and above. Immediate Joiners Preferred (Notice Period: 7 to 10days) We are seeking a skilled Senior DataEngineer to join our dynamic team. The ideal candidate should havea strong background in data engineering with expertise in PythonPyspark AWS Glue Athena Redshift and SQL. The...

  • Senior Data Engineer

    1 month ago

    Gurugram, India Zupee Full time

    Senior Data EngineerWe are the biggest online gaming company with largest market share in the Indian gaming sector’s largest segment — Casual & Boardgame. We make skill-based games that spark joy in the everyday lives of people by engaging, entertaining, and enabling earning while at play.In the three plus years of existence, Zupee has been on a mission...

  • Senior Data Engineer

    1 month ago

    Gurugram, India Zupee Full time

    Senior Data Engineer We are the biggest online gaming company with largest market share in the Indian gaming sector’s largest segment — Casual & Boardgame. We make skill-based games that spark joy in the everyday lives of people by engaging, entertaining, and enabling earning while at play. In the three plus years of existence, Zupee has been on a...

  • Senior Data Engineer

    1 month ago

    Gurugram, India Zupee Full time

    Senior Data EngineerWe are the biggest online gaming company with largest market share in the Indian gaming sector’s largest segment — Casual & Boardgame. We make skill-based games that spark joy in the everyday lives of people by engaging, entertaining, and enabling earning while at play.In the three plus years of existence, Zupee has been on a mission...

  • Senior Data Engineer

    1 month ago

    Gurugram, India Circle K Full time

    JOB DESCRIPTION Job Description Alimentation Couche-Tard Inc., (ACT) is a global Fortune company. A leader in the convenience store and fuel space with over 14, stores in 26 countries, serving more than 6 million customers each day. It is an exciting time to be a part of the growing Data Engineering team at Circle K. We are driving a well-supported...

  • Senior Data Engineer

    1 month ago

    Gurugram, India Expedia Group Full time

    Senior Data Engineer We are looking for a highly motivated, self-driven , talented and experienced Data Engineer to join our dynamic team and drive the development and maintenance of our data platform. You have at least 9 years of experience as a Data Engineer. An independent thinker, who works around problems and who isn’t shy of trying new technologies....

  • Senior Data Engineer

    1 month ago

    gurugram, India Expedia Group Full time

    Senior Data Engineer We are looking for a highly motivated, self-driven , talented and experienced Data Engineer to join our dynamic team and drive the development and maintenance of our data platform. You have at least 9 years of experience as a Data Engineer. An independent thinker, who works around problems and who isn’t shy of trying new...

  • Senior Data Engineer

    4 weeks ago

    Gurugram, India LexisNexis Full time

    Senior Data EngineerWould you like to be part of a team that delivers high-quality software to our customers?About the Role:This role is more focused on Pyspark with Cloud developer.Hiring Senior Data Engineer in LNRS to work on Brightmine project.About the Team:Generally, the team is form in Squad where each squad consist of Squad Lead, Business Analyst,...

  • Senior Big Data Software Engineer

    1 month ago

    gurugram, India Epam Full time

    Description EPAM is a leading global provider of digital platform engineering and development services. We are committed to having a positive impact on our customers, our employees, and our communities. We embrace a dynamic and inclusive culture. Here you will collaborate with multi-national teams, contribute to a myriad of innovative projects...

  • Coforge - Data Engineer - Data Pipeline

    3 weeks ago

    Gurugram, India COFORGE Full time

    Job Description :As a Senior Data Engineer, you'll be at the forefront of developing and optimizing data pipelines, ensuring the seamless flow of data across our systems. Bring your expertise in Java, Python, and a range of big data technologies including Hadoop, Cassandra, Kafka, Spark, HBase, and MySQL to drive innovation and efficiency in our data...

  • Coforge - Data Engineer - Data Pipeline

    1 month ago

    gurugram, India COFORGE Full time

    Job Description : As a Senior Data Engineer, you'll be at the forefront of developing and optimizing data pipelines, ensuring the seamless flow of data across our systems. Bring your expertise in Java, Python, and a range of big data technologies including Hadoop, Cassandra, Kafka, Spark, HBase, and MySQL to drive innovation and efficiency in our data...

  • Curate Data Analytics

    1 month ago

    gurugram, India Curate Data Analytics LLP Full time

    About the Job : Senior Power BI DeveloperWe at Curate Data Analytics (A Startup in Business Analytics & Strategy space) are on a look out for a dynamic leader who knows Power BI very well, to be part of our Business Intelligence reporting Team. The incumbent is required to have a good understanding of business analytics & reporting using Power BI in FMCG...

  • Curate Data Analytics

    3 weeks ago

    Gurugram, India Curate Data Analytics LLP Full time

    About the Job : Senior Power BI DeveloperWe at Curate Data Analytics (A Startup in Business Analytics & Strategy space) are on a look out for a dynamic leader who knows Power BI very well, to be part of our Business Intelligence reporting Team. The incumbent is required to have a good understanding of business analytics & reporting using Power BI in FMCG...

  • Senior Data Engineer

    3 days ago

    Gurugram, India Capgemini Full time

    Job DescriptionExperience Required - 6 to 12 YearsExperience with object-oriented/object function scripting languages: Python, Java, C++, Scala, etc.Strong analytic skills related to working with unstructured datasets.Proficiency in Spark Technology and Elastic pipeline engine.Experience with big data tools: Hadoop, Spark, Kafka, etc.Experience with...

  • Senior Data Engineer

    2 weeks ago

    Gurugram, India AXA Group Full time

    Senior Data Engineer Bangalore/Gurgaon, India AXA XL recognizes data and information as critical business assets, both in terms of managing risk and enabling new business opportunities. This data should not only be high quality, but also actionable – enabling AXA XL’s executive leadership team to maximize benefits and facilitate sustained dynamic...

  • Senior Data Engineer

    2 weeks ago

    gurugram, India AXA Group Full time

    Senior Data Engineer Bangalore/Gurgaon, India AXA XL recognizes data and information as critical business assets, both in terms of managing risk and enabling new business opportunities. This data should not only be high quality, but also actionable – enabling AXA XL’s executive leadership team to maximize benefits and facilitate sustained dynamic...

  • Senior Data Engineer

    4 days ago

    Gurugram, India Capgemini Full time

    Job Description Experience Required - 6 to 12 Years Experience with object-oriented/object function scripting languages: Python, Java, C++, Scala, etc. Strong analytic skills related to working with unstructured datasets. Proficiency in Spark Technology and Elastic pipeline engine. Experience with big data tools: Hadoop, Spark, Kafka, etc. ...

  • Senior Data Engineer

    4 days ago

    gurugram, India Capgemini Full time

    Job Description Experience Required - 6 to 12 Years Experience with object-oriented/object function scripting languages: Python, Java, C++, Scala, etc. Strong analytic skills related to working with unstructured datasets. Proficiency in Spark Technology and Elastic pipeline engine. Experience with big data tools: Hadoop, Spark, Kafka, etc. Experience with...

  • Senior Data Engineer

    4 weeks ago

    Gurugram, India Impetus Full time

    Qualifications:3.5-7 years of IT experience range is preferred.The candidate should have extensive production experience (2-3 Years) in GCP, Other cloud experience would be a strong bonus.Strong background in Data engineering 3-6 Years of exp in Big Data technologies including, Hadoop, NoSQL, Spark, Kafka etc.Exposure to enterprise application development is...

  • Senior Data Engineer

    4 weeks ago

    Gurugram, India Impetus Full time

    Qualifications: 3.5-7 years of IT experience range is preferred. The candidate should have extensive production experience (2-3 Years) in GCP, Other cloud experience would be a strong bonus. Strong background in Data engineering 3-6 Years of exp in Big Data technologies including, Hadoop, NoSQL, Spark, Kafka etc. Exposure to enterprise application...