Data Engineer Lead
4 days ago
About the Role
We are seeking a highly skilled Data Engineer Lead to join our team at Giant Eagle GCC in Bangalore. As a key member of our data analytics team, you will play a critical role in designing and developing systems for the maintenance of our data warehouse, ETL processes, data pipelines, and business intelligence.
Job Summary
The successful candidate will have a strong background in data engineering, with experience in working with big data tools such as Azure Data Factory, Databricks, Spark, Kafka, and Python. You will be responsible for building and optimizing data pipelines, architectures, and data sets, as well as performing root cause analysis on internal and external data and processes to answer specific business questions and identify opportunities for improvement.
Main Responsibilities:
- Design and develop data pipelines using big data tools such as Azure Data Factory, Databricks, Spark, and Kafka.
- Build and maintain data warehouses, ETL processes, and data sets.
- Perform root cause analysis on internal and external data and processes to answer specific business questions and identify opportunities for improvement.
- Work closely with cross-functional teams to gather and populate ESL table structure, which is optimized for reporting.
Requirements:
- 5+ years of related experience with a Bachelor's degree; equivalent work experience.
- Advanced working SQL knowledge and experience working with relational databases, query authoring (SQL) as well as working familiarity with a variety of NO SQL databases.
- Experience building and optimizing 'big data' data pipelines, architectures and data sets.
- Extensive working knowledge of API or Stream based data extraction processes like Oracle ERP API and Bulk API is must.
- Experience supporting and working with cross-functional teams in a dynamic environment across geographies.
- Experience with big data tools: Azure Data factory, Databricks, Spark, Kafka, Spark & Kafka Streaming, Python, Scala, Talend etc.
What We Offer:
- A competitive salary range of $120,000 - $180,000 per year.
- A comprehensive benefits package including health insurance, retirement savings plan, and paid time off.
- Ongoing training and development opportunities to help you grow your career.
About Us:
Giant Eagle Inc. is a leading food retailer and distributor with over 37,000 Team Members and $9.7 billion in revenue. Our company is committed to investing in people, technology, and data to elevate our customer's experience across multiple touchpoints. At Giant Eagle GCC, we enable our customers to expand internal capabilities in areas such as data analytics, merchandising and eCommerce, quality engineering, and automation to generate insights for faster decision-making and help us accelerate our business strategy.
-
india Data Warehouse Engineer Full timeExperience : 2- 5 YearsPrimary Skills : Strong SQL knowledge, Data warehouse concepts and ETL hands on experience, Azure services like Data Factory, Azure Data Lake, and Good analysis skills.Good to have skills: Power BI, Databricks, Python.
-
Data Warehouse Engineer
2 weeks ago
India Data Warehouse Engineer Full timeExperience : 2- 5 Years Primary Skills : Strong SQL knowledge, Data warehouse concepts and ETL hands on experience, Azure services like Data Factory, Azure Data Lake, and Good analysis skills. Good to have skills: Power BI, Databricks, Python.
-
Data Warehouse Expert for Analytics Projects
1 week ago
India Data Warehouse Engineer Full timeAbout the RoleWe are seeking an experienced Data Warehouse Engineer to join our team. In this role, you will design, develop, and maintain data warehouses that support business intelligence and analytics initiatives.
-
Lead data engineer
3 weeks ago
India Wavicle Data Solutions Full timeJob Description: We are seeking a highly experienced Lead Data Engineer with over 8 years of expertise in data engineering. As a Lead Data Engineer, you will play a pivotal role in architecting and implementing data solutions. Your proficiency in Python, Py Spark, AWS, Databricks, SQL, and leadership skills will be crucial for success. Key...
-
Lead Data Engineer
4 weeks ago
India Wavicle Data Solutions Full timeJob Description:We are seeking a highly experienced Lead Data Engineer with over 8 years of expertise in data engineering.As a Lead Data Engineer, you will play a pivotal role in architecting and implementing data solutions.Your proficiency in Python, PySpark, AWS, Databricks, SQL, and leadership skills will be crucial for success.Key Responsibilities:Lead...
-
Lead Data Engineer
4 weeks ago
India Wavicle Data Solutions Full timeJob Description: We are seeking a highly experienced Lead Data Engineer with over 8 years of expertise in data engineering. As a Lead Data Engineer, you will play a pivotal role in architecting and implementing data solutions. Your proficiency in Python, PySpark, AWS, Databricks, SQL, and leadership skills will be crucial for success. Key...
-
Cloud Data Engineering Lead
7 days ago
India ITI Data Full timeITI Data is seeking a highly skilled Cloud Data Engineering Lead to spearhead the design and development of scalable data pipelines on AWS. With a strong background in PySpark, Python, and AWS services, you will be responsible for building robust data integration solutions that enable data-driven insights across various internal and external sources.This is...
-
india Senior Data Integration Engineer Full timeMust Have Skills/Skill Requirement:Design and architect integration solutions to connect various enterprise applications, systems, and databases.Develop and implement integration workflows, APIs, and data pipelines to enable smooth communication and data exchange between different applications.Utilize Azure Integration Services such as Azure Logic Apps,...
-
india Senior Data Integration Engineer Full timeMust Have Skills/Skill Requirement: Design and architect integration solutions to connect various enterprise applications, systems, and databases. Develop and implement integration workflows, APIs, and data pipelines to enable smooth communication and data exchange between different applications. Utilize Azure Integration Services such as Azure Logic Apps,...
-
Senior Data Integration Engineer
2 weeks ago
India Senior Data Integration Engineer Full timeMust Have Skills/Skill Requirement: Design and architect integration solutions to connect various enterprise applications, systems, and databases. Develop and implement integration workflows, APIs, and data pipelines to enable smooth communication and data exchange between different applications. Utilize Azure Integration Services such as Azure Logic...
-
Lead Data Engineer: Strategic Data Architect
4 weeks ago
India Wavicle Data Solutions Full timeWavicle Data Solutions is seeking an experienced Lead Data Engineer to play a pivotal role in architecting and implementing data solutions.About the RoleThis position offers a competitive salary of $180,000 - $220,000 per annum, commensurate with experience. Key ResponsibilitiesDesign and develop scalable and efficient data pipelines using Python and...
-
india Wavicle Data Solutions Full timeJob Description: We are seeking a highly experienced Lead Data Engineer with over 8 years of expertise in data engineering. As a Lead Data Engineer, you will play a pivotal role in architecting and implementing data solutions. Your proficiency in Python, PySpark, AWS, Databricks, SQL, and leadership skills will be crucial for success. Key Responsibilities:...
-
india Wavicle Data Solutions Full timeJob Description:We are seeking a highly experienced Lead Data Engineer with over 8 years of expertise in data engineering.As a Lead Data Engineer, you will play a pivotal role in architecting and implementing data solutions.Your proficiency in Python, PySpark, AWS, Databricks, SQL, and leadership skills will be crucial for success.Key Responsibilities:Lead...
-
india Wavicle Data Solutions Full timeJob Description: We are seeking a highly experienced Lead Data Engineer with over 8 years of expertise in data engineering. As a Lead Data Engineer, you will play a pivotal role in architecting and implementing data solutions. Your proficiency in Python, PySpark, AWS, Databricks, SQL, and leadership skills will be crucial for success. Key Responsibilities:...
-
Lead Masters AI | Java Software Engineer | india
4 weeks ago
india Lead Masters AI Full timeCompany Description LeadMasters.ai is an innovative AI-driven platform for lead generation and ad optimization, utilizing advanced algorithms to analyze top-performing ads across social media. The platform empowers businesses of all sizes to maximize their marketing potential through intelligent lead generation and data-driven ad optimization. LeadMasters.ai...
-
ITI Data | PySpark Data Engineer
16 hours ago
india ITI Data Full timeLocation : IndiaType : Full-timeExperience : 10 – 13 years Functions : Consulting, Finance, Information Technology, Big Data Engineering Industries : Capital Markets, Investment Banking, Alternative Investments, Financial Services, Management Consulting, Information Technology and Services, HealthcareJob DescriptionWe are looking for a PySpark solutions...
-
Java software engineer
4 weeks ago
India Lead Masters AI Full timeCompany Description Lead Masters.ai is an innovative AI-driven platform for lead generation and ad optimization, utilizing advanced algorithms to analyze top-performing ads across social media. The platform empowers businesses of all sizes to maximize their marketing potential through intelligent lead generation and data-driven ad optimization. Lead...
-
Data Engineering Lead
3 weeks ago
India Welspun Transformation Services Limited Full timeAs a Data Engineering Lead, you will be responsible for managing and leading the data engineering team in our IT department. You will play a crucial role in designing, building, and maintaining our data infrastructure, data processing systems, and data pipelines. You will also be responsible for implementing data visualization tools and techniques to help...
-
Data Engineering Lead
4 days ago
India Lamipak Full timeLamipak is a leading innovator in the field of Al applications and dashboards, seeking an experienced Data Engineering Lead to spearhead the development and maintenance of scalable data pipelines.As a key member of our team, you will collaborate closely with data scientists and engineers to ensure seamless data integration across platforms, implement ETL...
-
Aws data engineer
2 weeks ago
India ITI Data Full timeJob Description We are looking for an AWS Data with primary skills on Py Spark development who will be able to design and build solutions for one of our Fortune 500 Client programs, which aims towards building an Enterprise Data Lake on AWS Cloud platform, build Data pipelines by developing several AWS Data Integration, Engineering & Analytics resources....
