Lead Data Engineer
2 days ago
What You Will Do :
As a Lead Data Engineer, you will be instrumental in driving our data strategy, ensuring data quality, and leading the technical execution of a small, impactful team.
Your responsibilities will include :
Team Leadership :
- Establish the strategic vision for the evolution of our data products and our technology solutions, then provide technical leadership and guidance for a small team of Data Engineers in executing the roadmap.
- Champion and enforce best practices for data quality, governance, and architecture within your team's work. Embody a product mindset over the team's data.
- Oversee the team's use of Agile methodologies (e.g., Scrum, Kanban), ensuring smooth and predictable delivery, and overtly focusing on continuous improvement.
Data Expertise & Domain Knowledge :
- Actively seek out, propose, and implement cutting-edge approaches to data transfer, transformation, analytics, and data warehousing to drive innovation.
- Design and implement scalable, robust, and high-quality ETL processes to support growing business demand for information, delivering data as a reliable service that directly influences decision making.
- Develop a profound understanding and 'feel' for the business meaning, lineage, and context of each data field within our domain.
Communication & Stakeholder Partnership :
- Collaborate with other engineering teams and business partners, proactively managing dependencies and holding them accountable for their contributions to ensure successful project delivery.
- Actively engage with data consumers to achieve deep understanding of their specific data usage, pain points, and current gaps, then plan initiatives to implement improvements collaboratively.
- Clearly articulate project goals, technical strategies, progress, challenges, and business value to both technical and non-technical audiences. Produce clear, concise, and comprehensive documentation.
Your Qualifications :
- At Vista, we value the experience and potential that individual team members add to our culture. Please don't hesitate to apply even if you don't meet the exact qualifications, we look forward to learning more about you
- Bachelor's or Master's degree in computer science, data engineering, or a related field.
years of professional experience, with at least 6 years of hands-on Data Engineering, specifically in e-commerce or direct to consumer, and 4 years of team leadership
- Demonstrated experience in leading a team of data engineers, providing technical guidance, and coordinating project execution
- Stakeholder management experience and excellent communication skills
- Strong knowledge of SQL and data warehousing concepts is a must
- Strong knowledge of Data Modeling concepts and hands-on experience designing complex multi-dimension data models
- Strong hands-on experience in designing and managing scalable ETL pipelines in cloud environments with large volume datasets (both structured/unstructured data)
- Proficiency with cloud services in AWS (Preferred), including S3, EMR, RDS, Step Functions, Fargate, Glue etc.
- Critical hands-on experience with cloud-based data platforms (Snowflake strongly preferred)
- Data Visualization experience with reporting and data tools (preferably Looker with LookML skills)
- Coding mastery in at least one modern programming language : Python (strongly preferred), Java, Golang, PySpark, etc.
- Strong knowledge in production standards such as versioning, CI/CD, data quality, documentation, automation, etc.
- Problem solving and multi-tasking ability in a fast-paced, globally distributed environment
Nice To Have :
- Experience with API development on enterprise platforms, with GraphQL APIs being a clear plus
- Hands-on experience designing DBT data pipelines
- Knowledge of finance, accounting, supply chain, logistics, operations, procurement data is a plus
- Experience managing work in Jira and writing documentation in Confluence
- Proficiency in AWS account management, including IAM, infrastructure, and monitoring for health, security and cost optimization
- Experience with Gen AI/ML tools for enhancing data pipelines or automating analysis
Our Team : Enterprise Business Solutions
Vista's Enterprise Business Solutions (EBS) domain is working to make our company one of the most data-driven organizations to support Finance, Supply Chain, and HR functions. The cross-functional team includes product owners, analysts, technologists, data engineers and more - all focused on providing Vista with cutting-edge tools and data we can use to deliver jaw-dropping customer value. EBS team members are empowered to learn new skills, communicate openly, and be active problem-solvers.
Join our EBS Domain as a Lead Data Engineer This Lead level within the organization will be responsible for the work of a small team of data engineers, focusing not only on implementations but also operations and support. The Lead Data Engineer will implement best practices, data standards, and reporting tools. The role will oversee and manage the work of other data engineers as well as being an individual contributor.
This role has a lot of opportunity to impact general ETL development and implementation of new solutions. We will look to the Lead Data Engineer to modernize data technology solutions in EBS, including the opportunity to work on modern warehousing, finance, and HR datasets and integration technologies. This role will require an in-depth understanding of cloud data integration tools and cloud data warehousing, with a strong and pronounced ability to lead and execute initiatives to tangible results.
-
Senior Lead Data Engineer
3 days ago
Anywhere in India/Multiple Locations People Prime Worldwide Pvt. Ltd. Full time ₹ 8,00,000 - ₹ 20,00,000 per yearAbout Client : Our Client is a global IT services company headquartered in Southborough, Massachusetts, USA. Founded in 1996, with a revenue of $1.8B, with 35,000 associates worldwide, specializes in digital engineering, and IT services company helping clients modernize their technology infrastructure, adopt cloud and AI solutions, and accelerate...
-
Data Engineer
5 days ago
Anywhere in India/Multiple Locations Firstcareercentre Full time ₹ 20,00,000 - ₹ 25,00,000 per yearEssential Duties & Responsibilities : - Design, develop, and optimize scalable data pipelines for ETL/ELT processes. - Develop and maintain Python-based data processing scripts and automation tools. - Write and optimize complex SQL queries (preferably in Snowflake) for data transformation and analytics. - Work with Jenkins or other CI/CD tools to...
-
Data Engineering Manager
3 days ago
Anywhere in India/Multiple Locations YipitData Full time ₹ 12,00,000 - ₹ 36,00,000 per yearAbout Us : YipitData is the leading market research and analytics firm for the disruptive economy and most recently raised $475M from The Carlyle Group at a valuation of over $1B. Every day, our proprietary technology analyzes billions of alternative data points to uncover actionable insights across sectors like software, AI, cloud, e-commerce,...
-
Data Engineer
3 days ago
Anywhere in India/Multiple Locations Risk Resources LLP Full time ₹ 10,00,000 - ₹ 15,00,000 per yearOverview : The Data Engineer specializing in Snowflake, Azure, and AWS technologies plays a crucial role in designing, developing, and maintaining scalable data solutions to meet the organization's evolving data needs. The role requires expertise in a range of data engineering tools and platforms for managing and transforming large sets of structured and...
-
Data Engineer
3 hours ago
Anywhere in India/Multiple Locations Techno Wise Full time ₹ 20,00,000 - ₹ 25,00,000 per yearJob Title : Data Engineer - Informatica MDM / IDMC Azure Location : Remote (India) OR Pune (Hybrid) Employment Type : Full-timeAbout the Role : - We are looking for an experienced Data Engineer who has successfully transitioned from Informatica MDM / IDMC to modern Azure data engineering platforms. If you have strong expertise in SQL, Azure Data...
-
Data Engineer
5 days ago
Anywhere in India/Multiple Locations Techno Wise Full time ₹ 15,00,000 - ₹ 25,00,000 per yearData Engineer (SAS DQ Conversion) Location : PAN INDIA (Preferred Hyderabad) - Hybrid Experience : 4+ YearsAbout the Role : We are seeking a motivated and detail-oriented Data Engineer to join our team. The ideal candidate will have hands-on experience with SQL, particularly translating between different SQL dialects, and a strong background or...
-
Data Engineer
2 days ago
Anywhere in India/Multiple Locations HyrEzy Talent Solutions Full time ₹ 15,00,000 - ₹ 25,00,000 per yearTitle : Data Engineer - SQL , PLSQL, ETL (IBM Data Stage)Location : RemoteType : Full TimeJob Role : We are looking for an experienced SQL , PLSQL and Data Stage ETL developer to join our team as a Data Engineer who will work as part of a team to help design and develop data-driven solutions that deliver insights to the business. The ideal candidate is a...
-
NucleusTeq - Big Data Engineer - Spark/Scala
5 days ago
Anywhere in India/Multiple Locations NucleusTeq Consulting Private Limited Full time ₹ 15,00,000 - ₹ 25,00,000 per yearRole : Big Data Engineer Responsibilities : - Big Data Engineer with 5-6 years of experience - Experience in leading a team of engineers and a good attitude toward learning the domain and implementation - Strong exposure and expertise in Spark (Primary), Scala/Java (Scala Primary), Airflow Orchestration and AWS. - Finalizing the scope of the...
-
Senior Data Engineer
3 days ago
Anywhere in India/Multiple Locations Techno Wise Full time ₹ 15,00,000 - ₹ 25,00,000 per yearThe Senior Data Engineer will be responsible for building new segments in a Customer Data Platform (CDP), maintaining the segments, understanding the data requirements for use cases, data integrity, data quality and data sources involved to build the specific use cases. The resource should also have an understanding of ETL processes. This position will...
-
Data Engineer
2 days ago
Anywhere in India/Multiple Locations Firstcareercentre Full time ₹ 15,00,000 - ₹ 25,00,000 per yearJob Summary : We are looking for a skilled Big Data Engineer with expertise in Google BigQuery to join our team. The ideal candidate should have hands-on experience in designing, developing, and maintaining large-scale data processing systems and data warehouses. You will be responsible for building efficient data pipelines, optimizing queries, and...