Visionary Data Architect

Talent500 is hiring for a Senior Lead Data Engineer to join our Enterprise Data & Analytics team. As a technical leader and mentor, you will drive best practices in data engineering, architecture, and governance.

You will lead the design and implementation of scalable, high-performance data solutions that support Sales, Marketing, Manufacturing, Finance, and Engineering across a world-class manufacturing organization.

The ideal candidate will be deeply curious about the evolving data landscape, passionate about innovation, and committed to enabling AI-powered business capabilities through high-quality, well-governed data.

• Data Pipelines: Architect, design, and optimize complex data pipelines using Databricks and Azure Data Services.
• Data Solutions: Lead the development of scalable data solutions using Python, PySpark, and distributed computing frameworks.
• Data Quality Standards: Define and enforce data quality standards, ensuring data is timely, accurate, and complete.
• Data Models: Design and maintain enterprise-grade data models using star and snowflake schemas.
• Advanced SQL: Write and review advanced SQL, including CTEs, aggregations, and complex joins.
• Cross-Functional Collaboration: Collaborate with cross-functional teams to translate business needs into robust data solutions.
• Documentation and Governance: Champion documentation, metadata management, and data governance practices.
• Power BI and Sigma Computing: Guide the development of Power BI and Sigma Computing dashboards and semantic models.
• Data Integration: Integrate data from relational (Oracle, SQL Server, Postgres) and NoSQL (MongoDB) sources.
• Integration Efforts: Lead integration efforts with Informatica Cloud Platform, including Customer 360, Reference 360, and MDM SaaS.
• Real-Time Data Ingestion: Architect and implement real-time data ingestion using Kafka, AWS SNS/SQS, and event-driven patterns.
• GitHub: Use GitHub for source control, code reviews, and CI/CD workflows.
• Mentorship and Knowledge Sharing: Mentor junior engineers, promote knowledge sharing, and foster a culture of technical excellence.

Requirements:

• A bachelor's degree in data analytics, data science, computer science, or a related field – or equivalent work experience.
• 5 - 7 years of hands-on experience with Databricks.

Qualifications:

• A bachelor's degree in data analytics, data science, computer science, or a related field or equivalent work experience.
• 5+ years of experience in data engineering, with a strong focus on Azure and Databricks.
• Expert-level proficiency in Python, PySpark, and distributed data processing.
• Deep understanding of data modeling, data warehousing, and ETL / ELT best practices.
• Advanced SQL skills, including CTEs, aggregations, and joins.
• Proven experience implementing data quality frameworks and scalable data architectures.
• Strong working knowledge of Power BI, Sigma Computing, and data visualization principles.
• Experience with Informatica Cloud tools and MDM strategies.
• Proficiency with relational databases and NoSQL technologies.
• Experience with real-time data streaming and event-driven architectures.
• Proficiency with GitHub and modern DevOps practices.

Leadership Skills/Preferred Attributes:

• Strategic thinker with a passion for data innovation and emerging technologies.
• Strong leadership and communication skills with the ability to influence across teams.
• Committed to mentorship, team development, and technical excellence.
• Enthusiastic about building a data-driven culture and enabling AI/ML capabilities.
• Comfortable working in a fast-paced, agile environment with shifting priorities.

Certifications or Licenses:

• Databricks Certified Data Engineer Professional
• Informatica Cloud Data Integration Specialist
• Travel Expected: 5-10% of time