Data engineer iii

Withum is a place where talent thrives - where who you are matters. It’s a place of endless opportunities for growth. A place where entrepreneurial energy plus inclusive teamwork equals exponential results. We empower clients with innovative tools and solutions to address their data, analytics, and business intelligence needs. At Withum, talent thrives—we recruit only the best and brightest people with a genuine passion for technology and impact.We are seeking Data Engineer III to join our Product Development team in our Bengaluru office. This role is ideal for a firsthand engineer who can design, build, and optimize data pipelines and architectures, while mentoring junior engineers and collaborating across teams to deliver scalable data solutions.How You'll Spend Your Time:- Design and implement scalable data pipelines using Azure Data Factory, Synapse Pipelines, and Apache Spark on Azure Fabric.- Architect and maintain data models and storage solutions using One Lake, Delta Lake, Parquet, ADLS gen2.- Develop and optimize Dataflows Gen2, Notebooks, and KQL queries for data transformation and exploration.- Collaborate with data scientists, analysts, and business stakeholders to understand data needs and deliver robust solutions.- Implement data governance, lineage, and quality frameworks using Microsoft Purview and Fabric Data Activator.- Supporting CI/CD pipelines and automation for data workflows using Azure Dev Ops or Git Hub Actions.- Integrating external datasets by working with APIs and third-party data sources.- Ensure security, compliance, and performance of data systems.- Mentor junior engineers and contribute to best practices and architectural standards.The Kinds of People We Want to Talk To:- Education: A bachelor’s degree or higher in Computer Science, Information Systems, or a related field.- Experience: 8 years of experience in data engineering, including a minimum of two years on Azure.- Proficiency: Skilled in SQL, Python, and Spark.- Azure Services: Experience with Azure cloud services such as Data Factory, Synapse, Blob Storage, Functions, ADLS gen2, and Data Bricks.- Microsoft Fabric: Advanced expertise in Microsoft Fabric- Data Management: Familiarity with data governance, lineage, and cataloging tools.- Data Warehousing: Strong understanding of data warehousing concepts and dimensional modeling.- Methodologies: Proficient with version control (Git), CI/CD, and Agile methodologies.- Communication: Excellent communication and collaboration skills.- Certification: Microsoft Azure Data Engineer certification is an advantage.Must-Have Technical Skills:- Cloud Platform: Advanced expertise in Microsoft Azure, with a particular focus on Microsoft Fabric.- Data Engineering: Proficiency in Azure Data Factory, Azure Synapse Analytics, and Apache Spark.- Lakehouse Architecture: Familiarity with One Lake, Delta Lake, Parquet, Delta, Iceberg, and Hudi.- Warehousing: Proficiency in star/snowflake schemas, dimensional modeling, and satellite hub models.- Programming: Expertise in Python, Py Spark, SQL, and KQL (Kusto Query Language).- Data Orchestration: Firsthand experience with Dataflows Gen2 and Notebooks.- Dev Ops & CI/CD: Proficiency in Azure Dev Ops, Git, and YAML pipelines.- Security & Governance: Advanced understanding of Microsoft Purview, RBAC, and data masking techniques.Nice-to-Have Skills:- Streaming & Real-Time: Knowledge and experience with Azure Event Hubs and Azure Stream Analytics.- Machine Learning Integration: Familiarity with Azure ML and MLflow.- Monitoring & Observability: Proficiency in Azure Monitor and Log Analytics.- Data Visualization: Expertise in Power BI, particularly in Direct Lake mode.- Infrastructure Code: Experience with Bicep and Terraform.- Data Cataloging: Familiarity with Data Activator and data lineage tools.- Other Tools: Knowledge of dbt, Delta Live Tables, and Great Expectations.Website: will not discriminate against any employee or applicant for employment because of race, color, religion, sex, sexual orientation, gender identity, nationalorigin, age, maritalstatus, genetic information, disability or because he or she is a protected veteran.