Platform Data Engineer

3 hours ago

delhi, India Insight Global Full time

Key Responsibilities • Administer and optimize Azure Databricks, including clusters, jobs, and user access. • Manage Snowflake environments (warehouses, roles/permissions, performance tuning, cost optimization). • Design, implement, and monitor Azure Data Factory (ADF) pipelines for batch and streaming workloads. • Enable data movement and replication across global environments. • Orchestrate pipelines using ADF, Apache Airflow, and automation frameworks. • Automate processes and reduce manual effort with Python, PySpark, SQL, and PowerShell. • Work with Azure Data Lake Storage (ADLS), Function Apps, and Key Vault for secure and efficient data operations. • Ensure compliance with security, governance, and cost management best practices. • Collaborate with Data Engineering, DNA, and Data Science teams to ensure high availability and reliable data delivery. • Troubleshoot platform issues, implement fixes, and contribute to runbooks and documentation. • Partner with architects and engineers to continuously improve platform scalability, reliability, and efficiency. Required Skills and Experience • 5+ years of experience in data platform engineering/administration. • Strong expertise in Azure Databricks, Snowflake, and Azure Data Factory. • Experience on Azure Synapse, Event Hubs, or other Azure data services. • Hands-on experience with data pipelines, orchestration, and automation. • Proficiency in SQL, Python, PySpark, and scripting (PowerShell/Bash). • Experience with Apache Airflow for scheduling and orchestration. • Strong understanding of Azure services including ADLS, Function Apps, Key Vault, Networking, and Monitoring. • Familiarity with CI/CD pipelines and Infrastructure as Code (Terraform/ARM). • Solid knowledge of data governance, security, and cost optimization practices Soft Skills • Strong problem-solving and analytical skills. • Ability to work independently and in a global, collaborative team environment. • Effective communication skills for technical and non-technical stakeholders. • Proactive and adaptable mindset with focus on continuous improvement. Nice to Have • Experience in DevOps practices for data engineering. • Knowledge of data governance and compliance frameworks (e.g., GDPR, PCI). • Familiarity with agile methodologies (JIRA, Confluence). • Microsoft Azure certifications (e.g., DP-203, AZ-204, AZ-104, AZ-305).

  • Platform Data Engineer

    3 days ago

    delhi, India Insight Global Full time

    Key Responsibilities• Administer and optimize Azure Databricks, including clusters, jobs, and user access.• Manage Snowflake environments (warehouses, roles/permissions, performance tuning, cost optimization).• Design, implement, and monitor Azure Data Factory (ADF) pipelines for batch and streaming workloads.• Enable data movement and replication...

  • Data Platform Engineer

    3 days ago

    New Delhi, India Grizmo Labs Full time

    What youʼll do:• Design, build, and maintain scalable data platforms and pipelines to support the needs of the business • Ensure data quality and accuracy by implementing data validation and testing processes • Participate in code reviews and provide feedback to improve code quality and adherence to best practices • Work closely with DevOps to...

  • IT Data Platform Engineer

    3 days ago

    New Delhi, India Palo Alto Networks Full time

    Our MissionAt Palo Alto Networks® everything starts and ends with our mission:Being the cybersecurity partner of choice, protecting our digital way of life.Our vision is a world where each day is safer and more secure than the one before. We are a company built on the foundation of challenging and disrupting the way things are done, and we’re looking for...

  • Platform Data Engineer

    4 days ago

    Delhi Division, India Insight Global Full time

    Key Responsibilities - Administer and optimize Azure Databricks, including clusters, jobs, and user access. - Manage Snowflake environments (warehouses, roles/permissions, performance tuning, cost optimization). - Design, implement, and monitor Azure Data Factory (ADF) pipelines for batch and streaming workloads. - Enable data movement and replication across...

  • IT Data Platform Engineer

    2 weeks ago

    New Delhi, India Palo Alto Networks Full time

    Our Mission At Palo Alto Networks® everything starts and ends with our mission: Being the cybersecurity partner of choice, protecting our digital way of life. Our vision is a world where each day is safer and more secure than the one before. We are a company built on the foundation of challenging and disrupting the way things are done, and we’re looking...

  • Data Engineer

    2 weeks ago

    Delhi, India Data-Hat AI Full time

    Department: Data Engineering & AI SolutionsReports To: Lead Data Solutions ArchitectTravel: International travel required (up to 30–40%)Position Summary:We are hiring a senior-level Data Engineer to lead the design, development, and optimization of high-performance data infrastructure that underpins mission-critical AI systems. With 12+ years of...

  • Data engineer

    2 weeks ago

    Delhi, India Data-Hat AI Full time

    Department: Data Engineering & AI Solutions  Reports To: Lead Data Solutions ArchitectTravel: International travel required (up to 30–40%)Position Summary:  We are hiring a senior-level Data Engineer to lead the design, development, and optimization of high-performance data infrastructure that underpins mission-critical AI systems. With 12+ years of...

  • Data Engineer

    2 weeks ago

    Delhi, India Data-Hat AI Full time

    Department: Data Engineering & AI SolutionsReports To: Lead Data Solutions ArchitectTravel: International travel required (up to 30–40%)Position Summary:We are hiring a senior-level Data Engineer to lead the design, development, and optimization of high-performance data infrastructure that underpins mission-critical AI systems. With 12+ years of...

  • Data Engineer

    2 weeks ago

    Delhi, India Data-Hat AI Full time

    Department:Data Engineering & AI SolutionsReports To:Lead Data Solutions ArchitectTravel:International travel required (up to 30–40%)Position Summary: We are hiring a senior-level Data Engineer to lead the design, development, and optimization of high-performance data infrastructurethat underpins mission-critical AI systems. With 12+ years of experience,...

  • Platform Engineer-Data

    1 day ago

    New Delhi, India ValueLabs Full time

    We’re Hiring: Senior Technology Engineer – DevOps & Big DataLocation:ValueLabs Experience:8+ Years Employment Type:Full-timeAtValueLabs , we’re on a mission to revolutionize our data platform withfull automation ,containerization , andcutting-edge distributed architecture . We're looking for aSenior Technology Engineer (STE)who thrives in fast-paced...