Platform Data Engineer

3 days ago

delhi, India Insight Global Full time

Key Responsibilities• Administer and optimize Azure Databricks, including clusters, jobs, and user access.• Manage Snowflake environments (warehouses, roles/permissions, performance tuning, cost optimization).• Design, implement, and monitor Azure Data Factory (ADF) pipelines for batch and streaming workloads.• Enable data movement and replication across global environments.• Orchestrate pipelines using ADF, Apache Airflow, and automation frameworks.• Automate processes and reduce manual effort with Python, PySpark, SQL, and PowerShell.• Work with Azure Data Lake Storage (ADLS), Function Apps, and Key Vault for secure and efficient data operations.• Ensure compliance with security, governance, and cost management best practices.• Collaborate with Data Engineering, DNA, and Data Science teams to ensure high availability and reliable data delivery.• Troubleshoot platform issues, implement fixes, and contribute to runbooks and documentation.• Partner with architects and engineers to continuously improve platform scalability, reliability, and efficiency.Required Skills and Experience• 5+ years of experience in data platform engineering/administration.• Strong expertise in Azure Databricks, Snowflake, and Azure Data Factory.• Experience on Azure Synapse, Event Hubs, or other Azure data services.• Hands-on experience with data pipelines, orchestration, and automation.• Proficiency in SQL, Python, PySpark, and scripting (PowerShell/Bash).• Experience with Apache Airflow for scheduling and orchestration.• Strong understanding of Azure services including ADLS, Function Apps, Key Vault, Networking, and Monitoring.• Familiarity with CI/CD pipelines and Infrastructure as Code (Terraform/ARM).• Solid knowledge of data governance, security, and cost optimization practicesSoft Skills• Strong problem-solving and analytical skills.• Ability to work independently and in a global, collaborative team environment.• Effective communication skills for technical and non-technical stakeholders.• Proactive and adaptable mindset with focus on continuous improvement.Nice to Have• Experience in DevOps practices for data engineering.• Knowledge of data governance and compliance frameworks (e.g., GDPR, PCI).• Familiarity with agile methodologies (JIRA, Confluence).• Microsoft Azure certifications (e.g., DP-203, AZ-204, AZ-104, AZ-305).

  • Platform Data Engineer

    27 minutes ago

    delhi, India Insight Global Full time

    Key Responsibilities • Administer and optimize Azure Databricks, including clusters, jobs, and user access. • Manage Snowflake environments (warehouses, roles/permissions, performance tuning, cost optimization). • Design, implement, and monitor Azure Data Factory (ADF) pipelines for batch and streaming workloads. • Enable data movement and...

  • Data Platform Engineer

    3 days ago

    New Delhi, India Grizmo Labs Full time

    What youʼll do:• Design, build, and maintain scalable data platforms and pipelines to support the needs of the business • Ensure data quality and accuracy by implementing data validation and testing processes • Participate in code reviews and provide feedback to improve code quality and adherence to best practices • Work closely with DevOps to...

  • IT Data Platform Engineer

    3 days ago

    New Delhi, India Palo Alto Networks Full time

    Our MissionAt Palo Alto Networks® everything starts and ends with our mission:Being the cybersecurity partner of choice, protecting our digital way of life.Our vision is a world where each day is safer and more secure than the one before. We are a company built on the foundation of challenging and disrupting the way things are done, and we’re looking for...

  • Platform Data Engineer

    3 days ago

    Delhi Division, India Insight Global Full time

    Key Responsibilities - Administer and optimize Azure Databricks, including clusters, jobs, and user access. - Manage Snowflake environments (warehouses, roles/permissions, performance tuning, cost optimization). - Design, implement, and monitor Azure Data Factory (ADF) pipelines for batch and streaming workloads. - Enable data movement and replication across...

  • IT Data Platform Engineer

    2 weeks ago

    New Delhi, India Palo Alto Networks Full time

    Our Mission At Palo Alto Networks® everything starts and ends with our mission: Being the cybersecurity partner of choice, protecting our digital way of life. Our vision is a world where each day is safer and more secure than the one before. We are a company built on the foundation of challenging and disrupting the way things are done, and we’re looking...

  • Data Engineer

    2 weeks ago

    Delhi, India Data-Hat AI Full time

    Department: Data Engineering & AI SolutionsReports To: Lead Data Solutions ArchitectTravel: International travel required (up to 30–40%)Position Summary:We are hiring a senior-level Data Engineer to lead the design, development, and optimization of high-performance data infrastructure that underpins mission-critical AI systems. With 12+ years of...

  • Data engineer

    2 weeks ago

    Delhi, India Data-Hat AI Full time

    Department: Data Engineering & AI Solutions  Reports To: Lead Data Solutions ArchitectTravel: International travel required (up to 30–40%)Position Summary:  We are hiring a senior-level Data Engineer to lead the design, development, and optimization of high-performance data infrastructure that underpins mission-critical AI systems. With 12+ years of...

  • Data Engineer

    2 weeks ago

    Delhi, India Data-Hat AI Full time

    Department: Data Engineering & AI SolutionsReports To: Lead Data Solutions ArchitectTravel: International travel required (up to 30–40%)Position Summary:We are hiring a senior-level Data Engineer to lead the design, development, and optimization of high-performance data infrastructure that underpins mission-critical AI systems. With 12+ years of...

  • Data Engineer

    2 weeks ago

    Delhi, India Data-Hat AI Full time

    Department:Data Engineering & AI SolutionsReports To:Lead Data Solutions ArchitectTravel:International travel required (up to 30–40%)Position Summary: We are hiring a senior-level Data Engineer to lead the design, development, and optimization of high-performance data infrastructurethat underpins mission-critical AI systems. With 12+ years of experience,...

  • Platform Engineer-Data

    1 day ago

    New Delhi, India ValueLabs Full time

    We’re Hiring: Senior Technology Engineer – DevOps & Big DataLocation:ValueLabs Experience:8+ Years Employment Type:Full-timeAtValueLabs , we’re on a mission to revolutionize our data platform withfull automation ,containerization , andcutting-edge distributed architecture . We're looking for aSenior Technology Engineer (STE)who thrives in fast-paced...