Platform Data Engineer

21 hours ago

Greater Delhi Area, IN Insight Global Full time

Key Responsibilities

• Administer and optimize Azure Databricks, including clusters, jobs, and user access.

• Manage Snowflake environments (warehouses, roles/permissions, performance tuning, cost optimization).

• Design, implement, and monitor Azure Data Factory (ADF) pipelines for batch and streaming workloads.

• Enable data movement and replication across global environments.

• Orchestrate pipelines using ADF, Apache Airflow, and automation frameworks.

• Automate processes and reduce manual effort with Python, PySpark, SQL, and PowerShell.

• Work with Azure Data Lake Storage (ADLS), Function Apps, and Key Vault for secure and efficient data operations.

• Ensure compliance with security, governance, and cost management best practices.

• Collaborate with Data Engineering, DNA, and Data Science teams to ensure high availability and reliable data delivery.

• Troubleshoot platform issues, implement fixes, and contribute to runbooks and documentation.

• Partner with architects and engineers to continuously improve platform scalability, reliability, and efficiency.


Required Skills and Experience

• 5+ years of experience in data platform engineering/administration.

• Strong expertise in Azure Databricks, Snowflake, and Azure Data Factory.

• Experience on Azure Synapse, Event Hubs, or other Azure data services.

• Hands-on experience with data pipelines, orchestration, and automation.

• Proficiency in SQL, Python, PySpark, and scripting (PowerShell/Bash).

• Experience with Apache Airflow for scheduling and orchestration.

• Strong understanding of Azure services including ADLS, Function Apps, Key Vault, Networking, and Monitoring.

• Familiarity with CI/CD pipelines and Infrastructure as Code (Terraform/ARM).

• Solid knowledge of data governance, security, and cost optimization practices


Soft Skills

• Strong problem-solving and analytical skills.

• Ability to work independently and in a global, collaborative team environment.

• Effective communication skills for technical and non-technical stakeholders.

• Proactive and adaptable mindset with focus on continuous improvement.


Nice to Have

• Experience in DevOps practices for data engineering.

• Knowledge of data governance and compliance frameworks (e.g., GDPR, PCI).

• Familiarity with agile methodologies (JIRA, Confluence).

• Microsoft Azure certifications (e.g., DP-203, AZ-204, AZ-104, AZ-305).

  • Senior Data Engineer

    3 days ago

    Greater Delhi Area, IN Dhurin Full time

    About the CompanyDhurin is a fastgrowing data science firm serving financial services industry. We work with banks, NBFCs, fintech and other financial institutions. Our work is in the space of risk, fraud, collections, marketing, sales, and operations through it we directly influence how financial institutions make smarter decisions. Dhurin is ‘the...

  • Data Engineer

    1 week ago

    Greater Delhi Area, IN Response Informatics Full time

    Requirements: Expert Data Engineer - Hands-on experience with PySpark/Spark-SQL - Hands-on with Spark, SQL optimization - Deep understanding of DWH, Data modelling - Decent understanding of any Cloud - Azure, Databricks, AWS Skills : Data Engineering- Databricks, Azure, AWS, SQL, Python, PySpark.- Backend Data engineer with ability to code and create...

  • Data Engineer

    1 week ago

    Greater Hyderabad Area, IN Logic Pursuits Full time

    Job Title: Data Engineer (Snowflake + dbt)Location: Hyderabad, IndiaJob Type: Full-timeJob Description:We are looking for an experienced and results-driven Data Engineer to join our growing Data Engineering team. The ideal candidate will be proficient in building scalable, high-performance data transformation pipelines using Snowflake and dbt, and able to...

  • Senior Data Engineer

    1 week ago

    Greater Hyderabad Area, IN Logic Pursuits Full time

    Job Title: Senior Data Engineer – Snowflake + dbtLocation: Hyderabad, IndiaJob Type: Full-timeJob Description:We are seeking a highly skilled and experienced Senior Data Engineer to join our growing data team at Logic Pursuits. In this role, you will lead the design and implementation of scalable, high-performance data pipelines using Snowflake and dbt,...

  • GCP Data Engineer

    21 hours ago

    Greater Hyderabad Area, IN Tata Consultancy Services Full time

    Required Technical Skill Set - GCP, Python, SQL, Big Query, ETL Data PipelineLocation of Requirement - Chennai, Kochi, Bangalore,HYD,Pune Must-Have Competencies ,Python, Pandas, NumPySQL, Data Warehouse conceptGCP services (Big Query, Cloud Run, Pub/Sub, Cloud Storage, Spanner, Cloud Composer, Dataflow, Cloud Functions)Docker, Kubernetes, GitHubGood...

  • Senior Data Engineer

    1 week ago

    Greater Hyderabad Area, IN AutomatonsX Full time

    :AutomatonsX is a new-age brand from CtrlS-Cloud4C group, mission-focused on architecting and delivering intelligent automations for large-scale organizations in key industries. We go beyond regular RPA, rendering hyperautomation solutions powered by data transformations and deep analytics, autonomous platforms, and GenAI innovations. From manufacturing,...

  • Head of Data Intelligence

    3 days ago

    Greater Delhi Area, IN Mancer Consulting Services Full time

    Hiring for a Telecom Infrastructure company.Designation: Head of Data IntelligenceLocation: GurgaonPosition Overview:The Head of Data Intelligence will lead the data strategy and execution for our organization. This role involves leading the development and implementation of Data Platform including data ingestion, integration, governance, analytics and...

  • QA Automation Engineer

    1 week ago

    Greater Hyderabad Area, IN Logic Pursuits Full time

    Job Title: QA Automation Engineer Location: Hyderabad, India Job Type: Full-time Job Description We are looking for a detail-oriented and innovative QA Automation Engineer to design, develop, and execute automated testing solutions and comprehensive test plans for Source Systems and Business Data Products. The ideal candidate will have strong expertise in...

  • AWS Data Engineer

    1 week ago

    Greater Hyderabad Area, IN Tata Consultancy Services Full time

    Role : AWS Data EngineerExperience : 6 to 8 yearsLocation : Bangalore, Bhubaneswar, HyderabadJob Description :Desired Competencies (Technical/Behavioral Competency)Must-Have:-At least 4-5 years of hands-on experience in Snowflake /data lake technology stack.Strong understanding of data warehousing concepts, data modeling, metadata management.Must have...

  • AI Security Engineer

    1 week ago

    Greater Delhi Area, IN Tumeryk Full time

    Company DescriptionTumeryk is a security and governance platform tailored for Agentic AI infrastructure. We assist enterprises in discovering, securing, and governing AI agentic applications, chatbots, and large language models across their cloud and internal environments. Our offerings include AI Trust Score™ Guardrails for enforcing real-time controls,...