Platform Data Engineer

3 weeks ago

Greater Delhi Area, IN Insight Global Full time

Key Responsibilities

• Administer and optimize Azure Databricks, including clusters, jobs, and user access.

• Manage Snowflake environments (warehouses, roles/permissions, performance tuning, cost optimization).

• Design, implement, and monitor Azure Data Factory (ADF) pipelines for batch and streaming workloads.

• Enable data movement and replication across global environments.

• Orchestrate pipelines using ADF, Apache Airflow, and automation frameworks.

• Automate processes and reduce manual effort with Python, PySpark, SQL, and PowerShell.

• Work with Azure Data Lake Storage (ADLS), Function Apps, and Key Vault for secure and efficient data operations.

• Ensure compliance with security, governance, and cost management best practices.

• Collaborate with Data Engineering, DNA, and Data Science teams to ensure high availability and reliable data delivery.

• Troubleshoot platform issues, implement fixes, and contribute to runbooks and documentation.

• Partner with architects and engineers to continuously improve platform scalability, reliability, and efficiency.


Required Skills and Experience

• 5+ years of experience in data platform engineering/administration.

• Strong expertise in Azure Databricks, Snowflake, and Azure Data Factory.

• Experience on Azure Synapse, Event Hubs, or other Azure data services.

• Hands-on experience with data pipelines, orchestration, and automation.

• Proficiency in SQL, Python, PySpark, and scripting (PowerShell/Bash).

• Experience with Apache Airflow for scheduling and orchestration.

• Strong understanding of Azure services including ADLS, Function Apps, Key Vault, Networking, and Monitoring.

• Familiarity with CI/CD pipelines and Infrastructure as Code (Terraform/ARM).

• Solid knowledge of data governance, security, and cost optimization practices


Soft Skills

• Strong problem-solving and analytical skills.

• Ability to work independently and in a global, collaborative team environment.

• Effective communication skills for technical and non-technical stakeholders.

• Proactive and adaptable mindset with focus on continuous improvement.


Nice to Have

• Experience in DevOps practices for data engineering.

• Knowledge of data governance and compliance frameworks (e.g., GDPR, PCI).

• Familiarity with agile methodologies (JIRA, Confluence).

• Microsoft Azure certifications (e.g., DP-203, AZ-204, AZ-104, AZ-305).

  • Senior Data Engineer

    3 weeks ago

    Greater Delhi Area, IN Dhurin Full time

    About the CompanyDhurin is a fastgrowing data science firm serving financial services industry. We work with banks, NBFCs, fintech and other financial institutions. Our work is in the space of risk, fraud, collections, marketing, sales, and operations through it we directly influence how financial institutions make smarter decisions. Dhurin is ‘the...

  • Databricks QA Engineer – Python, PySpark

    3 weeks ago

    Greater Hyderabad Area, IN ValueMomentum Full time

    Job Title: Data QA Engineer – Databricks & PythonExperience: 3 – 8 YearsLocation: Hyderabad / Pune / CoimbatoreNotice Period: Immediate to 30 DaysAbout The JobWe are seeking a Data QA Engineer with strong experience in Databricks and Python to ensure the quality, reliability, and accuracy of data pipelines and analytical solutions. The ideal candidate...

  • GCP Data Engineer

    3 weeks ago

    Greater Hyderabad Area, IN Tata Consultancy Services Full time

    Required Technical Skill Set - GCP, Python, SQL, Big Query, ETL Data PipelineLocation of Requirement - Chennai, Kochi, Bangalore,HYD,Pune Must-Have Competencies ,Python, Pandas, NumPySQL, Data Warehouse conceptGCP services (Big Query, Cloud Run, Pub/Sub, Cloud Storage, Spanner, Cloud Composer, Dataflow, Cloud Functions)Docker, Kubernetes, GitHubGood...

  • Head of Data Intelligence

    3 weeks ago

    Greater Delhi Area, IN Mancer Consulting Services Full time

    Hiring for a Telecom Infrastructure company.Designation: Head of Data IntelligenceLocation: GurgaonPosition Overview:The Head of Data Intelligence will lead the data strategy and execution for our organization. This role involves leading the development and implementation of Data Platform including data ingestion, integration, governance, analytics and...

  • AWS DeVops Engineer

    4 weeks ago

    Greater Bengaluru Area, IN Tata Consultancy Services Full time

    Greetings from Tata Consulting ServicesTCS is Hiring for AWS DevOps EngineerExperience : 5-9 years yearsLocation: Bangalore/ Chennai/Gurgaon/ Pune Please find the JD belowRequired Technical Skill - • Cloud Platform automation through DevOps scripting o (Terraform, Ansible, HELM, K8S, Shell, Python, Ruby, PowerShell, CloudFormation etc..or Similar DevOps...

  • Solutions Engineer

    3 weeks ago

    Greater Bengaluru Area, IN INDI Staffing Services Full time

    At INDI, we're passionate about empowering individuals and businesses worldwide. Our cutting-edge recruiters connect leading companies with top talent, fostering a dynamic environment where innovation thrives. Join us in shaping the future of work.Overview of the role:The Solutions Engineer will play a key role in driving enterprise adoption of an advanced...

  • Data Associate

    2 weeks ago

    Greater Coimbatore Area, IN Arcana Full time

    We are seeking a detail-oriented Data Associate to join our growing team. As a Data Associate, you will work closely with our product managers, financial analysts, and engineers to ensure high-quality data integration, analysis, and maintenance. The ideal candidate will have a passion for working with large datasets, a strong analytical mindset, and a desire...

  • Language Specialist-Data Annotation

    3 weeks ago

    Greater Delhi Area, IN Innodata Inc. Full time

    In this role, you will analyse, label, and categorise text content to help train AI models to recognise and respond appropriately to sensitive, harmful, or policy-violating language.Your work will directly contribute to building safe, inclusive, and responsible AI systems across multiple languages and cultural contexts.Languages RequiredWe are hiring for the...

  • Software Engineer

    3 weeks ago

    Greater Bengaluru Area, IN Checkpoint Systems Full time

    SUMMARYWe are looking for Senior Software Engineer on Java Platform in our R&D team who works creatively andindependently to establish objectives, meet deadlines, and complete difficult engineering assignment bydemonstrating full competency in the software development area and to design, development anddeployment of our SaaS based Enterprise Inventory...

  • AI Engineer – Generative AI

    3 weeks ago

    Greater Hyderabad Area, IN Accelyst, LLC Full time

    AI Engineer – Generative AI & LLMsOnsite Role - Hyderabad Accelyst is an innovative AI Consultancy that leverages a unique catalog of industry-specific Agents and leading-edge AI platforms to deliver tangible, integrated, secure and ROI-optimized solutions. We combine deep industry and technical expertise to enable rapid deployment of innovative AI-driven...