Freelance Azure Data Engineer

1 week ago

india, IN ThreatXIntel Full time

Company DescriptionThreatXIntel is a startup cyber security company focused on empowering businesses and organizations to defend against evolving cyber threats. Offering a comprehensive suite of services, including cloud security, web and mobile security testing, DevSecOps, and cloud security assessments, we tailor affordable solutions to suit the needs of startups and small businesses. With a proactive approach to security, we continuously monitor and assess our clients' digital environments to prevent vulnerabilities. At ThreatXIntel, our mission is to deliver exceptional cyber security services so our clients can safeguard their digital assets while concentrating on their growth.Role DescriptionWe are seeking an experienced Freelance Azure Data Engineer with strong expertise in Vectr and Cribl to design and develop ETL/ELT pipelines, optimize data workflows, and ensure robust data observability and streaming. This role is perfect for an engineer with extensive experience in Azure cloud services and tools for high-performance data processing.Key ResponsibilitiesDesign, develop, and maintain ETL/ELT pipelines using Azure Data Factory (ADF) and Databricks (PySpark) for efficient data transformation and integration.Build and manage API integrations for seamless data exchange between systems.Write and optimize SQL queries and stored procedures for data transformation, analysis, and performance tuning.Implement and manage Azure cloud services, including Azure Data Lake, Azure SQL Database, ensuring scalability and high performance.Develop Python-based data processing solutions for automation, orchestration, and transformation tasks.Integrate and configure Vectr for log management and real-time data streaming, optimizing data pipelines and ensuring data flow integrity.Leverage Cribl for data observability, transforming and routing data efficiently while filtering out unnecessary data.Ensure data security, governance, and compliance with industry standards and best practices.Monitor, troubleshoot, and optimize the performance of data workflows, ensuring reliability and scalability.Write unit tests and collaborate with the testing team to ensure automated testing is fully integrated.Collaborate with cross-functional teams to resolve production issues and provide timely data-related solutions.Required Skills & Qualifications8+ years of experience as a Data Engineer, with a focus on Azure cloud services and data pipeline design.Mandatory expertise in Vectr for log management and real-time data streaming.Strong experience with Cribl for data routing, observability, and transformation.Extensive knowledge in SQL Server, with strong SQL query writing, optimization, and data transformation capabilities.Hands-on experience with Azure Data Factory (ADF), Databricks (PySpark), Azure Data Lake, and Azure SQL Database.Proficiency in Python for data processing automation and orchestration.Experience in unit testing and integrating tests into CI/CD pipelines.Solid understanding of data security, governance, and compliance practices in cloud environments.Excellent problem-solving, multi-tasking, and collaboration skills to work across teams and handle complex data tasks.

  • Azure data engineer

    4 days ago

    india, IN LogFix SCM Solutions Pvt Ltd Full time

    Position: Azure Data EngineerExperience: 5+ YearsLocation: RemoteEngagement: ContractJob DescriptionWe are seeking an experienced Azure Data Engineer to design and implement a scalable, Azure-based Central Asset Registry that integrates data from 120+ SQL Server e-Quip databases and 130+ CSV-based hospital systems.The engineer will be responsible for...

  • Freelance Data Quality Engineer

    1 week ago

    india, IN Leading MNC Part time

    Looking for a Freelance Data Quality Engineer to join a team of rockstar developers. The candidate should have a minimum of 8+ yrs. of experience.There are multiple openings. If you're looking for freelance/ part time opportunity (along with your day job) & a chance to work with the top 0.1% of developers in the industry, this one is for you! You will report...

  • Freelance Data Quality Engineer

    2 weeks ago

    india, IN Leading MNC Part time

    Looking for a Freelance Data Quality Engineer to join a team of rockstar developers. The candidate should have a minimum of 8+ yrs. of experience.There are multiple openings. If you're looking for freelance/ part time opportunity (along with your day job) & a chance to work with the top 0.1% of developers in the industry, this one is for you! You will report...

  • Freelance Machine Learning Engineer

    2 weeks ago

    india, IN Leading MNC Part time

    Looking for a Freelance Machine Learning Engineer to join a team of rockstar developers. The candidate should have a minimum of 8+ yrs. of experience.There are multiple openings. If you're looking for freelance/ part time opportunity (along with your day job) & a chance to work with the top 0.1% of developers in the industry, this one is for you! You will...

  • Senior Data Engineer – Azure

    1 week ago

    Bangalore Urban, Karnataka, India, IN XML International Full time

    Senior Data Engineer – Azure (JG4)Location: Bangalore, India (Onsite)Contract Type: 1-year contract (January–June 2026, and a possible extension to December 2026)Work Schedule: Full-time, on-siteApplication Deadline: Until the position is filledJob OverviewWe are seeking a Senior Data Engineer (JG4) with strong Azure expertise to design, build, and...

  • Azure Data Lead/ Architect

    1 week ago

    india, IN Tech Mahindra Full time

    Job Description :Role: Azure Data Lead/ architectLocation: Pan India Work Mode: Hybrid *6 +years' experience in Data Engineering environment*Expertise in CI-CD, Pyspark, SQL*Expertise in ADF, ADLS & ADB (Mandatory)*Experience in "Azure Services / Key Vault"*Experience in "GIT / Jenkins / Azure DevOps"

  • Data Support Engineer

    2 weeks ago

    india, IN Kumaran Systems Full time

    Dear Candidate,Greeting,Experience : 8+ YearsWork Model: WFHWork Timings: Starts from 3pmWe’re looking for a skilled Data Support Engineer with 8+ years of experience . The ideal candidate will serve as the escalation point for data ingestion, pipeline, and consumption issues while ensuring high system stability through proactive monitoring and root-cause...

  • Freelance Agentic AI

    4 days ago

    india, IN ThreatXIntel Full time

    Company DescriptionThreatXIntel is a cybersecurity startup focused on safeguarding businesses and organizations from evolving cyber threats. Our team specializes in cloud security, web and mobile security testing, and DevSecOps, offering tailor-made and cost-effective solutions to meet the unique needs of our clients. With a proactive approach, we...

  • Azure Data Services Engineer

    2 weeks ago

    india, IN Gravity Infosolutions, Inc. Full time

    Position: Azure Data Engineer – Microsoft FabricExperience: 6+ yearsLocation: RemoteJob Summary: We are looking for an experienced Azure Data Engineer with strong expertise in Microsoft Fabric and the Azure data ecosystem. The ideal candidate will design, build, and optimize scalable data solutions, enabling advanced analytics and business insights across...

  • Azure Data Architect

    2 weeks ago

    india, IN 9NEXUS Full time

    Job Title: Azure Data ArchitectExperience: 8–12 YearsLocation: RemoteJob DescriptionWe are seeking an experienced Azure Data Architect to design, implement, and optimize enterprise-scale data platforms on Microsoft Azure.Key ResponsibilitiesDesign end-to-end Azure data architecture including ingestion, storage, processing, and consumption layers.Lead...