Freelance Senior Data Engineer

2 days ago

Tiruppur, India ThreatXIntel Full time

Company DescriptionThreatXIntel is a startup cybersecurity company focused on delivering advanced and tailored solutions to protect businesses and organizations from cyber threats. Our expertise spans cloud security, web and mobile security testing, DevSecOps, and cloud security assessment. We are committed to providing affordable and custom solutions that cater specifically to the needs of businesses of all sizes, ensuring high-quality protection for digital assets. With a proactive approach to security, ThreatXIntel helps clients identify and address vulnerabilities before they can be exploited, allowing businesses to operate with confidence and peace of mind.Role DescriptionWe are seeking an experienced Freelance Senior Data Engineer with strong expertise in Vectr, Cribl, Azure Data Factory (ADF), Databricks (PySpark), and large-scale ETL/ELT development. The consultant will play a key role in designing, building, and optimizing cloud-native data pipelines, integrating disparate data sources, and ensuring secure, high-quality data processing across the organization.This is a senior-level role requiring 8+ years of data engineering experience along with deep Azure and Python capabilities.ResponsibilitiesDesign, develop, and maintain ETL/ELT pipelines using Azure Data Factory (ADF) and Databricks (PySpark)Develop and manage API integrations for seamless data exchange across internal and external systemsWrite, tune, and optimize SQL queries, stored procedures, and transformation logicBuild, secure, and maintain data platforms including Azure Data Lake and Azure SQL DatabaseImplement Python-based automation, orchestration, and data processing workflowsLeverage Vectr and Cribl for pipeline observability, log analytics, and data flow monitoringTroubleshoot and optimize pipeline performance, ensuring reliability and scalabilityPerform unit testing, integrate with automated test frameworks, and collaborate with QA teamsEnsure data governance, compliance, and security alignment with enterprise and industry standardsWork independently while communicating effectively with cross-functional teamsRequired Technical SkillsStrong proficiency in designing and building ETL/ELT pipelinesHands-on expertise with Azure Data Factory (ADF)Practical experience developing data workflows using Databricks (PySpark)Advanced skills in Python for automation, orchestration, and data processingStrong SQL development skills including query optimization and stored proceduresExperience working with Azure Data Lake and Azure SQL DatabaseAbility to build and manage API integrations for data exchangeWorking knowledge of Vectr for analytics and data security visibilityWorking knowledge of Cribl for log routing, observability, and pipeline monitoringFamiliarity with data governance, security controls, and cloud best practices

  • Senior data engineer

    2 weeks ago

    Tiruppur, India MyRemoteTeam Inc Full time

    About Us My Remote Team, Inc is a fast-growing distributed workforce enabler, helping companies scale with top global talent. We empower businesses by providing world-class software engineers, operations support, and infrastructure to help them grow faster and better. Position: Senior Data Engineer (Python Coder) Location: India ( Remote ) Work Commitment:...

  • AWS, Snowflake, DBT, Terraform- Senior Data Engineer

    3 weeks ago

    Tiruppur, India COREDATA CONSULTANCY Full time

    Role DescriptionWe are seeking a Senior Data Engineer with expertise in AWS, Snowflake, DBT, and Terraform. This is 1 year extendable contractual role where you will design, build, and optimize scalable data solutions. Your responsibilities will include creating and maintaining data pipelines, developing data models, implementing ETL processes, and ensuring...

  • Principal Data Architect

    1 week ago

    tiruppur, India beBeeDataEngineering Full time

    Senior Data Engineering PositionWe are seeking an accomplished Senior Data Engineer to design, develop, and maintain large-scale data pipelines.This role requires a highly skilled individual with expertise in SQL, ETL development, and experience working with big data ecosystems. The ideal candidate will have a strong proficiency in PySpark and the ability to...

  • Chief Data Architect

    2 weeks ago

    tiruppur, India beBeeDataEngineer Full time

    Senior Data Engineer RoleYou will play a pivotal role in designing, developing, and maintaining large-scale data pipelines. Your collaboration with cross-functional teams will lead to the development and implementation of data solutions that drive business growth.Key Responsibilities:Design and build data pipelines from core services and products into our...

  • Data Engineer

    37 minutes ago

    Tiruppur, India Vriba Solutions Full time

    Role: Data EngineeringRemoteLooking for 5-10 years of ExpSkill Set:AWS, Snowflake, Kafka, Airflow, GitHub, PySpark, PythonKey Responsibilities:Design, develop, and maintain scalable ETL/ELT pipelinesIngest data from various sources (APIs, databases, files, etc.)Implement both real-time and batch processing solutions based on use case requirementsEnsure data...

  • Data Analyst

    2 weeks ago

    Tiruppur, India Taskify AI Full time

    We're Hiring "Data Analyst (Freelance/Remote)" | Earn up to $2500 per month Location: India (Remote) What You Will Be Doing: - Contribute to training and refining cutting-edge AI systems - Adopt a “user mindset” to produce natural and realistic data for AI development - Develop rubrics to structure and address user needs effectively - Evaluate...

  • Customer Engineer

    1 week ago

    Tiruppur, India Konecta Full time

    In this role, you will be the technical point of contact for the customer – a trusted partner for their IT leadership – as the primary engineer on the project, working with multifunctional teams both internally and externally. You are a customer-facing data engineer who genuinely loves solving problems and can handle client expectations while working on...

  • Senior data scientist

    1 week ago

    Tiruppur, India Aditya Birla Fashion And Retail Ltd. Full time

    About the Role We are looking for a motivated Data Analyst to join our team. The ideal candidate should have strong fundamentals in analytics, hands-on experience in Python, SQL, and Power BI, and a good understanding of cloud platforms. You will work closely with cross-functional teams to build dashboards, automate data pipelines, and support model...

  • Part Time Fresher Data Typist

    4 days ago

    Tiruppur, India Sapat International Pvt Ltd Full time

    Data Entry Computer Operator and Back Office The position is remote working from home o based Must have Computer knowledge and Basic Typing speed College az Student For more details or instant reply WhatssApp your namee on this number - **8O 528 495 55** **Job Types**: Part-time, Fresher, Freelance **Salary**: ₹26,000.00 - ₹29,000.00 per...

  • Learning Support Specialist

    3 weeks ago

    Tiruppur, India Emeritus Full time

    About Emeritus:Emeritus is committed to teaching the skills of the future by making high-quality education accessible and affordable to individuals, companies, and governments around the world. It does this by collaborating with more than 50 top-tier universities across the United States, Europe, Latin America, Southeast Asia, India and China.Emeritus’...