Freelance Data Engineering Specialist

1 day ago

Thiruvananthapuram, Kerala, India beBeeDataEngineer Full time ₹ 10,00,000 - ₹ 20,00,000
Job Opportunity: Freelance Data Engineer

ThreatXIntel, a startup cyber security company, is seeking an experienced Freelance Data Engineer with strong expertise in Python and AWS services to design, develop, and optimize data pipelines.

Key Responsibilities:
  • Design and develop scalable data pipelines using AWS Glue, PySpark, and Step Functions.
  • Implement ETL/ELT processes for ingesting, transforming, and delivering data from multiple sources.
  • Manage and optimize storage solutions with Amazon S3.
  • Write reusable and efficient Python code for data engineering workflows.
  • Implement unit and integration tests using pytest to ensure data quality and pipeline reliability.
  • Collaborate using Git/GitHub for version control, code reviews, and CI/CD integration.
  • Create clear technical documentation for pipelines, workflows, and design decisions.
Qualifications:
  • 5-10 years of data engineering experience, with at least 5 years in the AWS ecosystem.
  • Strong coding skills in Python with experience in PySpark.
  • Hands-on experience with AWS Glue, Step Functions, and S3.
  • Proficiency in pytest for test automation.
  • Solid understanding of Git/GitHub workflows.
  • Strong communication skills with a focus on documentation and knowledge sharing.

This role offers a unique opportunity to work with cutting-edge technologies and contribute to the development of innovative data pipelines. If you are passionate about data engineering and have the required skills, please apply for this exciting opportunity.

  • Freelance Data Governance Specialist

    4 days ago

    Thiruvananthapuram, Kerala, India beBeeAccess Full time ₹ 1,20,00,000 - ₹ 1,50,00,000

    We are seeking a skilled Freelance Access Control Specialist to join our team.The ideal candidate will have expertise in designing and implementing authorization policies that safeguard sensitive data across multiple platforms, including CRM systems, data lakes, reporting tools, APIs, and enterprise applications. This is a highly skilled freelance role...

  • Freelance Cloud Engineer Specialist

    2 days ago

    Thiruvananthapuram, Kerala, India beBeeCloudEngineer Full time ₹ 20,00,000 - ₹ 25,00,000

    Remote Role: Cloud Engineer with Java ExpertiseWe are seeking a highly skilled Cloud Engineer to join our team on a freelance contract basis. As a key member of our team, you will design, develop, and maintain applications using Java SpringBoot.Key Responsibilities:Manage cloud infrastructure on AWSImplement CI/CD pipelinesEnsure high availability and...

  • Freelance Data Modeler

    4 days ago

    Thiruvananthapuram, Kerala, India ThreatXIntel Full time

    Company DescriptionThreatXIntel is a startup cyber security company focused on protecting businesses and organizations from cyber threats. We offer a range of services, including cloud security, web and mobile security testing, cloud security assessment, and DevSecOps. Our goal is to provide customized, affordable solutions that meet the specific needs of...

  • Freelance Child Safety Specialist

    3 days ago

    Thiruvananthapuram, Kerala, India beBeeChildSafety Full time ₹ 6,00,000 - ₹ 12,00,000

    Job DescriptionWe are seeking a dedicated Freelance Child Safety Specialist to conduct awareness programs on child safety. This role involves delivering engaging and age-appropriate sessions to students from standards 4th to 9th, emphasizing Good Touch and Bad Touch concepts.The ideal candidate will have a strong background in training, education, people...

  • Data Engineer Test Specialist

    1 day ago

    Thiruvananthapuram, Kerala, India beBeeDataEngineer Full time ₹ 12,00,000 - ₹ 20,00,000

    Data Engineer Test SpecialistJob Summary:•We are seeking a highly skilled Data Engineer Test Specialist to join our team. As a key member of the data engineering team, you will be responsible for designing and executing test cases to validate Databricks tables across various layers.Responsibilities:•Develop and execute comprehensive test plans to ensure...

  • Azure Data Factory Specialist

    24 hours ago

    Thiruvananthapuram, Kerala, India beBeeData Full time ₹ 15,00,000 - ₹ 20,10,000

    Job DescriptionThreatXIntel, a leading cybersecurity firm, is seeking an experienced Freelance Azure Data Factory Specialist to support data integration and ETL needs. The ideal consultant will have expertise in Azure ADF pipelines, data orchestration, and transformations.Key Responsibilities:Design, build, and maintain Azure Data Factory pipelines for ETL...

  • Senior Freelance Oracle SOA and HRMS Integration Specialist

    1 day ago

    Thiruvananthapuram, Kerala, India beBeeTechnical Full time ₹ 1,20,00,000 - ₹ 1,50,00,000

    **Job Title:** Freelance Oracle SOA and HRMS Technical SpecialistOur team is seeking an experienced freelance technical consultant to support integration and development needs in Oracle E-Business Suite.Key Responsibilities:Design, develop, and support Oracle SOA Suite integrations and EBS ISG Web Services.Deliver synchronous, asynchronous, and bulk...

  • Senior Cloud Data Engineering Specialist

    2 days ago

    Thiruvananthapuram, Kerala, India beBeeDataEngineering Full time ₹ 1,04,000 - ₹ 1,30,878

    Job Role Overview:As a senior data engineering specialist, you will design and develop scalable solutions using Azure Databricks and PySpark. This role involves collaboration with product owners to analyze requirements and create detailed interface designs.Key Responsibilities:Develop and optimize data pipelines using ADF, SQL, and NoSQL...

  • Senior Big Data Specialist

    1 day ago

    Thiruvananthapuram, Kerala, India beBeeDataEngineer Full time ₹ 1,50,00,000 - ₹ 2,00,00,000

    Job DescriptionOur organization seeks a skilled Freelance Data Engineer to design, build, and optimize large-scale data pipelines. The ideal candidate will collaborate with internal teams and clients to ensure robust, scalable, and high-performance data solutions.Key ResponsibilitiesDevelop ETL/ELT pipelines using PySpark, AWS, and Databricks.Perform data...

  • Large Scale Data Engineer

    3 days ago

    Thiruvananthapuram, Kerala, India beBeeData Full time ₹ 15,00,000 - ₹ 20,00,000

    Job Description:We are seeking a skilled Data Engineering Specialist to join our team. As a key member, you will be responsible for designing, building, and maintaining large-scale data processing systems using Azure technologies.You will design and develop scalable data pipelines, collaborate with cross-functional teams, and stay up-to-date with the latest...