Freelance Data Engineer – Python

1 week ago

Ajmer, Rajasthan, India ThreatXIntel Full time

Company Description

ThreatXIntel is a startup cyber security company that focuses on protecting businesses and organizations from cyber threats. Our team offers various services, such as cloud security, web and mobile security testing, and DevSecOps. We aim to deliver customized and affordable solutions tailored to meet the specific needs of our clients, ensuring that businesses of all sizes have access to high-quality cyber security services.

Role Description

We are seeking an experienced Freelance Data Engineer with strong expertise in Python and AWS services (S3, Glue, Step Functions, PySpark) to design, develop, and optimize data pipelines. The role also requires proficiency in pytest for testing, Git/GitHub for version control, and clear technical documentation.

Key Responsibilities

  • Design and develop data pipelines using AWS Glue, PySpark, and Step Functions.
  • Implement ETL/ELT processes for ingesting, transforming, and delivering data from multiple sources.
  • Manage and optimize storage solutions with Amazon S3.
  • Write reusable and scalable Python code for data engineering workflows.
  • Implement unit and integration tests using pytest to ensure data quality and pipeline reliability.
  • Collaborate using Git/GitHub for version control, code reviews, and CI/CD integration.
  • Create clear technical documentation for pipelines, workflows, and design decisions.
  • Troubleshoot and resolve issues related to data pipelines and AWS services.

Qualifications

  • 5–10 years of data engineering experience, with at least 5 years in AWS ecosystem.
  • Strong coding skills in Python with experience in PySpark.
  • Hands-on experience with AWS Glue, Step Functions, and S3.
  • Proficiency in pytest for test automation.
  • Solid understanding of Git/GitHub workflows.
  • Strong communication skills with a focus on documentation and knowledge sharing.

  • Large Scale Data Engineer

    7 days ago

    Ajmer, Rajasthan, India beBeeDataEngineer Full time ₹ 1,50,00,000 - ₹ 2,00,00,000

    Data Engineer PositionThreatXIntel is a startup cyber security company that offers customized solutions to protect businesses from cyber threats. The company provides cloud security, web and mobile security testing, and DevSecOps services.We are seeking an experienced Freelance Data Engineer with expertise in Python, SQL, Linux/Bash, PySpark, AWS, and...

  • Data engineer

    1 week ago

    Ajmer, Rajasthan, India NP Group Full time

    Data Engineer - Python, Pyspark & TypescriptFully Remote Long Term Contract Rate: $14 - $17 per hour We have an immediate requirement for an experienced Data Engineer to join the global engineering team for a International Enterprise Organisation.You will bring Data Engineering expertise onto greenfield multi year project initiative.You should offer at least...

  • Python Software Engineer Position

    4 days ago

    Ajmer, Rajasthan, India beBeeSoftware Full time US$ 25,00,000 - US$ 42,90,000

    Job TitleA Python Test Engineer is required to join our organization. The successful candidate will be responsible for designing, developing, and maintaining robust automation frameworks using Python/Java and Selenium WebDriver.The ideal candidate will have hands-on experience in Python (mandatory) and working knowledge of Java. Solid experience with...

  • Data Engineer Leader

    24 hours ago

    Ajmer, Rajasthan, India beBeeDataEngineering Full time ₹ 1,20,00,000 - ₹ 2,00,00,000

    Unlock your potential as a senior data engineer.Shape the future of global communication with innovative solutions, driving positive impact through data-driven insights.Join our team of experts in design, development, and operations of data warehouses and data platform functions using Python programming.Key responsibilities include:Designing, developing, and...

  • Principal Data Engineer

    7 days ago

    Ajmer, Rajasthan, India beBeePython Full time ₹ 20,00,000 - ₹ 25,00,000

    Senior Data ArchitectWe are seeking an experienced Lead Python Developer to spearhead large-scale, high-availability systems that drive complex supply chain operations, order management, and personalized customer experiences.This is an exciting opportunity to leverage your technical expertise in designing, developing, and automating scalable data pipelines...

  • Senior Cloud Data Engineer

    1 day ago

    Ajmer, Rajasthan, India beBeeData Full time US$ 90,000 - US$ 1,25,000

    Job Title:Senior Cloud Data EngineerJob Description: Our organization seeks a skilled Senior Cloud Data Engineer to design, develop, and maintain large-scale data processing systems on Google Cloud Platform (GCP). This is an excellent opportunity for a motivated professional with experience in cloud computing, data engineering, and GCP services.The ideal...

  • Data Engineer Professional

    7 days ago

    Ajmer, Rajasthan, India beBeeDataDriven Full time ₹ 35,00,000 - ₹ 50,00,000

    Job Opportunity: Data EngineerA high-performing data engineer is needed to work on advanced data processing projects. The ideal candidate will have extensive experience in big data technologies and hands-on expertise in Python, PySpark, and AWS.The successful candidate will possess a strong background in data analysis and processing, with experience in...

  • Flexible Freelance Backend Developer

    1 week ago

    Ajmer, Rajasthan, India beBeeBackend Full time ₹ 20,00,000 - ₹ 25,00,000

    **Job Overview**We are seeking a skilled and motivated freelance backend developer with 6+ years of experience.This opportunity allows you to work part-time alongside your day job, collaborating with top developers in the industry. You will report to experienced professionals with 10+ years of development expertise.Key Responsibilities:Design, develop, and...

  • Innovative Data Solutions Engineer

    4 days ago

    Ajmer, Rajasthan, India beBeeDataEngineer Full time ₹ 20,00,000 - ₹ 25,00,000

    Position OverviewWe are looking for a highly skilled and proactive Data Engineer to join our team. As a Data Engineer, you will be responsible for designing and developing innovative data solutions that drive business value.Job DescriptionDesign and develop high-quality data solutions using Python, JVM, and Shell Scripting.Collaborate with cross-functional...

  • Freelance Access Control Specialist

    1 week ago

    Ajmer, Rajasthan, India beBeeAccess Full time ₹ 1,00,00,000 - ₹ 2,50,00,000

    Job Title: Freelance Access Control SpecialistWe are seeking a highly skilled Freelance Access Control Specialist with expertise in authorization platforms, data governance, and fine-grained access control. This role involves designing and implementing policies that safeguard sensitive business and customer data across multiple...