Freelance AWS Data Engineer

2 days ago

India ThreatXIntel Full time
Job Description

Company Description

ThreatXIntel is a startup cyber security company focused on protecting businesses and organizations from cyber threats. Our services include cloud security, web and mobile security testing, cloud security assessment, and DevSecOps. We provide customized, affordable solutions to meet the specific needs of our clients, offering proactive monitoring to identify vulnerabilities before they can be exploited.

Role Description

This is a part-time remote role for a Freelance AWS Data Engineer / Python Developer at ThreatXIntel. The role involves tasks such as data engineering, data modeling, ETL (Extract Transform Load), data warehousing, and data analytics.

Technical Skill Set Required

- AWS Glue ETL job development, Glue Catalog, Crawlers, job optimization.
- AWS Lambda Serverless functions for automation and orchestration.
- AWS Step Functions Workflow design, state machine orchestration, error handling.
- PySpark Data processing, transformations, schema handling, performance tuning.
- Pytest Unit testing, integration testing for data pipelines and automation scripts.
- Python Strong coding and debugging skills, reusable function development.
- AWS Core Services S3, IAM, CloudWatch for monitoring, logging, and access control.
- Documentation Ability to prepare clear and concise technical documentation for pipelines, workflows, and processes.

Role Expectations

- Build and maintain data pipelines using AWS Glue & PySpark.
- Create serverless automation with Lambda and Step Functions.
- Ensure pipelines are tested with Pytest and optimized for performance.
- Develop robust error handling and logging mechanisms.
- Deliver documentation covering architecture, workflows, and deployment.

  • Freelance Data Engineer

    4 weeks ago

    India Leading MNC Full time

    Looking for a Freelance Data Engineer to join a team of rockstar developers. The candidate should have a minimum of 5+ yrs. of experience.There are multiple openings. If you're looking for freelance/ part time opportunity (along with your day job) & a chance to work with the top 0.1% of developers in the industry, this one is for you You will report into...

  • Freelance Data Engineer

    4 weeks ago

    India Leading MNC Full time

    Looking for a Freelance Data Engineer to join a team of rockstar developers. The candidate should have a minimum of 5+ yrs. of experience.There are multiple openings. If you're looking for freelance/ part time opportunity (along with your day job) & a chance to work with the top 0.1% of developers in the industry, this one is for you You will report into...

  • AWS Data Engineer

    3 weeks ago

    India Qubryx Full time

    AWS Data EngineerLocation: Remote (India)Experience: 3+ YearsEmployment Type: Full-TimeAbout the Role:We are seeking a talented AWS Data Engineer with at least 3 years of hands-on experience in building andmanaging data pipelines using AWS services. This role involves working with large-scale data, integratingmultiple data sources (including sensor/IoT...

  • AWS Data Engineer

    3 weeks ago

    India Qubryx Full time

    AWS Data EngineerLocation: Remote (India)Experience: 3+ YearsEmployment Type: Full-TimeAbout the Role:We are seeking a talented AWS Data Engineer with at least 3 years of hands-on experience in building andmanaging data pipelines using AWS services. This role involves working with large-scale data, integratingmultiple data sources (including sensor/IoT...

  • Senior Data Engineer

    3 weeks ago

    India Aptus Data Labs Full time

    Job Title: Senior Data EngineerLocation: RemoteExperience: 4+Employment Type: Full-TimeNotice- Looking for immediate joiners or who can join within 15-20 days.About the RoleAptus Data Labs is looking for a talented and proactive Senior Data Engineer to help build the backbone of our enterprise data and AI initiatives. You'll work on modern data lake...

  • Freelance IOT Engineer

    4 weeks ago

    India Leading MNC Full time

    Looking for a Freelance IOT Engineer to join a team of rockstar developers. The candidate should have a minimum of 5+ yrs. of experience .There are multiple openings. If you're looking for freelance/ part time opportunity (along with your day job) & a chance to work with the top 0.1% of developers in the industry, this one is for you You will report into...

  • Freelance Data and AI Trainer

    4 weeks ago

    India Incubity Full time

    Incubity is a learning and talent-building initiative under Ambilio Technologies, focused on empowering enterprises with cutting-edge skills in artificial intelligence, data, and emerging technologies. We work with top industry practitioners to design and deliver impactful, hands-on corporate training programs.Role OverviewWe are seeking an experienced...

  • AWS Engineer

    3 weeks ago

    India Cloud202 Full time

    Job Title: AWS EngineerLocation: RemoteJob Type: Full-TimeAbout Us: Cloud202 Limited is a leading technology consulting company dedicated to helping businesses transform and innovate through cutting-edge technology solutions. We specialize in cloud migration, AI/ML, and application development, providing our clients with the expertise they need to stay ahead...

  • AWS Cloud Engineer

    2 days ago

    India beBeeCloud Full time ₹ 8,00,000 - ₹ 15,00,000

    AWS Cloud EngineerThis role involves delivering high-quality technical solutions using AWS services. Key Responsibilities:Advanced Troubleshooting: Investigate and resolve complex issues related to networking, security, and automation.Analyze and Fix Performance Issues: Identify and resolve performance bottlenecks on AWS infrastructure.Automation and...

  • Freelance Data Researcher

    2 days ago

    India beBeeDataInsight Full time ₹ 5,00,000 - ₹ 10,00,000

    Job Title: Data Insight SpecialistAre you a detail-oriented individual with a passion for research and a good understanding of national and local geography? This freelance opportunity allows you to work at your own pace and from the comfort of your own home.About the JobIn this role, you will be working on a project aimed at enhancing the content and quality...