Freelance AWS Data Engineer

3 weeks ago

India ThreatXIntel Full time
Job Description

Company Description

ThreatXIntel is a startup cyber security company focused on protecting businesses and organizations from cyber threats. Our services include cloud security, web and mobile security testing, cloud security assessment, and DevSecOps. We provide customized, affordable solutions to meet the specific needs of our clients, offering proactive monitoring to identify vulnerabilities before they can be exploited.

Role Description

This is a part-time remote role for a Freelance AWS Data Engineer / Python Developer at ThreatXIntel. The role involves tasks such as data engineering, data modeling, ETL (Extract Transform Load), data warehousing, and data analytics.

Technical Skill Set Required

- AWS Glue ETL job development, Glue Catalog, Crawlers, job optimization.
- AWS Lambda Serverless functions for automation and orchestration.
- AWS Step Functions Workflow design, state machine orchestration, error handling.
- PySpark Data processing, transformations, schema handling, performance tuning.
- Pytest Unit testing, integration testing for data pipelines and automation scripts.
- Python Strong coding and debugging skills, reusable function development.
- AWS Core Services S3, IAM, CloudWatch for monitoring, logging, and access control.
- Documentation Ability to prepare clear and concise technical documentation for pipelines, workflows, and processes.

Role Expectations

- Build and maintain data pipelines using AWS Glue & PySpark.
- Create serverless automation with Lambda and Step Functions.
- Ensure pipelines are tested with Pytest and optimized for performance.
- Develop robust error handling and logging mechanisms.
- Deliver documentation covering architecture, workflows, and deployment.

  • Freelance data visualization engineer

    6 days ago

    India Senovo IT Ltd Full time

    *** Freelance Opportunity | Power BI Data Engineer (India – Remote) *** We are seeking a Freelance Data Visualisation Engineer (India-based) to join our team and design impactful, engaging dashboards using Power BI . This is a contract position , perfect for professionals looking for project-based work with flexibility. Contract Details: Start...

  • Freelance Data Visualization Engineer

    6 days ago

    India Senovo IT Ltd Full time

    *** Freelance Opportunity | Power BI Data Engineer (India – Remote) *** We are seeking a Freelance Data Visualisation Engineer (India-based) to join our team and design impactful, engaging dashboards using Power BI. This is a contract position, perfect for professionals looking for project-based work with flexibility. 📅 Contract Details: - Start...

  • Freelance Data Visualization Engineer

    6 days ago

    India Senovo IT Ltd Full time

    *** Freelance Opportunity | Power BI Data Engineer (India – Remote) *** We are seeking a Freelance Data Visualisation Engineer (India-based) to join our team and design impactful, engaging dashboards using Power BI . This is a contract position , perfect for professionals looking for project-based work with flexibility. Contract Details: Start date: ...

  • Freelance Data Visualization Engineer

    7 days ago

    India Senovo IT Ltd Full time

    *** Freelance Opportunity | Power BI Data Engineer (India – Remote) ***We are seeking a Freelance Data Visualisation Engineer (India-based) to join our team and design impactful, engaging dashboards using Power BI. This is a contract position, perfect for professionals looking for project-based work with flexibility.📅 Contract Details:Start date: 15...

  • Freelance Data Visualization Engineer

    5 days ago

    India Senovo IT Ltd Full time

    *** Freelance Opportunity | Power BI Data Engineer (India – Remote) *** We are seeking a Freelance Data Visualisation Engineer (India-based) to join our team and design impactful, engaging dashboards using Power BI . This is a contract position , perfect for professionals looking for project-based work with flexibility. Contract Details: ...

  • Aws Data Engineer

    1 week ago

    India Adastra Corp Full time

    As an AWS Data Engineer, you will be responsible for: Technical requirements gathering and development of functional specificationsCommunicating with technical contacts regarding incoming and outgoing data interfacesImplementing the data pipelinesDevelop and implement best practices for AWS applications: Data Integration, Analytics & ReportingCreate ETL jobs...

  • AWS Data Engineer

    5 hours ago

    Chennai, India Crescent Techservices Full time

    Job Description Role: AWS Data Engineer Type: 6-12 month contract Location: Chennai, Tamil Nadu (WFO) Experience: 6-8 Years Requirements: - Proficiency in Python and PySpark: Strong experience writing robust Python code and utilizing PySpark for distributed data processing, transformation, and working with large datasets. - AWS Data Engineering...

  • Aws Data Engineer – Oil

    3 weeks ago

    India DigiHelic Solutions Pvt. Ltd. Full time

    Job Title: AWS Data Engineer – Oil & Gas Domain Location: Offshore/ REMOTEExperience: 5+ years Experienced AWS Data Engineer with Oil & Gas industry expertise to design, build, and optimize scalable data pipelines and cloud solutions.The ideal candidate will have strong experience in AWS cloud services, data engineering and knowledge of Oil & Gas upstream,...

  • Senior AWS Data Engineer

    3 weeks ago

    India CYAN360 Full time

    Position: Senior AWS Data Engineer Location: Remote Salary: Open Work Timings: 2:30 PM to 11:30 PM IST *** Need someone who can join immediately or in 15 days*** Responsibilities: Design, develop, and deploy end-to-end data pipelines on AWS cloud infrastructure using services such as Amazon S3, AWS Glue, AWS Lambda, Amazon Redshift, etc. Implement data...

  • Senior AWS Data Engineer

    2 weeks ago

    India CYAN360 Full time

    Position: Senior AWS Data Engineer Location: Remote Salary: Open Work Timings: 2:30 PM to 11:30 PM IST *** Need someone who can join immediately or in 15 days*** Responsibilities: Design, develop, and deploy end-to-end data pipelines on AWS cloud infrastructure using services such as Amazon S3, AWS Glue, AWS Lambda, Amazon Redshift, etc. ...