Freelance Data Engineer – Python, SQL, AWS

2 weeks ago

Thoothukudi, Tamil Nadu, India ThreatXIntel Full time

Company Description

ThreatXIntel is a startup cyber security company that offers customized, affordable solutions to protect businesses and organizations from cyber threats. The company provides services like cloud security, web and mobile security testing, and DevSecOps. ThreatXIntel takes a proactive approach to security by continuously monitoring and testing clients' digital environments to identify vulnerabilities before they can be exploited.

Role Description

We are seeking an experienced Freelance Data Engineer with expertise in Python, SQL, Linux/Bash, PySpark, AWS, and Databricks to design, build, and optimize large-scale data pipelines. The consultant will collaborate with internal teams and clients to ensure robust, scalable, and high-performance data solutions.

Key Responsibilities

  • Design, develop, and maintain ETL/ELT pipelines using PySpark, AWS, and Databricks.
  • Perform data profiling, validation, and transformation using Python and SQL.
  • Optimize and monitor workflows for performance, scalability, and cost efficiency.
  • Build automation scripts using Linux and Bash for data pipeline orchestration.
  • Collaborate with analytics teams to surface trustworthy KPIs and metrics.
  • Troubleshoot and resolve data inconsistencies, configuration issues, and pipeline errors.
  • Work closely with cross-functional teams (analysts, product managers, engineers) to define and implement data requirements.
  • Ensure thorough documentation and knowledge sharing across stakeholders.

Qualifications

  • 5+ years of data engineering experience with a strong background in Python and SQL.
  • Proven expertise in PySpark, AWS services, and Databricks.
  • Proficiency in Linux/Bash scripting for automation and data operations.
  • Hands-on experience with ETL/ELT pipelines and large-scale integrations.
  • Familiarity with Agile and CI/CD practices.
  • Strong problem-solving and communication skills, with experience in client-facing roles.

  • Freelance Data Engineer – Scalable Solutions Specialist

    2 weeks ago

    Thoothukudi, Tamil Nadu, India beBeeData Full time ₹ 2,00,00,000 - ₹ 2,50,00,000

    Find a Fulfilling Career as a Freelance Data EngineerWe are seeking an experienced Freelance Data Engineer to design, build, and optimize large-scale data pipelines. The consultant will collaborate with internal teams and clients to ensure robust, scalable, and high-performance data solutions.Key Responsibilities:Develop ETL/ELT pipelines using PySpark, AWS,...

  • Data Engineering Expert with AWS

    2 weeks ago

    Thoothukudi, Tamil Nadu, India beBeeDataEngineer Full time ₹ 20,00,000 - ₹ 25,00,000

    Data Engineer with AWSOur organization's mission is to design, build, and optimize data warehousing and data lake solutions that power business analytics activities. This includes gathering and analyzing data from diverse enterprise systems and operational sources to identify trends, improve efficiency, and derive insights for strategic decision-making.We...

  • Highly Skilled Python Data Pipeline Specialist

    2 weeks ago

    Thoothukudi, Tamil Nadu, India beBeeDataEngineer Full time ₹ 12,00,000 - ₹ 20,00,000

    Job Description:We are seeking an experienced Freelance Data Engineer with strong expertise in Python and AWS services (S3, Glue, Step Functions, PySpark) to design, develop, and optimize data pipelines.The role requires proficiency in pytest for testing, Git/GitHub for version control, and clear technical documentation.

  • Experienced Data Engineer Wanted

    2 weeks ago

    Thoothukudi, Tamil Nadu, India beBeeDataEngineer Full time ₹ 20,00,000 - ₹ 25,00,000

    Job TitleWe are seeking a seasoned Data Engineer to join our team. As a key member of our data engineering team, you will play a pivotal role in designing, developing, and maintaining scalable data pipelines using PySpark.The ideal candidate will have strong experience in PySpark, with hands-on expertise in building efficient data pipelines. You will also be...

  • AWS Solutions Architect

    6 days ago

    Thoothukudi, Tamil Nadu, India beBeeData Full time ₹ 15,00,000 - ₹ 25,00,000

    AWS Data Architect JobWe are seeking a highly skilled data architect to join our team. The ideal candidate will have deep expertise in designing and implementing scalable data pipelines using Apache Spark, PySpark, SQL, and Python, along with hands-on experience in the AWS ecosystem.Key Responsibilities:Design, develop, and maintain robust ETL/ELT pipelines...

  • Freelance Healthcare Data Analyst

    2 weeks ago

    Thoothukudi, Tamil Nadu, India beBeeDataScientist Full time ₹ 10,00,000 - ₹ 25,00,000

    Job OpportunityWe are seeking an experienced Data Scientist to join our team in a Freelance capacity. This position involves working with large-scale healthcare claims and provider data to uncover insights, build predictive models, and support data-driven decision-making.The ideal candidate will have expertise in SQL, Python, and statistical methods, as well...

  • AWS Cloud Data Architect

    2 weeks ago

    Thoothukudi, Tamil Nadu, India beBeeData Full time ₹ 20,00,000 - ₹ 25,00,000

    Key Responsibilities:As a seasoned data engineer, you will be responsible for designing and developing end-to-end data pipelines on cloud infrastructure. The ideal candidate will have extensive experience with AWS services such as Amazon S3, AWS Glue, AWS Lambda, and Amazon Redshift.Design and develop scalable data architectures to support analytics and...

  • Chief Data Pipeline Engineer

    6 days ago

    Thoothukudi, Tamil Nadu, India beBeeDataEngineer Full time ₹ 1,50,00,000 - ₹ 2,00,00,000

    Job Description\As a seasoned data engineer, you will be responsible for designing, developing and maintaining large-scale data pipelines and ETL processes using AWS services. The ideal candidate will have a strong background in programming, particularly in Python, and experience with SQL databases.\The selected individual will work closely with...

  • Data Engineering Innovator

    7 days ago

    Thoothukudi, Tamil Nadu, India beBeeData Full time ₹ 2,00,00,000 - ₹ 2,50,00,000

    Unlock business value through data-driven insights and innovative digital solutions.About the RoleWe're seeking a highly skilled data engineer to join our team. This role is critical in empowering businesses with data-driven decision making.Key ResponsibilitiesCollaborate with stakeholders to understand data requirements and translate them into technical...

  • Freelance Data Modeler Expert

    2 weeks ago

    Thoothukudi, Tamil Nadu, India beBeeDataModeler Full time ₹ 1,20,00,000 - ₹ 1,40,00,000

    We're seeking a seasoned freelance data modeler to join our roster of experts. With a strong background in statistical modeling and analytics, you'll leverage your expertise in SAS and Python to drive business success.The ideal candidate should have at least 6+ years of experience in developing, validating, and maintaining complex statistical models using...