Freelance Big Data Specialist

6 days ago

Kurnool, Andhra Pradesh, India beBeeDataEngineer Full time ₹ 15,00,000 - ₹ 20,00,000

ThreatXIntel, a cyber security company, offers customized solutions to protect businesses from cyber threats.

The company provides cloud security, web and mobile security testing, and DevSecOps services. We are seeking an experienced Freelance Data Engineer to design, build, and optimize large-scale data pipelines using Python, SQL, Linux/Bash, PySpark, AWS, and Databricks.

Key Responsibilities:
  • Design and Develop ETL/ELT Pipelines: Utilize PySpark, AWS, and Databricks to create efficient and scalable data pipelines that meet the needs of our clients.
  • Perform Data Profiling and Validation: Use Python and SQL to analyze and refine large datasets, ensuring accuracy and quality.
  • Optimize and Monitor Workflows: Enhance performance, scalability, and cost efficiency by streamlining data processing workflows.
  • Build Automation Scripts: Leverage Linux and Bash scripting to automate data pipeline orchestration and reduce manual intervention.
  • Collaborate with Analytics Teams: Work closely with analytics teams to surface actionable insights and key performance indicators (KPIs).
  • Troubleshoot and Resolve Issues: Identify and resolve data inconsistencies, configuration errors, and pipeline failures in a timely manner.
Qualifications:
  • 5+ years of experience in data engineering with a strong background in Python and SQL.
  • Proven expertise in PySpark, AWS services, and Databricks.
  • Proficiency in Linux/Bash scripting for automation and data operations.
  • Hands-on experience with ETL/ELT pipelines and large-scale integrations.
  • Familiarity with Agile and CI/CD practices.
  • Strong problem-solving and communication skills, with experience in client-facing roles.

This is a fantastic opportunity to join our team as a Freelance Data Engineer and contribute your expertise to help us achieve our goals.

  • Strategic Big Data Solutions Specialist

    6 days ago

    Kurnool, Andhra Pradesh, India beBeeData Full time ₹ 15,00,000 - ₹ 25,00,000

    Big Data Engineer PositionWe are seeking a highly skilled Big Data Engineer to fill a key role in our organization.Design and implement large-scale big data solutions using technologies such as PySpark, Hive, Spark, HBase, and DQ tools to drive business growth and success.Develop and maintain scalable data pipelines to ingest data from disparate sources onto...

  • Big Data Cloud Solutions Specialist

    2 days ago

    Kurnool, Andhra Pradesh, India beBeeData Full time ₹ 15,00,000 - ₹ 20,00,000

    Cloud Architect - Big Data ExpertAt the heart of our organization lies a pivotal role that demands expertise in managing complex data environments. As a Cloud Architect with specialization in Big Data, you will be responsible for designing and implementing cutting-edge cloud solutions.Key Responsibilities:Develop hybrid cloud architectures to migrate...

  • Lead Big Data Analyst

    6 days ago

    Kurnool, Andhra Pradesh, India beBeeDataScientist Full time ₹ 1,00,00,000 - ₹ 2,00,00,000

    Data Scientist RoleWe are seeking a highly skilled Data Scientist to join our team. As a Data Scientist, you will be working with large datasets to gain valuable insights and drive business growth through data-driven decisions.Key Responsibilities:Create and implement complex data models to process and analyze big dataDesign and optimize efficient data...

  • Big Data Systems Developer

    2 days ago

    Kurnool, Andhra Pradesh, India beBeeData Full time ₹ 1,50,00,000 - ₹ 2,50,00,000

    Job OverviewWe are seeking a Data Systems Developer to design, build, and maintain large-scale data processing systems using Big Data technologies.Key Responsibilities:Design and develop scalable data processing systems.Collaborate with cross-functional teams to identify business requirements and design data pipelines.Analyze complex data sets to inform...

  • Senior Big Data Developer

    2 days ago

    Kurnool, Andhra Pradesh, India beBeeDataEngineer Full time ₹ 1,50,00,000 - ₹ 2,50,00,000

    Big Data Engineer WantedWe are seeking a skilled Data Engineer to lead our distributed data systems. The successful candidate will be responsible for designing, executing and managing large and complex distributed data systems.The ideal candidate will have experience in big data technologies (Apache Hadoop) and relational databases (MySQL/PostgreSQL)....

  • Data Engineering Specialist

    1 week ago

    Kurnool, Andhra Pradesh, India beBeeIngestion Full time US$ 1,00,000 - US$ 1,20,000

    Job Title: Data Engineering SpecialistWe require a skilled specialist with expertise in big data processing, cloud computing and data integration to work on data ingestion processes.This role involves the design, development, testing and deployment of data pipelines, automation tools and infrastructure management solutions for scalable and efficient data...

  • Senior Big Data Specialist

    4 days ago

    Kurnool, Andhra Pradesh, India beBeeDataEngineer Full time ₹ 20,00,000 - ₹ 30,00,000

    Job Title:Data EngineerWe are seeking a highly skilled Data Engineer to join our team. As a key member of our data engineering team, you will be responsible for designing, developing, and maintaining large-scale data pipelines that enable our company to make data-driven decisions.About the Role:Design and develop scalable data pipelines using Hadoop, Spark,...

  • Freelance Data Governance Specialist

    1 week ago

    Kurnool, Andhra Pradesh, India beBeeAccess Full time ₹ 80,00,000 - ₹ 2,00,00,000

    We are seeking an accomplished Freelance Access Control Engineer to join our team.

  • Senior Big Data Expert

    7 days ago

    Kurnool, Andhra Pradesh, India beBeeData Full time ₹ 15,00,000 - ₹ 25,00,000

    Job Title: Senior Big Data ExpertAs a senior big data expert, you will be responsible for designing and implementing large-scale data systems.Key Responsibilities:Design and implement high-performance data warehouses using Trino (PrestoSQL).Develop and maintain complex SQL queries to optimize database performance.Collaborate with cross-functional teams to...

  • Big Data Innovator

    17 hours ago

    Kurnool, Andhra Pradesh, India beBeeDataEngineer Full time ₹ 2,00,00,000 - ₹ 2,50,00,000

    Job Title: Data EngineerThe ideal candidate for this position is a skilled professional with expertise in data engineering and a strong passion for delivering high-quality solutions. Key Responsibilities:We are looking for an individual who can interact directly with customers, requiring excellent communication skills.A strong background in Azure/AWS...