Freelance Data Expert – Big Data Analytics Specialist

21 hours ago

Kannur, Kerala, India beBeeDataEngineer Full time ₹ 15,00,000 - ₹ 25,00,000

ThreatXIntel is a startup cyber security company that offers customized solutions to protect businesses from cyber threats.

We are seeking an experienced Freelance Data Engineer with expertise in data pipelines design and development.

  • Design and develop ETL/ELT pipelines using PySpark, AWS, and Databricks for large-scale data integration.
  • Perform data profiling, validation, and transformation using Python and SQL.
  • Optimize and monitor workflows for performance, scalability, and cost efficiency.

Data engineers will be responsible for designing, developing, and maintaining large-scale data processing systems. They will need to have strong programming skills, especially in Python and SQL, as well as experience with big data technologies such as PySpark and Databricks. Additionally, they should have knowledge of cloud-based services like AWS and proficiency in Linux/Bash scripting for automation and data operations.

Key Qualifications
  • 5+ years of experience in data engineering with a strong background in Python and SQL
  • Proven expertise in PySpark, AWS services, and Databricks
  • Proficiency in Linux/Bash scripting for automation and data operations
  • Hands-on experience with ETL/ETL pipelines and large-scale integrations

  • Big Data Expert

    2 days ago

    Kannur, Kerala, India beBeeBigData Full time ₹ 18,00,000 - ₹ 30,00,000

    We're seeking a seasoned Data Scientist to spearhead our Big Data initiatives. As a key member of our team, you will have the opportunity to work with cutting-edge technologies and drive business growth through data-driven insights.About the Role:Design, develop, and implement scalable Big Data solutions using PySpark and Hive.Collaborate with...

  • Big Data Specialized Solutions Expert

    1 day ago

    Kannur, Kerala, India beBeeData Full time ₹ 15,00,000 - ₹ 25,00,000

    We are seeking a seasoned Data Specialist to lead our Big Data endeavors.Our ideal candidate will have extensive experience in handling large-scale data platforms and be proficient in leveraging tools such as PySpark, Hive, and Spark. Additionally, they should possess knowledge of HBase and DQ tool for efficient data ingestion and processing.The successful...

  • Big Data Engineer

    2 weeks ago

    Kannur, Kerala, India Nice Software Solutions Pvt. Ltd. Full time

    Big Data Engineer (PySpark)Location: Pune/Nagpur (WFO)Experience: 8 - 12 YearsEmployment Type: Full-timeJob OverviewWe are looking for an experienced Big Data Engineer with strong expertise in PySpark and Big Data ecosystems. The ideal candidate will be responsible for designing, developing, and optimizing scalable data pipelines while ensuring high...

  • Big Data Engineer Role

    1 day ago

    Kannur, Kerala, India beBeeDataEngineer Full time ₹ 25,00,000 - ₹ 35,00,000

    Senior Data Engineer - Big Data and AnalyticsWe are seeking a highly skilled Senior Data Engineer to lead the development of big data and analytics environments on Databricks.Main Responsibilities:Design, build, and maintain complex technical architectures on Databricks, ensuring scalability, reliability, and performance.Develop and implement efficient data...

  • Data Analytics Specialist

    5 days ago

    Kannur, Kerala, India beBeeData Full time ₹ 15,11,000 - ₹ 25,14,000

    Data Analytics SpecialistOur organization is seeking a highly skilled Data Analytics Specialist to join our team. The primary responsibilities of this role will include analyzing the current data environment, identifying and documenting inactive or redundant datasets, defining and implementing governance structures for dataset creation and ownership.Analyze...

  • Data Analytics Specialist

    4 days ago

    Kannur, Kerala, India beBeeData Full time ₹ 15,00,000 - ₹ 20,00,000

    Job Title: Data Analytics Specialist

  • GCP Data Analytics Expert

    1 day ago

    Kannur, Kerala, India beBeeDataEngineer Full time ₹ 80,00,000 - ₹ 2,00,00,000

    As a seasoned GCP Data Engineer, you will be responsible for architecting and implementing scalable data pipelines to drive business decision-making through advanced analytics.Key ResponsibilitiesCollaborate with data science teams to design and implement complex algorithms and analytical solutions.Utilize agile development practices to enhance back-end...

  • Big Data Architect

    3 days ago

    Kannur, Kerala, India beBeeDataEngineer Full time ₹ 1,50,00,000 - ₹ 2,00,00,000

    Job Opportunity: Big Data ArchitectThe Senior Data Engineer position involves designing, building, and maintaining large-scale data architectures. This includes data lakes, lakehouses, and warehouses.Key Responsibilities:Create scalable real-time and batch processing workflows using PySpark and Apache Spark.Cleanse, transform, deduplicate, normalize, encode,...

  • Senior Big Data Specialist

    2 days ago

    Kannur, Kerala, India beBeeDataEngineer Full time ₹ 15,00,000 - ₹ 20,00,000

    Job TitleA Data Engineer with expertise in Google Cloud Platform (GCP) and AtScale is required to design, build, and optimize scalable data solutions.The ideal candidate will have hands-on experience in developing robust data pipelines, implementing efficient data models, and ensuring performance optimization for enterprise-level analytics.Key...

  • Experienced Big Data Solutions Architect

    4 days ago

    Kannur, Kerala, India beBeeDataEngineer Full time ₹ 1,80,00,000 - ₹ 2,20,00,000

    Our client seeks a highly skilled Senior Data Engineer to join their team. In this role, you will be responsible for designing, constructing, and optimizing large-scale data processing systems that enable advanced analytics and business intelligence.You will collaborate closely with data scientists, analysts, and other engineers to ensure the availability,...