Senior Big Data Specialist

3 days ago


Thiruvananthapuram, Kerala, India beBeeDataEngineer Full time ₹ 1,50,00,000 - ₹ 2,00,00,000

Job Description

Our organization seeks a skilled Freelance Data Engineer to design, build, and optimize large-scale data pipelines. The ideal candidate will collaborate with internal teams and clients to ensure robust, scalable, and high-performance data solutions.

Key Responsibilities

  • Develop ETL/ELT pipelines using PySpark, AWS, and Databricks.
  • Perform data profiling, validation, and transformation using Python and SQL.
  • Optimize and monitor workflows for performance, scalability, and cost efficiency.
  • Build automation scripts using Linux and Bash for data pipeline orchestration.
  • Collaborate with analytics teams to surface trustworthy KPIs and metrics.
  • Troubleshoot and resolve data inconsistencies, configuration issues, and pipeline errors.
  • Work closely with cross-functional teams (analysts, product managers, engineers) to define and implement data requirements.

Requirements

  • 5+ years of data engineering experience with a strong background in Python and SQL.
  • Proven expertise in PySpark, AWS services, and Databricks.
  • Proficiency in Linux/Bash scripting for automation and data operations.
  • Hands-on experience with ETL/ELT pipelines and large-scale integrations.
  • Familiarity with Agile and CI/CD practices.
  • Strong problem-solving and communication skills, with experience in client-facing roles.

  • Big Data Specialist

    2 days ago


    Thiruvananthapuram, Kerala, India beBeeDataEngineer Full time US$ 5,00,000 - US$ 10,00,000

    As a Big Data Engineer, you will be responsible for designing and developing large-scale data processing systems. This role requires expertise in handling complex data pipelines and ensuring high-performance data analytics.Key Responsibilities:


  • Thiruvananthapuram, Kerala, India beBeeDataScientist Full time ₹ 1,50,00,000 - ₹ 2,50,00,000

    Job Title: Big Data ProfessionalWe are seeking an experienced Big Data Professional to join our team. The ideal candidate will have a strong background in big data analytics, including data ingestion, processing, and visualization.Key Responsibilities:Design and implement data ingestion pipelines from disparate sources onto a big data platform.Develop and...


  • Thiruvananthapuram, Kerala, India beBeeDataEngineer Full time ₹ 20,00,000 - ₹ 30,00,000

    Job Title:Data Engineer RoleWe are seeking a skilled Data Engineer to join our dynamic data team. As a key member of our data infrastructure team, you will design, develop and maintain robust data pipelines, data warehouses and analytics platforms that serve as the backbone of our digital marketing product development.The ideal candidate will have experience...


  • Thiruvananthapuram, Kerala, India beBeeData Full time ₹ 20,00,000 - ₹ 22,50,000

    Seeking a visionary leader to spearhead the development of scalable data pipelines and analytics platforms on Microsoft Azure and Databricks.The ideal candidate will have in-depth expertise in Big Data platforms, drive the design and delivery of end-to-end data solutions, collaborate with cross-functional teams, and promote best practices in data...


  • Thiruvananthapuram, Kerala, India beBeeDataEngineer Full time ₹ 1,00,00,000 - ₹ 1,50,00,000

    Big Data ExpertWe're seeking a seasoned Big Data Expert to drive the design, development, and optimization of large-scale data pipelines and distributed systems.Develop scalable big data architectures using cloud-based solutions.Collaborate with cross-functional teams to deliver high-quality code through code reviews, performance tuning, and best...


  • Thiruvananthapuram, Kerala, India beBeeData Full time ₹ 15,00,000 - ₹ 25,00,000

    Job Opportunity: Data Solutions SpecialistThis position involves developing and maintaining scalable data pipelines to support growing data volumes and complexity.Data solutions specialists will collaborate with analytics and business teams to improve data models for business intelligence tools, enhancing data accessibility and driving data-driven decision...


  • Thiruvananthapuram, Kerala, India beBeeData Full time ₹ 1,50,00,000 - ₹ 2,00,00,000

    OverviewWe are seeking a skilled Senior Data Engineer to help implement an application for a large retailer. The ideal candidate will have hands-on coding expertise in Python and PySpark, as well as strong experience with Telemetry, Big Data, and backend engineering.Required Skills & Qualifications5+ years of experience as a Data EngineerExpertise in Python,...


  • Thiruvananthapuram, Kerala, India beBeeDataEngineer Full time ₹ 15,00,000 - ₹ 25,00,000

    **Job Description:**We are seeking a skilled Data Engineer to join our team and contribute to the development of data-driven solutions using Azure Databricks.The ideal candidate will have experience working with big data technologies, including Apache Spark and Python. They should be able to design, develop, and deploy scalable data pipelines, as well as...


  • Thiruvananthapuram, Kerala, India beBeeDataIntegration Full time ₹ 20,00,000 - ₹ 25,00,000

    Job OpportunityWe are seeking a skilled Data Integration Specialist to join our team. As a Data Integration Specialist, you will play a key role in designing and developing scalable ETL workflows using Informatica BDM/DEI.The ideal candidate will have experience working with big data platforms, applying strong data warehousing concepts to ensure efficient...


  • Thiruvananthapuram, Kerala, India beBeeDataEngineer Full time ₹ 1,71,52,000 - ₹ 2,14,40,000

    Senior Data Engineer PositionOur company is seeking a highly skilled Senior Data Engineer to lead our data engineering efforts. In this role, you will be responsible for designing, developing, and maintaining large-scale data systems that support business intelligence and analytics.Lead the design and implementation of data pipelines, ETL processes, and data...