Advanced Data Pipelining Expert

2 days ago

Thiruvananthapuram, Kerala, India beBeeDataEngineer Full time ₹ 15,00,000 - ₹ 19,00,000
Senior Data Engineer Opportunity

Airflow is a scalable data processing system that enables efficient and reliable data movement, transformation, and analysis.

This role requires a Senior Data Engineer to design, develop, and maintain large-scale Airflow pipelines that integrate with various data sources, such as Snowflake.

The ideal candidate will have expertise in Python programming language and experience with Airflow's DAGs, operators, and sensors.

Additionally, the successful applicant should be familiar with data engineering concepts, including data warehousing, ETL processes, and data quality assurance.

Responsibilities:

  • Design and implement complex Airflow pipelines to extract, transform, and load (ETL) data from various sources
  • Develop and maintain high-quality code using Python and Airflow's APIs
  • Collaborate with cross-functional teams to identify business requirements and prioritize projects
  • Ensure data integrity, security, and compliance with organizational standards
  • Provide technical guidance and support to junior engineers and stakeholders

Requirements:

  • Bachelor's degree in Computer Science, Engineering, or related field
  • Minimum 5 years of experience in data engineering, with a focus on Airflow and Python
  • Strong understanding of data modeling, database management, and data visualization
  • Experience with cloud-based technologies, such as AWS or GCP
  • Excellent communication and collaboration skills

Benefits:

  • Competitive salary and bonus structure
  • Opportunities for professional growth and development
  • Collaborative and dynamic work environment
  • Recognition and rewards for outstanding performance

  • Expert Data Pipeline Specialist

    2 days ago

    Thiruvananthapuram, Kerala, India beBeeDataEngineering Full time ₹ 15,00,000 - ₹ 25,00,000

    Job Title:GCP Data EngineerDesign and implement scalable data engineering solutions while working on advanced cloud-based projects.Key Responsibilities:Design, build, and optimize data pipelines using BigQuery, Dataflow, DataProc, and Cloud Composer.Implement Big Data Analytics solutions leveraging Hadoop, Hive, and Spark on GCP.Write efficient queries and...

  • Enterprise Data Pipeline Architect

    1 week ago

    Thiruvananthapuram, Kerala, India beBeeDataEngineer Full time ₹ 15,00,000 - ₹ 25,00,000

    Job DescriptionWe are seeking a highly skilled Snowflake Developer and Infrastructure Integration Expert to lead full lifecycle implementations.As a seasoned professional in data engineering, infrastructure, and DevOps, you will be responsible for secure platform setup, cloud integration, and high-performance data pipeline development.This is an exciting...

  • Data Pipeline Architect

    2 days ago

    Thiruvananthapuram, Kerala, India beBeeDataPipeline Full time ₹ 20,00,000 - ₹ 30,00,000

    Job Opportunity: Data Pipeline ArchitectKey Responsibilities:Design and implement data pipelines using advanced technologies to drive business growth.Collaborate with cross-functional teams to develop and maintain large-scale data architectures.Develop and execute data warehousing strategies to improve data accessibility and insights.Ensure seamless...

  • Data Engineer

    6 days ago

    Thiruvananthapuram, Kerala, India beBeeDataEngineer Full time ₹ 20,00,000 - ₹ 35,00,000

    Job Opportunity for Data EngineerAbout the Role:We are seeking a highly skilled Data Engineer to join our team.The ideal candidate will have strong experience in data engineering and expertise in designing, developing, and maintaining scalable data pipelines using technologies like PySpark.Key Responsibilities include:Designing, developing, and maintaining...

  • Data Pipeline Developer

    6 days ago

    Thiruvananthapuram, Kerala, India beBeeDataPipeline Full time ₹ 12,00,000 - ₹ 20,10,000

    Job Overview:We are seeking a highly skilled Data Pipeline Developer to join our team.The ideal candidate will have experience in designing, developing, and maintaining large-scale data pipelines using Python and AWS technologies.Main Responsibilities:Design and develop scalable data pipelines that integrate with various AWS services (S3, Redshift, Lambda,...

  • Data Pipeline Architect

    7 days ago

    Thiruvananthapuram, Kerala, India beBeeData Full time ₹ 1,50,00,000 - ₹ 2,50,00,000

    We are seeking a skilled and detail-oriented Data Engineer to design, build, and manage scalable data pipelines and enterprise data solutions.This role will be critical in supporting our analytics, reporting, and data science initiatives by delivering high-quality, reliable, and performant data systems.The ideal candidate will have expertise in Azure, SQL...

  • Data Pipeline Specialist

    1 week ago

    Thiruvananthapuram, Kerala, India beBeeDataEngineer Full time ₹ 50,00,000 - ₹ 80,00,000

    About the RoleWe are seeking an experienced Data Engineer to join our team. The successful candidate will be responsible for designing, building and maintaining high-performance data pipelines that process large volumes of data.This role is critical in ensuring our data infrastructure can handle increasing volumes of data while maintaining exceptional...

  • Data Pipeline Specialist

    6 days ago

    Thiruvananthapuram, Kerala, India beBeeETL Full time ₹ 1,04,000 - ₹ 1,30,878

    Job DescriptionAs a skilled ETL testing professional, you will play a crucial role in ensuring the accuracy and reliability of our data pipelines. You will work closely with developers, business analysts, and business users to identify and resolve issues related to data transformation, procedures, and triggers."],

  • Director of Advanced Intelligence Solutions

    1 week ago

    Thiruvananthapuram, Kerala, India beBeeArtificialIntelligence Full time ₹ 2,00,00,000 - ₹ 2,40,00,000

    We are seeking a visionary leader to spearhead the development and implementation of Large Language Models.With 16+ years of experience in AI/ML, you will be responsible for designing and overseeing the overall architecture for our LLMs, ensuring alignment with business objectives. Your technical expertise will drive the selection of technology stacks,...

  • Advanced Data Analyst Position

    7 days ago

    Thiruvananthapuram, Kerala, India beBeeDataDriven Full time ₹ 1,00,00,000 - ₹ 2,00,00,000

    Lead Business Intelligence DeveloperWe seek a visionary Business Intelligence Developer to spearhead our data-driven initiatives.This role will leverage advanced analytical and technical expertise to drive impactful business decisions.Design, develop, and deploy sophisticated data analytics solutions.Conduct in-depth data analyses to deliver actionable...