Optimizing Data Pipelines

4 days ago


Kannur, Kerala, India beBeeDataEngineer Full time ₹ 90,00,000 - ₹ 1,20,00,000

**Data Engineer Role**

We are seeking a highly skilled Data Engineer to design and implement optimal data pipelines.

Key Responsibilities:

  • Create and maintain an efficient data pipeline architecture using big data technologies.
  • Design internal process improvements: automate manual processes, optimize data delivery, re-design infrastructure for greater scalability.
  • Build the infrastructure required for extracting, transforming, and loading data from various sources.
  • Develop data tools for analytics and data scientist team members.
  • Collaborate with data scientists to enhance data system functionality.

Mandatory Qualifications:

Proficiency in Scala or Python, expertise in Spark, experience with performance tuning and optimization. DBT is also required.

A minimum of 2 years of experience as a Data Engineer is essential.

The ideal candidate will have strong analytical skills related to working with structured/unstructured datasets.

Experience supporting cross-functional teams in a dynamic environment is crucial.

A portfolio of side projects on GitHub or contributions to open-source projects can be advantageous.

Benefits:

This role offers the opportunity to work with cutting-edge technologies and contribute to innovative projects.

What We're Looking For:

A motivated individual with a passion for data engineering and a drive to continuously improve processes.



  • Kannur, Kerala, India beBeeDataEngineer Full time ₹ 1,50,00,000 - ₹ 2,00,00,000

    Job OverviewAs a Data Engineer, you will play a pivotal role in designing and developing scalable data pipelines on Google Cloud Platform (GCP).Design and build robust data pipelines to extract, transform, and load data from various sources.Collaborate with cross-functional teams to understand business requirements and translate them into technical...


  • Kannur, Kerala, India beBeeArchitect Full time ₹ 20,00,000 - ₹ 25,00,000

    Cloud Data Solutions ArchitectJob OverviewOur organization is seeking an accomplished Cloud Data Solutions Architect with extensive experience in designing and implementing cloud data pipelines using AWS Databricks, Snowflake, Python, and Fivetran.Key Responsibilities:Domain Identification: Collaborate with data product stewards to define foundational...


  • Kannur, Kerala, India beBeeDataEngineer Full time ₹ 15,00,000 - ₹ 20,00,000

    Cloud Data Engineer PositionWe are seeking a skilled and motivated Cloud Data Engineer with hands-on experience in building scalable data pipelines and cloud-native solutions.Key Responsibilities:Design, develop, and optimize robust data ingestion pipelines using GCP services such as Pub/Sub, Dataflow, and Cloud Storage.Architect and manage scalable BigQuery...


  • Kannur, Kerala, India beBeePipeline Full time ₹ 15,00,000 - ₹ 25,00,000

    Job Title: Databricks Pipeline Developer We seek an experienced Databricks pipeline developer to design and implement robust data ingestion pipelines for integrating multiple sources into Databricks.Key Responsibilities:Develop high-performance data ingestion pipelines for integrating multiple sources into Databricks.Implement and maintain continuous...


  • Kannur, Kerala, India beBeeDataEngineering Full time US$ 1,50,000 - US$ 2,00,000

    We are seeking a highly skilled Senior Data Pipeline Specialist to join our team.The ideal candidate will have hands-on experience with data transformation pipelines using Snowflake and dbt.The successful candidate will design and implement scalable ELT pipelines using dbt on Snowflake, following industry-accepted best practices. They will also build...


  • Kannur, Kerala, India beBeeDataEngineer Full time ₹ 80,00,000 - ₹ 2,40,00,000

    Job Summary:We are seeking a skilled professional to develop and maintain robust data pipelines for structured and unstructured data.The ideal candidate will have a strong background in computer science, data science, or engineering, with 3+ years of experience in working with Python, SQL, PySpark, and bash scripts.Key Responsibilities:Design and develop...


  • Kannur, Kerala, India beBeeData Full time ₹ 15,00,000 - ₹ 20,00,000

    We are seeking an experienced Data Pipelines Tester to lead our project forward. The ideal candidate will have a proven track record in designing and executing advanced testing strategies across complex data pipelines and enterprise-grade data systems.Key Responsibilities:Perform thorough testing of ETL processes to ensure data integrity and accuracy.Develop...


  • Kannur, Kerala, India beBeeBackend Full time ₹ 1,50,00,000 - ₹ 2,00,00,000

    Job TitleA seasoned Backend Engineer is required to spearhead the development of cutting-edge data pipelines that power real-time pricing engines.Design, develop, and maintain event decoders for prominent DeFi protocols (e.g., Uniswap, Curve, Balancer).Create and optimize data extractors that convert on-chain events into structured trade data.Implement...


  • Kannur, Kerala, India beBeeData Full time ₹ 17,00,000 - ₹ 23,00,000

    Job OpportunityWe're seeking a skilled data engineer to design and develop scalable data pipelines using AWS services. With expertise in Python and experience in PySpark, you'll be responsible for developing ETL/ELT processes, managing storage solutions with Amazon S3, and implementing unit and integration tests.


  • Kannur, Kerala, India beBeeTestEngineer Full time ₹ 20,00,000 - ₹ 25,00,000

    About our company: Our client is a multinational information technology organization with headquarters in Paris.We have been leading business transformation for over 50 years, leveraging technology to address a wide range of business needs.Our mission is to unleash human energy through technology for an inclusive and sustainable future. We provide various...