Building Scalable Data Pipelines

5 days ago


Tiruchi, Tamil Nadu, India beBeeDataEngineer Full time ₹ 15,00,000 - ₹ 25,00,000

Effective data management is crucial in today's fast-paced business environment.

We are seeking a highly skilled data engineer to join our team, responsible for designing and optimizing scalable data pipelines and architectures.

The ideal candidate will have a solid understanding of data warehousing concepts and experience working on cloud platforms.

Key Responsibilities:

  • Create client-ready dashboards using BI tools like Bold BI, Power BI, Superset, or similar.
  • Develop data models, ETL processes, and database management using SQL Server, ClickHouse, and MongoDB.
  • Build data pipelines and automation using Python.
  • Work with Azure Data Factory and Databricks for data integration and analytics.

Requirements:

  • Proven experience in creating data models, ETL processes, and database management.
  • Strong skills in Python programming language.
  • Hands-on expertise with Azure Data Factory and Databricks.
  • Solid understanding of data warehousing concepts and experience working on cloud platforms.
  • Ability to design and optimize data pipelines and architectures.
  • Familiarity with version control systems like Git.
  • Knowledge of APIs and REST APIs to connect with external data sources.
  • Strong problem-solving mindset and eagerness to learn and adapt new technologies.

  • Data Engineer

    5 days ago


    Tiruchi, Tamil Nadu, India beBeeEtal Full time ₹ 12,00,000 - ₹ 15,00,000

    ETL Developer JobThis role involves building, maintaining and optimizing data pipelines using IBM DataStage (CP4D) and AWS Glue/Lambda for ingestion from varied sources. The ideal candidate will have experience in ETL development with a focus on scalable and efficient data flows.Data Pipeline Development: Design, develop and maintain ETL pipelines using IBM...


  • Tiruchi, Tamil Nadu, India beBeeDataEngineer Full time ₹ 15,00,000 - ₹ 20,00,000

    Job Title:Data Engineer for Large-Scale Data PipelinesRole OverviewWe are seeking an experienced Data Engineer to design, build, and optimize large-scale data pipelines using Python, SQL, Linux/Bash, PySpark, AWS, and Databricks.Key ResponsibilitiesDesign and develop ETL/ELT pipelines using PySpark, AWS, and Databricks.Perform data profiling, validation, and...


  • Tiruchi, Tamil Nadu, India beBeeDataEngineer Full time ₹ 18,00,000 - ₹ 24,00,000

    Job Title: Data EngineerWe are seeking a skilled Data Engineer to play a key role in building our technology platform from the ground up. As a member of our team, you will have the opportunity to shape our technology vision and architecture.This role is ideal for someone who thrives on early-stage challenges, loves building innovative, scalable solutions,...


  • Tiruchi, Tamil Nadu, India beBeeSoftware Full time ₹ 18,00,000 - ₹ 21,00,000

    Backend Software EngineerAbout this roleWe are seeking a skilled Backend Software Engineer to design scalable APIs, integrate structured data with AI models, and ensure our platform remains secure and reliable as we grow.Responsibilities:Design and maintain backend services and APIs for core objects (contacts, companies, deals, groups).Integrate Large...


  • Tiruchi, Tamil Nadu, India beBeeDataEngineering Full time ₹ 2,00,00,000 - ₹ 2,50,00,000

    We are seeking a skilled Data Engineering leader to spearhead the development of our data products and modernize existing platforms.Key ResponsibilitiesDesign, build, and maintain scalable data pipelines and products using cloud-based services.Develop and optimize Extract, Load, Transform (ELT)/Extract, Transform, Load (ETL) processes utilizing Python for...


  • Tiruchi, Tamil Nadu, India beBeeBackend Full time ₹ 15,00,000 - ₹ 20,00,000

    About the RoleWe are seeking a skilled Backend Developer with experience in Go or Rust to join our team. You will play a key role in transforming raw on-chain data into actionable insights by decoding smart contract events and implementing pricing logic from decentralized exchanges (DEXs).This role is ideal for someone who enjoys low-level protocol work,...


  • Tiruchi, Tamil Nadu, India beBeeDataFlow Full time ₹ 1,20,00,000 - ₹ 2,00,00,000

    Job Title: Data Flow ConsultantDesign and develop scalable data pipelines using Oracle Data Flow or Apache Spark (PySpark), with a thorough understanding of data patterns, Python, and SQL.Orchestrate complex data workflows, ensuring seamless integration and automation across data services. Manage large datasets with ease and efficiency.Key...


  • Tiruchi, Tamil Nadu, India beBeeDataEngineer Full time ₹ 15,00,000 - ₹ 25,00,000

    About the RoleWe are seeking a highly skilled Data Engineer to join our team and contribute to the design and implementation of scalable data processing systems that leverage the power of big data analytics.The ideal candidate will have experience in designing, developing, and deploying big data pipelines using technologies like PySpark and Hive.


  • Tiruchi, Tamil Nadu, India beBeeDataEngineer Full time ₹ 20,00,000 - ₹ 25,00,000

    Job Title:Azure Data Engineer - Design and DeployWe are seeking an experienced Azure Data Engineer to design, build, and maintain robust data pipelines that efficiently curate and ingest data.Key Responsibilities:Design and implement scalable data solutions using Azure cloud services.Maintain CI/CD pipelines for seamless data workflows.Collaborate with...


  • Tiruchi, Tamil Nadu, India beBeeDataEngineer Full time ₹ 15,00,000 - ₹ 25,00,000

    Job OpportunityWe are seeking an experienced Freelance Data Engineer to design, develop, and optimize data pipelines. Our team offers various services, including cloud security, web and mobile security testing, and DevSecOps.The ideal candidate will have strong expertise in Python and AWS services, with at least 5 years of data engineering experience and...