Building Scalable Data Pipelines

14 hours ago

Tiruchi, Tamil Nadu, India beBeeData Full time ₹ 15,00,000 - ₹ 25,00,000
Senior AWS Data Engineer">

We are seeking a highly skilled Senior AWS Data Engineer to join our data engineering team. The ideal candidate will have deep expertise in building scalable data pipelines using Apache Spark, PySpark, SQL, and Python, along with hands-on experience in the AWS ecosystem.

Key Responsibilities:

">
  • ">
  • Design, develop, and maintain robust ETL/ELT pipelines on AWS using Spark and PySpark for large-scale data processing workflows">
  • Optimize performance and reliability of complex data systems on AWS">
  • Work with a range of AWS services including Glue, EMR, S3, Lambda, and Redshift for data governance and security">
  • Ensure high-quality data across all pipelines through rigorous testing and validation">
">

Required Skills and Qualifications:

">
  • ">
  • 6+ years of experience in data engineering with strong proficiency in Spark, PySpark, SQL, and Python">
  • Hands-on experience with AWS data services and solid understanding of distributed computing and data architecture">
  • Excellent problem-solving and communication skills, as well as experience with CI/CD for data pipelines">
  • Familiarity with data lake and data warehouse architectures, including design and implementation">
  • Ability to work independently and collaboratively as part of a high-performing team">
">

Benefits of this Role:

">
  • ">
  • Opportunity to work on high-impact projects that drive business growth and innovation">
  • Collaborative and dynamic work environment with experienced professionals">
  • Professional development opportunities, including training and mentorship">
  • Flexible work arrangements and competitive compensation package">
">

What We Offer:

">
  • ">
  • Comprehensive benefits package, including health insurance, retirement plan, and paid time off">
  • Opportunities for professional growth and development, including training and mentorship">
  • Flexible work arrangements, including remote work options and flexible hours">
  • A collaborative and dynamic work environment with experienced professionals">
",

  • Building Scalable Data Pipelines

    7 days ago

    Tiruchi, Tamil Nadu, India beBeeDataEngineer Full time ₹ 15,00,000 - ₹ 25,00,000

    Effective data management is crucial in today's fast-paced business environment.We are seeking a highly skilled data engineer to join our team, responsible for designing and optimizing scalable data pipelines and architectures.The ideal candidate will have a solid understanding of data warehousing concepts and experience working on cloud platforms.Key...

  • Data Engineer

    7 days ago

    Tiruchi, Tamil Nadu, India beBeeEtal Full time ₹ 12,00,000 - ₹ 15,00,000

    ETL Developer JobThis role involves building, maintaining and optimizing data pipelines using IBM DataStage (CP4D) and AWS Glue/Lambda for ingestion from varied sources. The ideal candidate will have experience in ETL development with a focus on scalable and efficient data flows.Data Pipeline Development: Design, develop and maintain ETL pipelines using IBM...

  • Optimizing Data Pipelines through Scalable Engineering

    7 days ago

    Tiruchi, Tamil Nadu, India beBeeDataEngineer Full time ₹ 15,00,000 - ₹ 20,00,000

    Job Title:Data Engineer for Large-Scale Data PipelinesRole OverviewWe are seeking an experienced Data Engineer to design, build, and optimize large-scale data pipelines using Python, SQL, Linux/Bash, PySpark, AWS, and Databricks.Key ResponsibilitiesDesign and develop ETL/ELT pipelines using PySpark, AWS, and Databricks.Perform data profiling, validation, and...

  • Building Scalable Solutions

    2 days ago

    Tiruchi, Tamil Nadu, India beBeeDataEngineer Full time ₹ 18,00,000 - ₹ 24,00,000

    Job Title: Data EngineerWe are seeking a skilled Data Engineer to play a key role in building our technology platform from the ground up. As a member of our team, you will have the opportunity to shape our technology vision and architecture.This role is ideal for someone who thrives on early-stage challenges, loves building innovative, scalable solutions,...

  • Building Scalable Backend Solutions

    1 week ago

    Tiruchi, Tamil Nadu, India beBeeSoftware Full time ₹ 18,00,000 - ₹ 21,00,000

    Backend Software EngineerAbout this roleWe are seeking a skilled Backend Software Engineer to design scalable APIs, integrate structured data with AI models, and ensure our platform remains secure and reliable as we grow.Responsibilities:Design and maintain backend services and APIs for core objects (contacts, companies, deals, groups).Integrate Large...

  • Chief Data Pipeline Architect

    3 days ago

    Tiruchi, Tamil Nadu, India beBeeDataEngineering Full time ₹ 2,00,00,000 - ₹ 2,50,00,000

    We are seeking a skilled Data Engineering leader to spearhead the development of our data products and modernize existing platforms.Key ResponsibilitiesDesign, build, and maintain scalable data pipelines and products using cloud-based services.Develop and optimize Extract, Load, Transform (ELT)/Extract, Transform, Load (ETL) processes utilizing Python for...

  • Data Pipeline Architect

    4 days ago

    Tiruchi, Tamil Nadu, India beBeeBackend Full time ₹ 15,00,000 - ₹ 20,00,000

    About the RoleWe are seeking a skilled Backend Developer with experience in Go or Rust to join our team. You will play a key role in transforming raw on-chain data into actionable insights by decoding smart contract events and implementing pricing logic from decentralized exchanges (DEXs).This role is ideal for someone who enjoys low-level protocol work,...

  • Expert Data Pipelines Architect

    4 days ago

    Tiruchi, Tamil Nadu, India beBeeDataFlow Full time ₹ 1,20,00,000 - ₹ 2,00,00,000

    Job Title: Data Flow ConsultantDesign and develop scalable data pipelines using Oracle Data Flow or Apache Spark (PySpark), with a thorough understanding of data patterns, Python, and SQL.Orchestrate complex data workflows, ensuring seamless integration and automation across data services. Manage large datasets with ease and efficiency.Key...

  • Chief Data Pipeline Architect

    7 days ago

    Tiruchi, Tamil Nadu, India beBeeDataEngineer Full time ₹ 15,00,000 - ₹ 25,00,000

    About the RoleWe are seeking a highly skilled Data Engineer to join our team and contribute to the design and implementation of scalable data processing systems that leverage the power of big data analytics.The ideal candidate will have experience in designing, developing, and deploying big data pipelines using technologies like PySpark and Hive.

  • Building Scalable Systems

    1 day ago

    Tiruchi, Tamil Nadu, India beBeeBackend Full time ₹ 20,00,000 - ₹ 25,00,000

    Job OpportunityWe are seeking an accomplished Senior Backend Developer to join our team.A highly skilled individual with expertise in designing, developing, and maintaining scalable APIs, secure back-end systems, and high-performance architectures using Node.js and Express.js is required.Design, develop, and maintain RESTful APIs utilizing Node.js and...