Building Scalable Data Engineering Solutions

19 hours ago

Coimbatore, Tamil Nadu, India beBeeDataEngineer Full time ₹ 1,20,00,000 - ₹ 2,00,00,000
Developing Data Acquisition Pipelines 

As a Senior Data Engineer, you will be responsible for designing, building, and maintaining large-scale data acquisition pipelines that handle structured and unstructured data.

This includes batch and real-time processing in the cloud ecosystem. You will work with stakeholders to identify opportunities for data acquisition and translate business needs into technical requirements.

You will leverage various tools in the cloud ecosystem, such as Python, Cloud Functions, Cloud Run, Pub Sub, BigQuery, Cloud Storage, to integrate systems and data pipelines.

You will use logs and alerts to effectively monitor pipelines and utilize DevOps and CI/CD practices to ensure the reliability and scalability of data pipelines.

You will design and build an ingestion pipeline using Rest API and recommend ways to improve data quality, reliability, and efficiency.

Responsibilities:

  • Design, build, and maintain large-scale data acquisition pipelines.
  • Work with stakeholders to identify opportunities for data acquisition and translate business needs into technical requirements.
  • Develop and implement batch and real-time processing solutions in the cloud ecosystem.
  • Collaborate with cross-functional teams to ensure seamless integration between systems and data pipelines.

Requirements:

  • 4+ years of experience in a GCP data engineering role.
  • At least 1 year of hands-on experience in GCP tools, including Python, SQL, Cloud Functions, Cloud Run, Pub Sub, BigQuery, Cloud Storage.

Skills:

  • Cloud computing and architecture.
  • Big Data and data engineering.
  • DevOps and CI/CD practices.
  • Python programming language.
  • SQL and NoSQL databases.
  • Cloud storage and data lakes.

  • Senior Data Engineer

    2 days ago

    Coimbatore, Tamil Nadu, India beBeeData Full time ₹ 25,00,000 - ₹ 30,00,000

    Key Role: Data Engineering LeadWe're seeking an experienced and skilled data engineer to drive the development of our reporting and analytics platform.Main Responsibilities:Create scalable data solutions using Databricks, SQL, Python, Spark, and Delta Lake on Azure.Maintain high standards for ETL/ELT and data quality.Collaborate with teams to integrate data...

  • Building Scalable Data Solutions

    3 days ago

    Coimbatore, Tamil Nadu, India beBeeData Full time ₹ 15,00,000 - ₹ 20,00,000

    Cloud Data Architect Job OpportunityAs a Cloud Data Architect, you will be responsible for designing and implementing data pipelines that scale with business growth. Utilizing AWS services like Glue, Python, EMR/Spark, and Kafka/Kinesis streaming, you will develop efficient data processing solutions.Develop relational databases using Aurora Postgres,...

  • Building Scalable Pipelines and Driving Analytics

    2 weeks ago

    Coimbatore, Tamil Nadu, India beBeeDataEngineering Full time ₹ 1,50,00,000 - ₹ 2,00,00,000

    Job Title: Senior Data EngineerWe are seeking a highly skilled and experienced Data Engineer to join our data team focused on delivering impactful solutions in the healthcare and medical technology space.If you're passionate about building scalable pipelines, driving analytics, and working with healthcare data standards—this role is for you.Pipeline...

  • Scalable Data Solutions Architect

    2 days ago

    Coimbatore, Tamil Nadu, India beBeeData Full time ₹ 1,50,00,000 - ₹ 2,50,00,000

    Job Title: Scalable Data Solutions ArchitectWe are seeking a highly skilled data engineer with expertise in Scala, Spark, Python, NiFi, and Apache Kafka to lead our data engineering team.Data Engineering Expertise:Design, develop, and optimize large-scale data pipelines and distributed data processing systems.Work extensively with Scala, Spark (PySpark), and...

  • Unlock Your Potential as a Scalable Data Engineer

    16 hours ago

    Coimbatore, Tamil Nadu, India beBeeData Full time ₹ 12,00,000 - ₹ 15,00,000

    Scalable Data EngineerThe role of a Scalable Data Engineer involves enabling data-driven operations and decision-making in an agile environment.We are seeking a highly skilled professional with 4-8 years of experience in designing, building, and maintaining scalable and reliable data pipelines using AWS services like Glue and Lambda.The ideal candidate will...

  • Data Engineering Solutions Professional

    3 days ago

    Coimbatore, Tamil Nadu, India beBeeData Full time ₹ 1,50,00,000 - ₹ 2,50,00,000

    Job Title: Data Processing Systems Specialist">Azure data engineers are responsible for designing, building and maintaining large-scale data processing systems on Microsoft Azure.Key Responsibilities:Develop scalable data pipelines using cloud-based services such as Azure Data Factory, Databricks and Synapse Analytics.Create serverless data processing...

  • Scalable Data Systems Engineer

    1 week ago

    Coimbatore, Tamil Nadu, India beBeeDataInfrastructure Full time ₹ 35,00,000 - ₹ 50,00,000

    Job Title: Data Infrastructure SpecialistWe are seeking a skilled Data Infrastructure Specialist to join our team. In this role, you will be responsible for designing and building scalable data systems that support real-time and batch data processing.Create robust data pipelines and ETL workflowsBuild and manage cloud-based data...

  • Building Robust Data Infrastructure

    3 days ago

    Coimbatore, Tamil Nadu, India beBeeDataEngineer Full time ₹ 11,52,000 - ₹ 19,20,000

    Job Title: Data EngineerDomain: Agentic AI – AWSJob Overview:We are seeking skilled Data Engineers to design, build, and manage robust data pipelines that power Agentic AI solutions on AWS.Key Responsibilities:Develop efficient ETL/ELT workflows for structured, unstructured, and streaming data in AWS environments.Leverage AWS services like S3, Glue, EMR,...

  • Data Solutions Expert

    2 weeks ago

    Coimbatore, Tamil Nadu, India beBeeDataDriven Full time ₹ 20,00,000 - ₹ 25,00,000

    About UsWe provide data-driven solutions to empower businesses. Our team of experts designs and implements scalable, secure, and innovative data architecture.Key ResponsibilitiesWe design end-to-end data architecture solutions that meet business needs.Our team architects, builds, and optimizes data pipelines and ETL workflows using industry-leading tools.We...

  • Expert Data Solutions Architect

    6 days ago

    Coimbatore, Tamil Nadu, India beBeeDataEngineer Full time ₹ 15,85,000 - ₹ 25,30,000

    We are seeking a highly skilled Data Engineer to join our team in Hyderabad, India.The ideal candidate will have a deep understanding of data product lifecycle, standards and practices. They will be responsible for building scalable and efficient data solutions to support business functions with a specific focus on menu data products and initiatives.As a...