Senior Data Pipeline Specialist

2 days ago

Guntur, Andhra Pradesh, India beBeeDataEngineering Full time ₹ 13,08,000 - ₹ 26,12,000

Job Summary

We are seeking a skilled Data Engineer to join our team. As a Data Engineer, you will design, develop, and maintain large-scale data pipelines using various tools in the Google Cloud Ecosystem.

Key Responsibilities

  • Develop complex datasets based on business requirements.
  • Construct big data pipeline architecture.
  • Identify opportunities for data acquisition via collaboration with stakeholders and business clients.
  • Translate business needs to technical requirements.
  • Leverage DevOps and CI/CD practices (GitHub, Terraform) to ensure the reliability and scalability of data pipelines.
  • Partition/Cluster and retrieve content in Big Query using IAM roles & Policy Tags to secure the data.
  • Design and build an ingestion pipeline using Rest API.

Requirements

  • Proficiency in Python, Data Flow, DataStream, CDC (Change Data Capture), Cloud Functions, Cloud Run, Pub Sub, BigQuery, Cloud Storage.
  • Experience with SAP SLT to replicate SAP tables to Google Cloud.
  • Knowledge of JSON messaging structure for integrating with various applications.
  • Strong understanding of logs & alerts to effectively monitor pipelines.

What We Offer

  • Opportunities for growth and professional development.
  • Collaborative and dynamic work environment.
  • Competitive compensation and benefits package.

About Us

We are a forward-thinking organization dedicated to innovation and excellence in our industry. Our mission is to deliver cutting-edge solutions that meet the evolving needs of our customers.

  • Scalable Data Pipeline Specialist

    3 days ago

    Guntur, Andhra Pradesh, India beBeeDataEngineer Full time ₹ 2,00,00,000 - ₹ 2,50,00,000

    Senior Data Engineer Position OverviewThis role is centered around designing, developing, and implementing scalable data pipelines to drive business growth. The ideal candidate will be responsible for spearheading data engineering efforts, ensuring seamless integration with analytics and business teams.

  • Senior Data Pipeline Specialist

    1 week ago

    Guntur, Andhra Pradesh, India beBeeDataEngineer Full time US$ 1,00,000 - US$ 1,50,000

    Job TitleA Data Engineer will be responsible for building and maintaining data pipelines, designing enterprise-grade data architectures, and collaborating with cross-functional teams.Key Responsibilities:Design, build, and maintain robust data pipelines and ETL/ELT processesDevelop data ingestion frameworks to collect data from various sources (databases,...

  • Data Pipeline Specialist

    1 week ago

    Guntur, Andhra Pradesh, India beBeeIngestion Full time ₹ 15,00,000 - ₹ 17,50,000

    Seeking a seasoned Ingestion Expert to spearhead data ingestion strategies. This role demands expertise in designing, developing, and optimizing data pipelines for integrating various sources into Databricks.Key Responsibilities:Design and implement robust data ingestion pipelines for integrating multiple sources into Databricks.Develop and maintain...

  • Data Pipeline Specialist

    2 days ago

    Guntur, Andhra Pradesh, India beBeeCloudDataEngineer Full time ₹ 15,00,000 - ₹ 25,00,000

    Job Title: Cloud Data EngineerWe are seeking a highly skilled Cloud Data Engineer to design and implement scalable, reliable, and secure data pipelines on Google Cloud Platform (GCP). The ideal candidate will have in-depth experience with GCS, BigQuery, IAM, and Cloud Functions.The successful candidate will develop robust ETL/ELT processes using Python and...

  • Senior Data Engineer

    4 weeks ago

    Guntur, Andhra Pradesh, India Aptus Data Labs Full time

    Job Title: Senior Data EngineerLocation: RemoteExperience: 4+Employment Type: Full-TimeNotice- Looking for immediate joiners or who can join within 15-20 days.About the RoleAptus Data Labs is looking for a talented and proactive Senior Data Engineer to help build the backbone of our enterprise data and AI initiatives. You'll work on modern data lake...

  • Data Pipeline Specialist

    1 week ago

    Guntur, Andhra Pradesh, India beBeeDataEngineer Full time ₹ 10,00,000 - ₹ 18,00,000

    Data Engineer Job OverviewWe are seeking a skilled Data Engineer to design and implement efficient data pipelines that transform large datasets into high-quality structured data.Key Responsibilities:Normalize heterogeneous data into structured outputs (CSV, SQL, JSON) for large-scale comparisons.Document workflows, maintain reusable extraction modules, and...

  • Data Pipeline Specialist

    3 days ago

    Guntur, Andhra Pradesh, India beBeeDatabase Full time ₹ 1,50,00,000 - ₹ 2,00,00,000

    Job DescriptionAs a skilled and motivated Database Professional, you will play a vital role in designing, implementing, and optimizing data pipelines and storage solutions using SQL and NoSQL databases. You will be responsible for managing relational databases and NoSQL platforms, building scalable, distributed, and highly available database systems for...

  • Chief Data Pipeline Architect

    2 days ago

    Guntur, Andhra Pradesh, India beBeeDataEngineer Full time ₹ 20,00,000 - ₹ 35,00,000

    Senior AWS Data EngineerWe seek experts in building scalable data pipelines using Spark, PySpark, SQL, and Python.Design and develop robust ETL/ELT pipelines on AWS utilizing Spark and PySparkOngoing optimization of large-scale data processing workflows for performance and reliabilityCollaboration with AWS services such as Glue, EMR, S3, Lambda, and...

  • Senior Data Pipeline Developer

    1 week ago

    Guntur, Andhra Pradesh, India beBeeDataEngineer Full time ₹ 15,00,000 - ₹ 35,00,000

    We are seeking a seasoned data professional to spearhead large-scale data pipeline development using cutting-edge technologies like PySpark, AWS, and Databricks.The ideal candidate will possess extensive expertise in Python and SQL, with a proven track record of designing, building, and optimizing complex data pipelines.Key Responsibilities:Design and...

  • Distinguished Data Pipeline Architect

    1 week ago

    Guntur, Andhra Pradesh, India beBeeDataEngineer Full time ₹ 30,00,000 - ₹ 50,00,000

    About the Role:We are seeking a seasoned Senior Data Engineer to join our team. This is a critical role responsible for designing, building, and maintaining our data pipeline architecture.This engineer will collaborate closely with data scientists and analysts to facilitate data-related functionalities.They will lead the optimization and scalability of data...