Data Pipeline Specialist

1 day ago


Guntur, Andhra Pradesh, India beBeeCloudDataEngineer Full time ₹ 15,00,000 - ₹ 25,00,000

Job Title: Cloud Data Engineer

We are seeking a highly skilled Cloud Data Engineer to design and implement scalable, reliable, and secure data pipelines on Google Cloud Platform (GCP). The ideal candidate will have in-depth experience with GCS, BigQuery, IAM, and Cloud Functions.

The successful candidate will develop robust ETL/ELT processes using Python and integrate with data orchestration tools like Apache Airflow. They will collaborate with data analysts, data scientists, and business stakeholders to deliver high-quality solutions.

Key Responsibilities:

  1. Design and implement scalable, reliable, and secure data pipelines on GCP.
  2. Develop ETL/ELT processes using Python and integrate with data orchestration tools.
  3. Collaborate with data teams to understand data requirements and deliver high-quality solutions.
  4. Optimize BigQuery performance through efficient schema design, partitioning, clustering, and query optimization.
  5. Manage and maintain data lake and data warehouse environments.
  6. Automate and monitor data pipelines to ensure consistent and reliable data delivery.

Must-Have Skills:

  • GCP: In-depth experience with core services like GCS, BigQuery, IAM, and Cloud Functions.
  • BigQuery: Expertise in data modeling, performance tuning, and large-scale analytics.
  • Google Cloud Storage: Strong understanding of data storage, access patterns, and integration.
  • Apache Airflow: Experience in authoring and managing DAGs for complex workflows.
  • Python: Proficient in scripting and automation, including working with APIs, data processing libraries, and custom operators in Airflow.


  • Guntur, Andhra Pradesh, India beBeeIngestion Full time ₹ 15,00,000 - ₹ 17,50,000

    Seeking a seasoned Ingestion Expert to spearhead data ingestion strategies. This role demands expertise in designing, developing, and optimizing data pipelines for integrating various sources into Databricks.Key Responsibilities:Design and implement robust data ingestion pipelines for integrating multiple sources into Databricks.Develop and maintain...


  • Guntur, Andhra Pradesh, India beBeeDataEngineer Full time ₹ 10,00,000 - ₹ 18,00,000

    Data Engineer Job OverviewWe are seeking a skilled Data Engineer to design and implement efficient data pipelines that transform large datasets into high-quality structured data.Key Responsibilities:Normalize heterogeneous data into structured outputs (CSV, SQL, JSON) for large-scale comparisons.Document workflows, maintain reusable extraction modules, and...


  • Guntur, Andhra Pradesh, India beBeeDatabase Full time ₹ 1,50,00,000 - ₹ 2,00,00,000

    Job DescriptionAs a skilled and motivated Database Professional, you will play a vital role in designing, implementing, and optimizing data pipelines and storage solutions using SQL and NoSQL databases. You will be responsible for managing relational databases and NoSQL platforms, building scalable, distributed, and highly available database systems for...


  • Guntur, Andhra Pradesh, India beBeeDataEngineer Full time US$ 1,00,000 - US$ 1,50,000

    Job TitleA Data Engineer will be responsible for building and maintaining data pipelines, designing enterprise-grade data architectures, and collaborating with cross-functional teams.Key Responsibilities:Design, build, and maintain robust data pipelines and ETL/ELT processesDevelop data ingestion frameworks to collect data from various sources (databases,...


  • Guntur, Andhra Pradesh, India beBeeDataEngineering Full time ₹ 13,08,000 - ₹ 26,12,000

    Job SummaryWe are seeking a skilled Data Engineer to join our team. As a Data Engineer, you will design, develop, and maintain large-scale data pipelines using various tools in the Google Cloud Ecosystem.Key ResponsibilitiesDevelop complex datasets based on business requirements.Construct big data pipeline architecture.Identify opportunities for data...


  • Guntur, Andhra Pradesh, India beBeeDataEngineer Full time ₹ 2,00,00,000 - ₹ 2,50,00,000

    Senior Data Engineer Position OverviewThis role is centered around designing, developing, and implementing scalable data pipelines to drive business growth. The ideal candidate will be responsible for spearheading data engineering efforts, ensuring seamless integration with analytics and business teams.


  • Guntur, Andhra Pradesh, India beBeeData Full time ₹ 1,50,00,000 - ₹ 2,50,00,000

    Unlock Your Potential in Data EngineeringYour potential, unleashed. The global economy is evolving at an unprecedented rate, and it's a perfect time to unleash your skills in data engineering.You'll have the chance to combine our drive to propel with purpose with your passion for data engineering. You'll be part of a team that collaborates, innovates, grows,...


  • Guntur, Andhra Pradesh, India beBeeElasticsearch Full time ₹ 1,48,27,100 - ₹ 2,54,45,400

    Job Summary:About this role:Evaluate the performance of our Elasticsearch and Splunk clusters to identify developing problems, plan changes for upcoming high-load events, apply security fixes, test and perform incremental upgrades, and extend and improve our monitoring and alert infrastructure.Responsibilities Include:Maintaining other parts of the data...


  • Guntur, Andhra Pradesh, India beBeeDataEngineer Full time ₹ 20,00,000 - ₹ 35,00,000

    Senior AWS Data EngineerWe seek experts in building scalable data pipelines using Spark, PySpark, SQL, and Python.Design and develop robust ETL/ELT pipelines on AWS utilizing Spark and PySparkOngoing optimization of large-scale data processing workflows for performance and reliabilityCollaboration with AWS services such as Glue, EMR, S3, Lambda, and...


  • Guntur, Andhra Pradesh, India beBeeETLPipeline Full time ₹ 20,00,000 - ₹ 25,00,000

    ETL DeveloperWe are seeking a highly skilled and motivated ETL Developer to join our data engineering team.You will work on designing, developing, and maintaining scalable and efficient data pipelines using IBM DataStage, AWS Glue, and Snowflake. Key Responsibilities:Design and Develop ETL PipelinesLeverage best practices for schema design, partitioning, and...