Senior Data Pipeline Specialist

1 day ago

Kanpur, Uttar Pradesh, India beBeeDataEngineer Full time ₹ 36,00,000 - ₹ 42,00,000
Data Engineer Position

We are seeking a seasoned Data Engineer with a passion for building robust data pipelines on the Google Cloud Platform.

This is an exciting opportunity for a specialist with 10+ years of experience to work on challenging projects for industries like Energy, Oil & Gas, Healthcare, and Finance.

As a GCP Data Engineer, you will be responsible for:

  • Designing, developing, and maintaining scalable data pipelines for both batch and real-time processing using GCP tools.
  • Constructing large, complex datasets to meet diverse business needs.
  • Translating business requirements into clear technical specifications.
  • Leveraging a variety of GCP services, including Big Query, Cloud Dataflow (Apache Beam), Cloud Run, Cloud Functions, and Pub/Sub to build integrated systems.
  • Orchestrating workflows using Cloud Composer (Apache Airflow).
  • Working with SAP SLT to replicate SAP data to Google Cloud.
  • Implementing DevOps and CI/CD practices (GitHub, Terraform) to ensure the reliability and scalability of data pipelines.
  • Ensuring data security and governance using IAM roles, policies, and data masking techniques.
  • Monitoring pipelines using logs and alerts to proactively manage performance.

To succeed in this role, you will need:

Key Skills:

  • Deep expertise in GCP Services: Big Query, Cloud Dataflow (Apache Beam), Cloud Run, Cloud Functions, Pub/Sub, and Cloud Composer (Apache Airflow).
  • Proficiency in Python and SQL.
  • Experience with structured ERP solutions like SAP, Oracle EBS, and Salesforce.
  • A strong understanding of different file formats: CSV, JSON, XML, Parquet, ORC, Avro.
  • Knowledge of Data Lake concepts.
  • Experience with API development and consumption: REST, SOAP.

About the Role:

This position offers a unique opportunity to work on cutting-edge projects, collaborate with a talented team, and contribute to the growth of our organization.

What We Offer:

We provide a dynamic work environment, opportunities for professional growth, and a competitive compensation package.

How to Apply:

If you are a motivated and experienced Data Engineer looking for a new challenge, please submit your application.

  • Data Pipeline Specialist

    4 days ago

    Kanpur, Uttar Pradesh, India beBeeMachine Full time ₹ 25,00,000 - ₹ 28,00,000

    Senior Machine Learning EngineerKey Responsibilities:Develop and optimize complex data pipelines, applying machine learning engineering principles to enhance efficiency and scalability.Integrate and optimize data and model pipelines within production environments, diagnosing data inconsistencies and documenting assumptions.Employ experimental methodologies,...

  • Data Pipeline Specialist

    1 week ago

    Kanpur, Uttar Pradesh, India beBeeData Full time ₹ 10,00,000 - ₹ 20,00,000

    Big Data EngineerWe are seeking a highly skilled professional to join our team as a Big Data Engineer. In this role, you will be responsible for designing, building, and maintaining robust data pipelines that handle high-volume financial data.Key Responsibilities:Design, develop, and manage end-to-end data pipelines for stocks, crypto, and other financial...

  • Data Pipeline Specialist

    4 days ago

    Kanpur, Uttar Pradesh, India beBeeBusiness Full time ₹ 1,50,00,000 - ₹ 2,00,00,000

    Job Title: Business Intelligence Developer","Role Summary:","We are seeking an experienced professional to design and implement scalable data pipelines using industry-standard tools.","Key Responsibilities:","Design and implement scalable data pipelines.","Develop ETL/ELT solutions within a cloud-based environment.","Manage and optimize data storage and...

  • Data Pipeline Engineer

    1 week ago

    Kanpur, Uttar Pradesh, India beBeeETL Full time ₹ 10,00,000 - ₹ 15,00,000

    Senior ETL DeveloperWe are seeking an accomplished Senior ETL Developer to join our Data Engineering team. The ideal candidate will have a proven track record of designing, developing, and maintaining scalable and efficient data pipelines using IBM DataStage, AWS Glue, and Snowflake.The role involves collaborating with architects, business analysts, and data...

  • Data Pipeline Specialist

    1 week ago

    Kanpur, Uttar Pradesh, India beBeeData Full time ₹ 15,00,000 - ₹ 17,50,000

    About the RoleWe're seeking a highly skilled Data Engineer to build robust pipelines that transform large, messy technical datasets into high-quality structured data.

  • Senior Data Pipeline Developer

    2 days ago

    Kanpur, Uttar Pradesh, India beBeeDataEngineering Full time ₹ 1,20,00,000 - ₹ 2,00,00,000

    About Our Data Engineering RoleWe are seeking an experienced Data Engineer to develop scalable data pipelines and generate PDF reports using Python, SQL, and Spark.The ideal candidate will have a strong understanding of data pipelines and ETL processes, as well as experience working with Snowflake and Azure Databricks.

  • Senior Data Pipeline Specialist

    4 days ago

    Kanpur, Uttar Pradesh, India beBeeBigData Full time ₹ 15,00,000 - ₹ 20,00,000

    Unlock the Power of Data Engineering with a Career that Transforms.We're seeking an accomplished Big Data Engineer to spearhead our data engineering team. The ideal candidate will be highly skilled in designing, developing, and optimizing large-scale data pipelines and distributed data processing systems using Scala, Spark (PySpark), Python, NiFi, and Apache...

  • Financial Data Pipeline Specialist

    4 days ago

    Kanpur, Uttar Pradesh, India beBeeDataEngineer Full time ₹ 1,50,00,000 - ₹ 2,50,00,000

    We are seeking a highly skilled data engineer to take on the challenge of designing and building robust data pipelines that handle high-volume financial data.Key Responsibilities:Design and develop end-to-end data pipelines for stocks, cryptocurrencies, and other financial datasets.Integrate third-party APIs and data feeds into internal systems.Build and...

  • Data Pipeline Specialist

    1 week ago

    Kanpur, Uttar Pradesh, India beBeeDataEngineer Full time ₹ 15,00,000 - ₹ 20,00,000

    Job OpportunityWe are seeking a skilled professional to take on the role of Data Engineer, responsible for designing, developing, and maintaining data pipelines that ingest data from various sources into our enterprise-wide data warehouse system.Utilize cutting-edge technologies like AWS services (AWS Lambda, AWS DMS, and AWS Glue) for data ingestion and...

  • Strategic Data Architect

    1 week ago

    Kanpur, Uttar Pradesh, India beBeeData Full time ₹ 15,00,000 - ₹ 25,00,000

    Senior Data SpecialistWe are seeking a skilled Senior Data Specialist to design, develop, and maintain robust data pipelines, data warehouses, and analytics platforms that power our digital marketing platform. As a key member of our data infrastructure team, you will transform raw marketing data into actionable insights that drive business growth.Key...