Building Scalable Data Pipelines Specialist
1 week ago
Data Engineer Role Overview
The role of a Data Engineer is pivotal in the organization as they design, build and manage end-to-end data pipelines using Google Cloud Platform services including Dataflow, BigQuery, Pub/Sub, Dataproc, and Composer.
Responsibilities and Key Activities:
- Analyzing and processing real-time and batch data utilizing Apache Beam and Airflow.
- Developing and maintaining data warehouse solutions on BigQuery with optimized storage and accessibility.
- Configuring and provisioning GCP infrastructure using Infrastructure as Code (IaC) practices with Terraform.
- Collaborating with cross-functional teams to ensure data quality, scalability, and security across the board.
- Monitoring, debugging, and resolving issues within data workflows.
- Documenting all data processes, workflows, and infrastructure for internal reference and knowledge sharing.
Requirements and Preferred Skills:
- A strong background in data engineering with proven expertise in Google Cloud Platform.
-
Building Scalable Data Solutions
1 week ago
Pune, Maharashtra, India beBeeData Full time ₹ 1,50,00,000 - ₹ 2,50,00,000Senior Data ArchitectWe are seeking a highly skilled Senior Data Architect to design and implement scalable data solutions.Develops and implements comprehensive data architectures, ensuring scalability and maintainability.Designs and optimizes large-scale data pipelines with strong communication skills.Collaborates with cross-functional teams to deliver...
-
Data Engineer
2 weeks ago
Pune, Maharashtra, India beBeeDataEngineer Full time ₹ 1,50,00,000 - ₹ 2,50,00,000About the Role:">We are seeking a seasoned data engineer to spearhead the development and maintenance of large-scale data pipelines that process massive datasets from billions of devices and hundreds of millions of active users.">Key Responsibilities:">Design, build, and deploy scalable data pipelines using Python and SQLCollaborate with stakeholders to...
-
Data Pipeline Engineer
7 days ago
Pune, Maharashtra, India beBeeData Full time ₹ 2,00,00,000 - ₹ 2,50,00,000Big Data Specialist - Data Pipeline EngineerAs a Big Data Specialist - Data Pipeline Engineer, you will be responsible for designing, building, and maintaining robust data pipelines to efficiently curate and ingest data.Our ideal candidate will have strong SQL skills, experience with Fabric, and proficiency in programming languages such as Python (PySpark)....
-
Building Scalable Solutions
1 week ago
Pune, Maharashtra, India beBeeData Full time ₹ 90,00,000 - ₹ 1,20,00,000Lead Data EngineerWe are seeking a passionate and driven professional to join our team at the forefront of data engineering. As we build our platform from scratch, you will have the opportunity to shape our technology vision, architecture, and engineering culture.This role is ideal for someone who thrives on early-stage challenges and loves building...
-
Expert Data Pipeline Developer
2 weeks ago
Pune, Maharashtra, India beBeeDataEngineer Full time ₹ 1,50,00,000 - ₹ 2,30,00,000Senior Data Engineer PositionWe are seeking a highly skilled Senior Data Engineer to join our team. As a critical member of our AI-powered applications, you will design and build scalable data pipelines that process clinical encounter data.You will work closely with software engineers, machine learning specialists, and our clinical partners to bring our...
-
Pune, Maharashtra, India beBeeDataEngineering Full time ₹ 1,50,00,000 - ₹ 2,50,00,000**Job Opportunity**We are seeking a seasoned data professional to lead our big data initiatives. As a Senior Data Engineer with GCP, ETL expertise, you will be responsible for designing and implementing scalable data pipelines using Google Cloud Platform technologies.The ideal candidate should have hands-on experience with GCP services such as GCS, PubSub,...
-
Data Pipeline Expert
1 week ago
Pune, Maharashtra, India beBeeData Full time ₹ 1,00,00,000 - ₹ 2,00,00,000As a Technical Specialist, you will play a pivotal role in designing, implementing, and managing data pipelines using Azure Data Factory.You will work closely with clients to understand their data needs and requirements, providing support and training on data tools and solutions.The ideal candidate will have 5-7 years of experience in data warehousing and...
-
Pune, Maharashtra, India beBeeDataEngineering Full time ₹ 45 - ₹ 65Job TitleA Technical Lead – Data Engineering position is available with expertise in Snowflake, SQL Server, and modern data architecture principles.This role will play a critical part in the TurboRater RQR: CPQ Rating initiative, leading the design and implementation of scalable, secure, and high-performance data pipelines that power rating and CPQ...
-
Senior Data Pipeline Specialist
2 weeks ago
Pune, Maharashtra, India beBeeDataEngineer Full time ₹ 15,00,000 - ₹ 25,00,000Job OverviewWe are seeking a seasoned Data Engineer to join our team. This role involves crafting and maintaining robust data pipelines using Python and SQL to ensure efficient extraction, transformation, and loading (ETL) of data.The ideal candidate will have expertise in building and optimizing data pipelines to facilitate seamless data flow across systems...
-
Data Pipeline Architect
2 weeks ago
Pune, Maharashtra, India beBeeData Full time ₹ 1,80,00,000 - ₹ 2,50,00,000Senior Data Engineer - AWS ExpertWe are seeking a seasoned professional to spearhead the design, development, and deployment of end-to-end data pipelines on AWS cloud infrastructure.Key Responsibilities:Design scalable data processing workflows using Apache Spark and SQL for analytics and reporting requirements.Build and maintain orchestration workflows to...