Current jobs related to Senior Pipeline Developer - Thāne, Maharashtra - beBeeDataEngineer
-
Thāne, Maharashtra, India beBeeData Full time ₹ 1,50,00,000 - ₹ 2,50,00,000Senior Data Engineer PositionWe are seeking a seasoned Senior Data Engineer to drive large-scale data pipeline design, development, and maintenance on Google Cloud Platform.Key Responsibilities:Design and develop robust ETL pipelines using GCP services such as Cloud Storage, Pub/Sub, Dataflow, and BigQuery.Develop and maintain complex data processing...
-
Senior Pipeline Systems Specialist
1 week ago
Thāne, Maharashtra, India beBeePipeline Full time ₹ 20,00,000 - ₹ 30,00,000Job Title:Skip to Job DetailsPosition Overview:We are seeking a highly skilled and experienced Pipeline Systems Specialist to lead the conceptual and detailed engineering of large-scale pipeline projects across Argentina and beyond.Main Responsibilities:Develop and oversee the design and engineering of pipelines for gas, oil, water, slurry, etc.Review and...
-
Data Pipeline Architect
1 week ago
Thāne, Maharashtra, India beBeeDataEngineering Full time ₹ 1,50,00,000 - ₹ 2,00,00,000Job Title: Senior Data EngineerAbout the Role:Our company seeks a skilled data engineer to create robust data pipelines and drive business strategy.Key Responsibilities:Develop and refine complex ETL pipelines for processing high volumes of data.Ensure data precision, coherence, and system performance.Collaborate with architects, analysts, and stakeholders...
-
Pipeline Designer
1 week ago
Thāne, Maharashtra, India Domnic Lewis Full timePosition Summary We are looking for a skilled professional with 10 to 15 years of experience in pipeline and piping projects The ideal candidate should have a background in design or surveying with strong technical knowledge and hands-on experience using industry-standard tools Key Responsibilities Prepare pipeline drawings including...
-
Senior AI Developer
2 weeks ago
Thāne, Maharashtra, India beBeeAi Full time ₹ 2,00,00,000 - ₹ 2,40,00,000Senior AI EngineerWe are seeking a highly skilled Senior AI Engineer to join our team and contribute to the development of cutting-edge AI technology.Job Description:The successful candidate will be responsible for designing, developing, and deploying scalable ML pipelines that can automate media content creation and localization across India's diverse...
-
Pipeline Engineering Specialist
1 week ago
Thāne, Maharashtra, India beBeePipelineEngineering Full time ₹ 90,00,000 - ₹ 1,20,00,000Job Title: Pipeline Engineering SpecialistWe are seeking a highly skilled pipeline engineer with extensive experience in design, construction and maintenance of pipelines.About the Role:Design and develop pipeline systems, including plan and profile views, and details for special crossings.Review and verify detailed engineering deliverables to ensure...
-
Senior Data Pipeline Architect
1 week ago
Thāne, Maharashtra, India beBeeDataEngineering Full time ₹ 18,00,000 - ₹ 25,00,000Job Title">Data Engineer Leader - Azure SolutionsWe are seeking an experienced Data Engineer with a strong background in designing, developing and managing data pipelines and transformation frameworks.The ideal candidate will have hands-on experience with Azure Data Factory (ADF), Azure Databricks, Azure Synapse Analytics and Apache Kafka. They will also...
-
Senior Data Pipeline Specialist
1 week ago
Thāne, Maharashtra, India beBeeDataEngineer Full time ₹ 1,50,00,000 - ₹ 2,00,00,000Job DescriptionAs a key member of our data engineering team, you will play a pivotal role in designing and implementing robust data pipelines to drive business growth.You will work closely with cross-functional teams to ensure seamless integration of data solutions across the organization.Our ideal candidate will possess strong SQL skills, experience with...
-
Senior AI Software Developer
2 weeks ago
Thāne, Maharashtra, India beBeeArtificial Full time ₹ 20,00,000 - ₹ 25,00,000Job Opportunity: Senior AI EngineerWe are seeking a highly skilled and experienced Senior AI Engineer to join our organization.The ideal candidate will have a strong understanding of software development and a proven track record of working with Python, designing, developing, and maintaining scalable backend services and APIs using Python/Fast API and...
-
Thāne, Maharashtra, India beBeeDataEngineeringLeader Full time ₹ 24,00,000 - ₹ 30,20,000Job Title: Data Engineering Testing LeaderOverview:As a seasoned testing professional, you will lead comprehensive testing strategy and execution for complex data engineering pipelines and product delivery initiatives. You will drive quality assurance across integrated systems, data workflows, and customer-facing applications while coordinating...
Senior Pipeline Developer
2 weeks ago
Job Title: Data Engineer
We are seeking an experienced professional to build scalable pipelines, work with streaming data, and collaborate with data scientists and stakeholders to deliver high-quality solutions.
Key Responsibilities:
- Design and optimize data pipelines and ETL workflows.
- Manage and process large datasets using Spark, PySpark, and SQL.
- Build and maintain real-time streaming applications with Spark Streaming/Kafka.
- Collaborate with data scientists and product teams to integrate AI/ML models into production.
- Ensure data quality, scalability, and performance in all pipelines.
- Deploy and manage Spark workloads on cloud platforms (AWS, Azure, GCP, Databricks).
- Automate testing and deployment of Spark jobs via CI/CD pipelines.
Requirements:
- Bachelor's/Master's degree in Computer Science or related field.
- Minimum 4 years of professional experience as a Data Engineer.
- Strong expertise in Python, Spark, PySpark.
- Hands-on experience with Spark SQL, DataFrames, UDFs, DAG execution.
- Knowledge of data ingestion tools (Kafka, Flume, Kinesis) and data formats (Parquet, Avro, ORC).
- Proficiency in Airflow/Prefect for scheduling and orchestration.
- Familiarity with performance tuning in Spark (partitioning, caching, broadcast joins).
- Experience deploying on Databricks, AWS EMR, Azure HDInsight, or GCP Dataproc.
- Exposure to testing and CI/CD for data pipelines (pytest, Jenkins, GitHub Actions).
What We Offer:
- Onshore benefits according to market standards.
