
Big Data Pipeline Architect
2 days ago
Job Description:
We are seeking a highly skilled Senior Data Engineer to develop, construct, test and maintain data acquisition pipelines for large volumes of structured and unstructured data.
The ideal candidate will have experience in building large and complex datasets based on business requirements, as well as constructing 'big data' pipeline architecture.
Responsibilities include identifying opportunities for data acquisition via working with stakeholders and business clients, translating business needs to technical requirements, and leveraging various tools in the Google Cloud Ecosystem.
The Senior Data Engineer will use logs & alerts to effectively monitor pipelines, utilize SAP SLT to replicate SAP tables to Google Cloud using SLT, develop JSON messaging structure for integrating with various applications, and leverage DevOps and CI/CD practices to ensure the reliability and scalability of data pipelines.
In addition, the successful candidate will partition/cluster and retrieve content in Big Query, use IAM roles & Policy Tags to secure the data, design and build an ingestion pipeline using Rest API, and recommend ways to improve data quality, reliability, and efficiency.
Required Skills and Qualifications:
- At least 4+ years of experience in a GCP data engineering role.
- Hands-on experience in GCP tools including Python, SQL, Data Flow, DataStream, CDC (Change Data Capture), Cloud Functions, Cloud Run, Pub Sub, BigQuery, Cloud Storage.
-
Big Data Solutions Architect
7 days ago
Nagpur, Maharashtra, India beBeeData Full time ₹ 15,00,000 - ₹ 25,00,000Job OpportunityWe are seeking a highly skilled Big Data Solutions Architect to design, develop and implement scalable big data solutions.The ideal candidate will have strong expertise in big data technologies including Spark, Scala, Hadoop and Unix commands. Experience with Cloudera and real-time data processing platforms would be beneficial.The successful...
-
Data Pipeline Architect
7 days ago
Nagpur, Maharashtra, India beBeeData Full time ₹ 15,00,000 - ₹ 20,00,000Big Data SpecialistAs a Snowflake Big Data Specialist, you will be designing and developing data pipelines, models, and transformations using Snowflake's scalable cloud-based platform. You will work on building ETL/ELT pipelines, optimizing micro-partitioning, implementing real-time ingestion, and integrating data lakes.Develop complex SQL queries with...
-
Senior Data Pipeline Architect
4 days ago
Nagpur, Maharashtra, India beBeeData Full time ₹ 1,50,00,000 - ₹ 2,00,00,000Senior Data Pipeline ArchitectWe are seeking an experienced data professional to lead the design and development of our scalable data pipelines using GCP tools.10+ years of experience in designing, developing, and maintaining complex data pipelines for both batch and real-time processing.Strong understanding of GCP services including Big Query, Cloud...
-
Chief Big Data Architect
7 days ago
Nagpur, Maharashtra, India beBeeCloudDataEngineer Full time ₹ 1,50,00,000 - ₹ 2,10,00,000Big Data ExpertJob OverviewA seasoned professional with a strong background in big data technologies is required to spearhead the development and implementation of cutting-edge solutions.Key ResponsibilitiesDesign and develop scalable architectures for big data processing using Hadoop, Spark, and No-SQL databases.Collaborate with cross-functional teams to...
-
Big Data Engineer
1 week ago
Nagpur, Maharashtra, India Naukri E Hire Campaign Full time ₹ 9,00,000 - ₹ 12,00,000 per yearRole- Big dataExperience- 3 to 5 yrsLocation- NagpurInterview mode- 2 Virtual roundNotice period- 30 daysInterview date- 23rd AugJob Summary:We are looking for a skilled Big Data Developer with strong expertise in Apache Spark, Scala, and Linux to join our dynamic data engineering team. The ideal candidate will design, develop, and maintain big data...
-
Big Data Developer
4 days ago
Nagpur, Maharashtra, India Naukri E Hire Campaign Full time ₹ 9,00,000 - ₹ 12,00,000 per yearRoles and Responsibilities :Design, develop, test, deploy and maintain large-scale big data solutions using Scala and Spark.Collaborate with cross-functional teams to gather requirements and deliver high-quality software products.Troubleshoot complex issues related to big data processing pipelines and provide timely resolutions.Stay up-to-date with industry...
-
Big Data Professional
6 days ago
Nagpur, Maharashtra, India beBeeData Full time ₹ 20,00,000 - ₹ 25,00,000Big Data EngineerDesign and implement large-scale data processing systems using big data technologies.Develop scalable data pipelines using Spark, Scala, and Linux-based Hadoop Ecosystem.Implement real-time data processing platforms using Spark Streaming and Kafka.Collaborate with cross-functional teams to identify technical requirements.Ensure high-quality...
-
Senior Data Architect Role
5 days ago
Nagpur, Maharashtra, India beBeeData Architect Full time ₹ 18,00,000 - ₹ 25,00,000Data Architecture PositionWe are seeking a skilled data architect to design and implement data architectures that support business growth. This individual will work with cross-functional teams to build reliable datasets.
-
Chief Data Pipeline Architect
7 days ago
Nagpur, Maharashtra, India beBeeDataEngineer Full time ₹ 15,00,000 - ₹ 20,00,000Role Overview:We are seeking a highly skilled Data Engineer with expertise in designing, developing, and maintaining large-scale data pipelines and infrastructure.Your key responsibilities will include architecting and implementing data pipelines using Azure Data Factory and Databricks to support the ingestion, transformation, and movement of data.You will...
-
Big Data Architect
6 days ago
Nagpur, Maharashtra, India beBeeDataEngineer Full time ₹ 20,00,000 - ₹ 30,00,000About People Prime Worldwide was removed to focus on job requirements. We provide digital engineering and technology services to companies worldwide.Job Title : GCP Big Data EngineerKey Skills : PySpark , Airflow , SQL , GCPWe are seeking a seasoned professional with extensive experience in Big Data technologies and Google Cloud Platform services to design...