
Big Data Architect Position
2 weeks ago
Job Title:
Cloud Engineer
Duration:
Long-term Contract
Location:
Remote/Offshore
Timing:
US work hours
Availability:
Immediate
The ideal candidate will have excellent communication skills and be able to develop, construct, test, and maintain data acquisition pipelines for large volumes of structured and unstructured data. This includes batch and real-time processing in Google Cloud.
To accomplish this task, the candidate should be able to build large and complex datasets based on business requirements, construct 'big data' pipeline architecture, and identify opportunities for data acquisition via working with stakeholders and business clients.
They must translate business needs to technical requirements, leverage various tools in the Google Cloud Ecosystem, and use logs & alerts to effectively monitor pipelines.
Key skills include using SAP SLT to replicate SAP tables to Google Cloud using SLT, developing JSON messaging structure for integrating with various applications, and leveraging DevOps and CI/CD practices to ensure the reliability and scalability of data pipelines.
In addition, the candidate should be able to partition/cluster and retrieve content in Big Query, use IAM roles & Policy Tags to secure the data, and design and build an ingestion pipeline using Rest API.
Finally, the candidate should be able to recommend ways to improve data quality, reliability, and efficiency.
- Required Skills: 5-7 years of experience in a data engineering role – with core GCP experience of 3-4 years.
- Work time will be in CST, until 2 am IST on most days.
- 1-2 times in a month, the resource might be needed to stretch their work hours by 1-2 hours.
-
Big Data Architect
2 weeks ago
Surat, Gujarat, India beBeeData Full time ₹ 20,00,000 - ₹ 30,00,000Big Data ArchitectWe are seeking a highly skilled Big Data Architect to design, build, and maintain large-scale data pipelines.Key Responsibilities:Design and implement robust data architectures using cloud-based technologies such as AWS Glue, Lambda, and DBT.Develop and optimize data models in Snowflake for high scalability and performance.Write efficient...
-
Big Data and Cloud Solutions Expert
2 weeks ago
Surat, Gujarat, India beBeeCloudDataArchitect Full time ₹ 15,00,000 - ₹ 30,00,000Role: Cloud and Big Data ArchitectWe are seeking skilled professionals to fill a key position as a Cloud and Big Data Architect.Key Responsibilities & Qualifications:
-
Big Data Solutions Architect
2 weeks ago
Surat, Gujarat, India beBeeData Full time ₹ 20,00,000 - ₹ 25,00,000Job Role: Data Information ArchitectKey Responsibilities:Communicate effectively with customers to ensure mutual understanding and satisfaction.Utilize expertise in big data technologies like Azure Databricks, Python/Scala/Spark/PySpark, HIVE, HBase, Impala, and Parquet to drive business outcomes.Apply strong SQL and RDBMS skills to analyze and optimize...
-
Big Data Engineer
2 weeks ago
Surat, Gujarat, India beBeeDataEngineer Full time ₹ 2,00,00,000 - ₹ 2,50,00,000Job Title: Big Data Solutions ArchitectWe are seeking a highly skilled professional to lead the design and implementation of scalable data engineering solutions. The ideal candidate will have strong hands-on experience in architecting and implementing complex data architectures leveraging AWS services.Key Responsibilities:Design, develop, and optimize big...
-
Senior Data Architect
1 week ago
Surat, Gujarat, India beBeeBigData Full time ₹ 2,00,00,000 - ₹ 2,50,00,000Senior Data ArchitectWe are seeking a highly skilled Senior Data Architect to design and develop scalable data pipelines using Big Data analytics platforms.Skill in designing and developing large-scale data architectures, particularly with Spark, Kafka, Glue, EMR, Hudi, Schema Registry, and Data Lineage is required.A successful candidate will have extensive...
-
Big Data Engineer
1 week ago
Surat, Gujarat, India beBeeData Full time ₹ 20,00,000 - ₹ 30,00,000As a Big Data Engineer, you will be responsible for developing scalable and efficient big data solutions using Hadoop, Spark, Hive, HDFS, and Kafka.This role requires strong expertise in big data technologies, excellent problem-solving skills, and effective communication with colleagues.The ideal candidate will have:8+ years of professional experience in big...
-
Senior Big Data Architect
2 weeks ago
Surat, Gujarat, India beBeeDataEngineer Full time ₹ 20,23,200 - ₹ 25,95,200Job ProfileWe are seeking a highly skilled professional to design, build, and maintain large-scale data processing systems.The ideal candidate will have a deep understanding of algorithms, data structures, and design patterns, as well as experience with data pipelines and data warehousing. You should be proficient in one or more programming languages such as...
-
Big Data Platform Manager
1 week ago
Surat, Gujarat, India beBeeDataiku Full time ₹ 2,00,00,000 - ₹ 2,50,00,000Big Data Platform Manager JobWe are seeking a highly skilled Big Data Platform Manager to join our team. This is a challenging role that requires expertise in managing big data platforms, including day-to-day operations, administration, and monitoring of components.Manage big data platforms with day-to-day operations including administration and monitoring...
-
Chief Data Pipeline Architect
2 weeks ago
Surat, Gujarat, India beBeeDataEngineer Full time ₹ 1,20,00,000 - ₹ 2,00,00,000Lead Data EngineerWe are seeking a skilled data engineer to drive initiatives and continuously improve our Data/AI Practice.Key Responsibilities:Design, build, and optimize data pipelines for large-scale structured and unstructured datasets.Implement ETL/ELT processes using SQL and modern big data frameworks.Collaborate with architects and governance leads...
-
Big Data Developer Role
2 weeks ago
Surat, Gujarat, India beBeeDataArchitect Full time US$ 1,80,000 - US$ 2,00,000Data Architect Position A leading organization is seeking a highly skilled data architect to design and implement scalable data platforms on Microsoft Azure. Key Responsibilities: Design and implement data architectures using Azure services such as Cosmos DB, Data Factory, and Databricks.Develop and maintain ETL processes using Azure Data Factory and Azure...