
Cloud Data Engineer Position for Large-Scale Data Systems
14 hours ago
We are seeking a highly skilled professional to lead the design, development, and maintenance of large-scale data processing systems using Google Cloud Platform (GCP) and BigQuery. The ideal candidate will possess expertise in SQL database management and query writing.
Key Responsibilities:
- Design and implement scalable data processing systems using GCP services including BigQuery and Cloud Storage.
- Collaborate with cross-functional teams to integrate data storage solutions and ensure seamless data flow.
- Implement data ingestion pipelines using Cloud Pub/Sub and Apache Airflow.
Requirements:
- Strong understanding of GCP services, particularly BigQuery, Cloud Storage, and Cloud Pub/Sub.
- Experience with workflow management using Apache Airflow and Cloud Composer.
- Proficiency in SQL database management and query writing.
The successful candidate will have excellent problem-solving skills, be able to work in a fast-paced environment, and possess strong communication skills.
The role requires a deep understanding of cloud-based technologies, data engineering principles, and software development best practices.
Preferred qualifications include experience with cloud migration strategies, containerization using Docker, and automation using Ansible or Terraform.
-
Coimbatore, Tamil Nadu, India beBeeEngineering Full time ₹ 20,00,000 - ₹ 25,00,000Lead Data EngineerAbout the Role:We are seeking an experienced data engineer with expertise in Big Data platforms, Microsoft Azure, and Databricks. The ideal candidate will lead a team of talented engineers to design and deliver scalable data pipelines and analytics platforms, ensuring high performance, reliability, and security in a cloud-native...
-
Expert in Large Scale Data Management
4 days ago
Coimbatore, Tamil Nadu, India beBeeDataEngineer Full time US$ 90,000 - US$ 1,40,000Senior Data EngineerOverview:As a seasoned data engineer, you will play a pivotal role in designing and implementing large-scale data pipelines using Python and Pandas.Develop scalable ETL workflows to process and transform massive datasets.Collaborate with cross-functional teams to architect and implement data warehousing solutions using Hive SQL.Optimize...
-
Senior Big Data Engineer Position
8 hours ago
Coimbatore, Tamil Nadu, India beBeeBigData Full time ₹ 20,00,000 - ₹ 25,00,000Big Data Engineering OpportunityWe are seeking a highly skilled Big Data Engineer to design and develop scalable data processing systems using cutting-edge technologies.Design and implement large-scale data processing architectures using Big Data tools and technologiesCollaborate with cross-functional teams to integrate data solutions with existing...
-
Senior Cloud Data Architect
14 hours ago
Coimbatore, Tamil Nadu, India beBeeDataEngineer Full time ₹ 1,20,00,000 - ₹ 2,00,00,000Cloud Data Engineer PositionWe are seeking an experienced professional to design and implement scalable data engineering solutions using Google Cloud Platform (GCP) services.Data Pipeline Design: Create, build, and optimize data pipelines using BigQuery, Dataflow, DataProc, and Cloud Composer.Big Data Analytics Solutions: Implement Big Data Analytics...
-
Data Engineer
1 hour ago
Coimbatore, Tamil Nadu, India Incept Labs Full timePosition: Software Engineer (Data)Location: Remote, IndiaAt Incept Labs, we believe the future of education and research lies in humans and AI workingtogether side by side. AI brings the ability to process knowledge at scale, while peoplecontribute imagination, values, and lived experience. When combined, they create a partnershipwhere each strengthens the...
-
Advanced Data Systems Developer
5 days ago
Coimbatore, Tamil Nadu, India beBeeDataEngineer Full time ₹ 15,00,000 - ₹ 25,00,000Job Title: Data Engineer - Apache RayOverview: We are seeking a skilled Data Engineer to lead large-scale data processing systems.Key Responsibilities:Apache Ray Expertise: In-depth understanding of Ray and its applications in cloud environments.Cloud Operations: Manage, monitor, and troubleshoot all aspects of production and non-production environments on...
-
Senior Cloud Data Specialist
1 week ago
Coimbatore, Tamil Nadu, India beBeeDataEngineer Full time ₹ 2,00,00,000 - ₹ 2,50,00,000We are seeking a seasoned data engineer to develop large-scale data platforms on the Google Cloud.Key Responsibilities:Create robust data pipelines for ingestion, transformation and analytics using cloud-based toolsA strong understanding of the GCP ecosystem is requiredWork with big data tools such as Hadoop, Spark and Kafka
-
Cloud Data Engineer
5 days ago
Coimbatore, Tamil Nadu, India beBeeData Full time ₹ 1,50,00,000 - ₹ 2,00,00,000Cloud Data Engineer PositionWe are looking for a highly skilled and experienced Cloud Data Engineer to join our team. As a key member of our data engineering team, you will play a crucial role in designing, implementing, and optimizing data pipelines using cloud-based technologies.Your primary responsibility will be to develop, maintain, and optimize...
-
Advanced Data Systems Developer
1 week ago
Coimbatore, Tamil Nadu, India beBeeDataEngineer Full time ₹ 10,00,000 - ₹ 12,00,000Job Title: Data EngineerWe are seeking a skilled Data Engineer for a contract role. This is an exciting opportunity to work with cutting-edge technologies and contribute to the growth of our organization.Responsibilities:Design, develop, and maintain large-scale data systems on cloud platforms.Work with advanced tools to optimize data processing and improve...
-
Data Engineer
4 weeks ago
Coimbatore, Tamil Nadu, India hirezy Full timeKey Responsibilities :- Design, develop, and maintain high-performance ETL and real-time data pipelines using Apache Kafka and Apache Flink.- Build scalable and automated MLOps pipelines for training, validation, and deployment of models using AWS SageMaker and associated services.- Implement and manage Infrastructure as Code (IaC) using Terraform to...