GCP Big Data Engineer
2 weeks ago
About the Role:
We are seeking a highly motivated and experienced Big Data Engineer to join our growing team in Chennai, Bangalore, or Gurgaon. In this role, you will play a key part in designing, developing, and managing our big data infrastructure on Google Cloud Platform (GCP). You will leverage your expertise in big data technologies and GCP services to build, deploy, and maintain scalable and reliable data pipelines for processing and analyzing large datasets.
Responsibilities:
- Design, develop, and implement big data solutions using GCP services like BigQuery, Cloud Dataflow, Cloud Dataproc, and Cloud Storage.
- Ingest, transform, and load (ETL) data from various sources into BigQuery for efficient data analysis.
- Looking for a Data Engineer with strong expertise in Python and Big Data concepts to build, optimize, and scale data processing pipelines and solutions.
- Develop and automate data pipelines using tools like Cloud Dataflow for large-scale data processing.
- Manage and optimize big data infrastructure on GCP to ensure scalability, performance, and cost-effectiveness.
- Configure and implement security best practices for big data storage and processing in GCP.
- Monitor and troubleshoot big data pipelines and identify areas for improvement.
- Work collaboratively with data scientists, analysts, and other engineers to translate data needs into technical solutions.
- Stay up-to-date with the latest advancements in big data technologies and GCP services.
Qualifications:
- 5+ years of experience in big data engineering or a related role.
- Proven experience in designing and developing big data solutions on the cloud (preferably GCP).
- Strong understanding of big data concepts (data lakes, data warehouses, distributed processing)
- Expertise in GCP services for big data processing (BigQuery, Cloud Dataflow, Cloud Dataproc).
- Experience with scripting languages like Python for data manipulation and automation.
- Experience with cloud storage solutions (e.g., Cloud Storage) a plus.
- Experience with data warehousing concepts and data modeling techniques (a plus).
- Excellent analytical and problem-solving skills.
- Strong communication and collaboration skills.
- Ability to work independently and as part of a team.
-
GCP Big Data Engineer
3 weeks ago
Chennai, India IntraEdge Full timeAbout the Role:We are seeking a highly motivated and experienced Big Data Engineer to join our growing team in Chennai, Bangalore, or Gurgaon. In this role, you will play a key part in designing, developing, and managing our big data infrastructure on Google Cloud Platform (GCP). You will leverage your expertise in big data technologies and GCP services to...
-
GCP Data Engineer
22 hours ago
Chennai, India Tata Consultancy Services Full timeGreetings from TCSTCS presents an excellent opportunity for GCP Data EngineerRelevant Experience (Yrs) :5-7 yrsRole: GCP Data EngineerLocation: ChennaiDesired Competencies (Technical/Behavioral Competency)Must-Have5+ years of strong experience in delivering Big Data solutions.Experience in developing and deploying big data pipelines in Cloud preferably...
-
Gcp Big Data Architect
3 months ago
Chennai, Tamil Nadu, India Tiger Analytics Full time-As an Architect, you will analyze, architect, design, and actively develop cloud data warehouses, data lakes, and other cloud-based data solutions in GCP. - Analyze, architect, design, and actively develop cloud data warehouses, data lakes, and other cloud-based data solutions in GCP. - GCP experts with strong experience in working with modern data...
-
GCP Data Engineer
2 days ago
Chennai, India Tata Consultancy Services Full timeGreetings from TCSTCS presents an excellent opportunity for GCP Data EngineerRelevant Experience (Yrs) :5-7 yrsRole: GCP Data EngineerLocation: ChennaiDesired Competencies (Technical/Behavioral Competency)Must-Have5+ years of strong experience in delivering Big Data solutions.Experience in developing and deploying big data pipelines in Cloud preferably GCP....
-
GCP Data Engineer
2 days ago
chennai, India Tata Consultancy Services Full timeGreetings from TCS TCS presents an excellent opportunity for GCP Data Engineer Relevant Experience (Yrs) :5-7 yrs Role: GCP Data Engineer Location: Chennai Desired Competencies (Technical/Behavioral Competency) Must-Have 5+ years of strong experience in delivering Big Data solutions. Experience in developing and deploying big data pipelines in Cloud...
-
GCP Data Engineer
16 hours ago
Chennai, India Tata Consultancy Services Full timeGreetings from TCSTCS presents an excellent opportunity for GCP Data EngineerRelevant Experience (Yrs) :5-7 yrsRole: GCP Data EngineerLocation: ChennaiDesired Competencies (Technical/Behavioral Competency)Must-Have5+ years of strong experience in delivering Big Data solutions.Experience in developing and deploying big data pipelines in Cloud preferably GCP....
-
Chennai, India GIT Infosys Full timeWe need a proficient and seasoned Big Data Engineer with GCP cloud expertise and Lumi tool migration for our client American Express, Chennai. Someone with at least 5+ years of experience and who can join in 2-3 weeks. ResponsibilitiesTools & Technologies: Big Data (Hadoop, HBase, Hive, etc.), GCP cloud expertise, Lumi tool migrationQualificationsBachelors...
-
Chennai, India GIT Infosys Full timeWe need a proficient and seasoned Big Data Engineer with GCP cloud expertise and Lumi tool migration for our client American Express, Chennai. Someone with at least 5+ years of experience and who can join in 2-3 weeks. ResponsibilitiesTools & Technologies: Big Data (Hadoop, HBase, Hive, etc.), GCP cloud expertise, Lumi tool migrationQualificationsBachelors...
-
GCP Data Engineer
4 weeks ago
Chennai, India Xebia Full timeEstablish scalable, efficient, automated processes for data analyses, model development, validation and implementationWork closely with data scientists and analysts to create and deploy new featuresWrite efficient and well-organized software to ship products in an iterative, continual release environmentMonitor and plan out core infrastructure...
-
GCP Data Engineer
1 week ago
Chennai, India Technogen, Inc. Full timeIf interested, please drop your resume to swarnalatha.m@technogenindia.comRole- Sr Engr Cslt-Data EngineeringLocation-ChennaiExp-6 to 8.5 yearsPrimary: SQL, GCP (BigQuery, Composer, Data Flow), Big Data (Spark/ Kafka/ Hive/ Pyspark)Secondary: Teradata (BTEQ, Performance Tuning), ESPx, Python, DevOps What we're looking for...You're curious about new...
-
GCP Data Engineer
23 hours ago
Chennai, India Tata Consultancy Services Full timeGreetings from TCSTCS presents an excellent opportunity for GCP Data EngineerRelevant Experience (Yrs) :5-7 yrsRole: GCP Data EngineerLocation: ChennaiDesired Competencies (Technical/Behavioral Competency)Must-Have5+ years of strong experience in delivering Big Data solutions.Experience in developing and deploying big data pipelines in Cloud preferably...
-
GCP Data Engineer
1 week ago
chennai, India Technogen, Inc. Full timeIf interested, please drop your resume to Sr Engr Cslt-Data EngineeringLocation-ChennaiExp-6 to 8.5 yearsPrimary: SQL, GCP (BigQuery, Composer, Data Flow), Big Data (Spark/ Kafka/ Hive/ Pyspark)Secondary: Teradata (BTEQ, Performance Tuning), ESPx, Python, DevOpsWhat we're looking for...You're curious about new technologies and the game-changing...
-
GCP Data Engineer
4 weeks ago
Chennai, India Xebia Full timeEstablish scalable, efficient, automated processes for data analyses, model development, validation and implementation Work closely with data scientists and analysts to create and deploy new features Write efficient and well-organized software to ship products in an iterative, continual release environment Monitor and plan out core infrastructure...
-
GCP Data Engineer
4 weeks ago
Chennai, India Xebia Full timeEstablish scalable, efficient, automated processes for data analyses, model development, validation and implementationWork closely with data scientists and analysts to create and deploy new featuresWrite efficient and well-organized software to ship products in an iterative, continual release environmentMonitor and plan out core infrastructure...
-
Senior Data Engineer
3 days ago
Chennai, India Trinity Technology solutions Full timeWe're seeking a highly skilled and experienced Senior Data Engineer to join our team! You will play a pivotal role in designing, developing, and deploying robust data pipelines and data warehouse solutions leveraging Google Cloud Platform (GCP). You will leverage your expertise in big data technologies like Hadoop, Spark, and Airflow to build scalable...
-
GCP Architect
2 weeks ago
Chennai, India Tech Mahindra Full timeHi All,Greetings from Tech Mahindra.We are hiringGCP Architects for Chennai Location . JD is below. If you are interested kindly apply with your updated profileGCP Certification is mandatory (Either GCP Data Engineer or GCP Cloud Architect)• 12+ years of experience in Architecting Data projects and knowledge of multiple ETL tools (like Informatica, Talend,...
-
GCP Architect
3 weeks ago
Chennai, India Tech Mahindra Full timeHi All,Greetings from Tech Mahindra.We are hiring GCP Architects for Chennai Location. JD is below. If you are interested kindly apply with your updated profile GCP Certification is mandatory (Either GCP Data Engineer or GCP Cloud Architect)• 12+ years of experience in Architecting Data projects and knowledge of multiple ETL tools (like Informatica,...
-
GCP Architect
2 weeks ago
Chennai, India Tech Mahindra Full timeHi All, Greetings from Tech Mahindra. We are hiring GCP Architects for Chennai Location . JD is below. If you are interested kindly apply with your updated profile GCP Certification is mandatory (Either GCP Data Engineer or GCP Cloud Architect) • 12+ years of experience in Architecting Data projects and knowledge of multiple ETL tools (like Informatica,...
-
Data Engineer IV
1 month ago
Chennai, India Sadup Softech Full timeMust have skills :- Minimum of 5-7 years of experience in software development, with a focus on Java and infrastructure tools.- Min 6+ years of experience as a Data Engineer.- Good Experience in handling Big Data Spark, Hive SQL, BigQuery, SQL.- Candidate worked on cloud platforms and GCP would be an added advantage.- Good understanding of Hadoop based...
-
Big Data Architect
3 months ago
Chennai, Tamil Nadu, India RiskInsight Consulting Pvt Ltd Full time**Responsibilities**: - Design and architect Big Data solutions to meet business requirements. - Collaborate with stakeholders to understand their data and analytics needs. - Create and maintain data models, data flow diagrams, and data integration strategies. - Develop and implement data ingestion, processing, and storage solutions using Big Data...