![Intraedge Technologies Ltd.](https://media.trabajo.org/img/noimg.jpg)
Big Data Engineer
3 weeks ago
Job Description :
We are seeking a skilled Big Data GCP Engineer to join our team. The ideal candidate will have substantial experience with Google Cloud Platform (GCP) and a strong background in Big Data technologies. This role involves working with various GCP services and tools to design, develop, and optimize data processing pipelines and workflows.
Key Responsibilities :
GCP Data Engineering :
- Design, implement, and maintain data processing pipelines using GCP services such as BigQuery, DataProc, Airflow, Cloud Composer, and GCP Hydra Services.
- Optimize and manage data storage and retrieval processes to ensure efficient performance and cost-effectiveness.
Big Data Technologies :
- Utilize Hive, PySpark, and Python to develop and manage Big Data solutions.
- Implement data transformations, aggregations, and data enrichment processes.
Data Pipeline Development :
- Develop and maintain ETL processes to integrate and process large datasets from various sources.
- Ensure data quality, reliability, and security in all data processing activities.
Workflow Automation :
- Use Airflow and Cloud Composer to automate data workflows and orchestrate complex data processing tasks.
- Monitor and troubleshoot data pipelines to ensure smooth and uninterrupted operations.
Performance Optimization:
- Optimize data processing jobs for performance and scalability.
- Implement best practices for data storage, indexing, and partitioning in BigQuery and other GCP services.
Collaboration and Support :
- Work closely with data scientists, analysts, and other stakeholders to understand data requirements and deliver effective solutions.
- Provide technical support and troubleshooting for data-related issues.
Documentation and Best Practices :
- Maintain comprehensive documentation of data pipelines, workflows, and processes.
- Adhere to industry best practices and standards in Big Data and cloud engineering.
Required Skills and Qualifications :
- Education: Bachelor's degree in Computer Science, Information Technology, or a related field.
Experience :
- 3+ years of hands-on experience with GCP services such as BigQuery, DataProc, Airflow, Cloud Composer, and GCP Hydra Services.
- 3-8 years of experience in Big Data engineering.
Technical Skills :
- Proficient in Hive, PySpark, and Python.
- Strong understanding of data warehousing concepts and best practices.
- Experience with cloud data optimization and cost management.
Soft Skills :
- Strong problem-solving and analytical skills.
- Excellent communication skills, both verbal and written.
- Ability to work effectively in a team-oriented, collaborative environment.
Personal Attributes :
- Self-motivated, proactive, and able to work independently.
- Strong attention to detail and commitment to delivering high-quality solutions.
-
Big Data Engineer
6 days ago
Bangalore/Gurgaon/Gurugram, India HR BIZ HUB Full timeJob Title : Big Data DeveloperJob Description : Bachelor's degree in Engineering or Computer Science or equivalent OR Master's in Computer Applications or equivalent. Solid Experience of software development experience and leading teams of engineers and scrum teams. 4+ years of handson experience of working with Map-Reduce, Hive, Spark (core, SQL and...
-
Big Data Engineer
6 days ago
Gurgaon, Haryana, India Intraedge Technologies Ltd. Full timeJob Description :We are seeking a skilled Big Data GCP Engineer to join our team. The ideal candidate will have substantial experience with Google Cloud Platform (GCP) and a strong background in Big Data technologies. This role involves working with various GCP services and tools to design, develop, and optimize data processing pipelines and workflows.Key...
-
Gurgaon/Gurugram, India Paisabazaar.com Full timeJob Description : Qualifications for Data Engineer : 3+ Years of experience in building and optimizing 'big data' solutions required to fulfill business and technology requirements. 3+ years of technical expertise in areas of design and implementation using big data technology Hadoop, Hive, Spark, Python/Java. Strong analytic skills to understand...
-
Paisabazaar - Data Engineer - Big Data Technologies
2 months ago
Gurgaon/Gurugram, India Paisabazaar.com Full timeJob Description : Qualifications for Data Engineer : 3+ Years of experience in building and optimizing 'big data' solutions required to fulfill business and technology requirements. 3+ years of technical expertise in areas of design and implementation using big data technology Hadoop, Hive, Spark, Python/Java. Strong analytic skills to understand...
-
Big Data Engineer
6 days ago
Gurgaon, Haryana, India virtusa consulting services pvt. ltd. Full timeApply for Big Data Engineer, Career Progress Consultants in Gurgaon for 6 - 9 Year of Experience on
-
Big Data Engineer
2 weeks ago
Gurgaon, Haryana, India virtusa consulting services pvt. ltd. Full timeApply for Big Data Engineer, Career Progress Consultants in Gurgaon for 6 - 9 Year of Experience on
-
Big Data Engineer
2 weeks ago
Gurgaon, India virtusa consulting services pvt. ltd. Full timeApply for Big Data Engineer, Career Progress Consultants in Gurgaon for 6 - 9 Year of Experience on TimesJobs.com.
-
Big Data Developer
6 days ago
Gurgaon, Haryana, India Workassist Full timeOur hiring partner is looking for :This is a full-time on-site role for a Big Data Developer at Big Four Consulting Firm Gurugram. The Big Data Developer will be responsible for tasks related to Data Engineering, Extract Transform Load (ETL), Big Data, Data Warehousing, and Software Data Engineering, Big Data, Extract Transform Load (ETL), and Data...
-
Big Data Engineer
4 weeks ago
Gurgaon/Gurugram, IN Intraedge Technologies Ltd. Full timeJob Description :We are seeking a skilled Big Data GCP Engineer to join our team. The ideal candidate will have substantial experience with Google Cloud Platform (GCP) and a strong background in Big Data technologies. This role involves working with various GCP services and tools to design, develop, and optimize data processing pipelines and workflows.Key...
-
Big Data Engineer
3 weeks ago
Gurgaon/Gurugram, IN Intraedge Technologies Ltd. Full timeJob Description :We are seeking a skilled Big Data GCP Engineer to join our team. The ideal candidate will have substantial experience with Google Cloud Platform (GCP) and a strong background in Big Data technologies. This role involves working with various GCP services and tools to design, develop, and optimize data processing pipelines and workflows.Key...
-
Big Data Engineer
6 days ago
Gurgaon, Haryana, India Chiselon Technologies Pvt Ltd Full time# Hiring Alert #We are looking for Immediate Joiners Skills:Big Data with GCP GCP; Hive; PySpark; Python GCP Data Engineer with hands-on experience of 3+ years in Big Query, Data Proc, Airflow, Cloud Composer, GCP Hydra Services, Cloud Data Optimization "Join us and become an integral part of our success story. Apply today and let's achieve great things...
-
Big Data Engineer
4 weeks ago
gurugram, India OmegaHires Full timeJob Title: Big Data Engineer Duration: Full-time on OmegaHires Payroll Location: Gurugram (Should be located near NCR to attend office for 3 days a week) Should understand the Credit Card domain and good to have knowledge on Compliance & Operational Risk . Good analytics experience to do data discovery, analyze the gaps in data, partner with Data...
-
Big Data Developer
6 days ago
Gurgaon, Haryana, India Rocket Consulting Full timeBig Data EngineerPosition Overview :We are seeking a skilled Big Data Engineer to join our dynamic team. The ideal candidate will have expertise in designing, implementing, and maintaining large-scale data processing systems using cutting-edge technologies. As a Big Data Engineer, you will play a key role in building and optimizing data pipelines, data...
-
Big Data Engineer
6 days ago
Gurgaon, Haryana, India OmegaHires Full timeJob Title:Big Data Engineer Duration: Full-time on OmegaHires Payroll Location: Gurugram (Should be located near NCR to attend office for 3 days a week) Should understand the Credit Card domain and good to have knowledge on Compliance & Operational Risk . Good analytics experience to do data discovery, analyze the gaps in data, partner with Data Owners,...
-
Big Data Developer
2 months ago
Gurgaon/Gurugram, IN Rocket Consulting Full timeBig Data EngineerPosition Overview :We are seeking a skilled Big Data Engineer to join our dynamic team. The ideal candidate will have expertise in designing, implementing, and maintaining large-scale data processing systems using cutting-edge technologies. As a Big Data Engineer, you will play a key role in building and optimizing data pipelines, data...
-
Big Data Developer
2 months ago
Gurgaon/Gurugram, India Rocket Consulting Full timeBig Data EngineerPosition Overview :We are seeking a skilled Big Data Engineer to join our dynamic team. The ideal candidate will have expertise in designing, implementing, and maintaining large-scale data processing systems using cutting-edge technologies. As a Big Data Engineer, you will play a key role in building and optimizing data pipelines, data...
-
Manager - Data Engineering - Big Data/Azure
6 days ago
Gurgaon, Haryana, India Publicis Sapient Full timeJob Description : As Manager, Data Engineering, you will be responsible for translating client requirements into design, architecting, and implementing Azure Cloud based big data solutions for clients. Your role will be focused on delivering high quality solutions by independently driving design discussions related to Data Ingestion, Transformation &...
-
Senior Data Engineer
4 weeks ago
Gurgaon/Gurugram, IN Optivalue tek consulting Full timeCompany Description : OptiValueTek is a leading provider of IT solutions specializing in Application & Process Integration, API Management, Data Engineering, Data Science/MLOps, DevOps & SRE, Cloud Solutions, and Web/Mobile & Application Development. With a focus on innovation, we have developed in-house tools/accelerators for Test Automation, API...
-
Senior Data Engineer
3 weeks ago
Gurgaon/Gurugram, India Optivalue tek consulting Full timeCompany Description : OptiValueTek is a leading provider of IT solutions specializing in Application & Process Integration, API Management, Data Engineering, Data Science/MLOps, DevOps & SRE, Cloud Solutions, and Web/Mobile & Application Development. With a focus on innovation, we have developed in-house tools/accelerators for Test Automation, API...
-
Senior Data Engineer
4 weeks ago
Gurgaon/Gurugram, India Optivalue tek consulting Full timeCompany Description : OptiValueTek is a leading provider of IT solutions specializing in Application & Process Integration, API Management, Data Engineering, Data Science/MLOps, DevOps & SRE, Cloud Solutions, and Web/Mobile & Application Development. With a focus on innovation, we have developed in-house tools/accelerators for Test Automation, API...