Cloud Data Engineer with Hadoop Experience
14 hours ago
Cloud Data Engineer at Prodapt
About the RoleWe are seeking a highly skilled Cloud Data Engineer to join our team. As a Cloud Data Engineer, you will be responsible for designing, building, and maintaining large-scale data processing systems on cloud platforms such as Google Cloud.
You will work closely with cross-functional teams to develop and implement data solutions that meet business needs. This includes creating datasets, compute projects, Hive tables, GCS buckets, and service accounts, as well as granting access to these resources.
A key aspect of this role is ensuring the reliability and performance of cloud platforms, monitoring their health, and identifying issues proactively. You will also develop frameworks to automate platform administration and monitoring tasks, as well as scripts to automate reports and maintenance activities.
RequirementsTo succeed in this role, you will need:
- At least 6+ years of experience in Big Data technologies and 4-5 years of experience in Hadoop platforms.
- Good experience in Level 2, 3 support for performing hot fixes and dealing with platform issues.
- Experience working with Google Cloud or other cloud platforms is a plus.
- Strong knowledge of Hadoop architecture, hardware specifications, and performance benchmarking.
- Excellent Unix skills and good knowledge of networking architecture and datacenter issues.
- Experience in tool integration, automation, and configuration management in GIT and Jira platforms.
- Proficiency in writing shell scripts, automating scripts, and designing scheduler processes.
- Ability to understand Python/Scala/Java programs and debug issues.
- Excellent oral, written communication, and presentation skills, analytical, and problem-solving skills.
- Self-driven, ability to work independently and as part of a team.
The estimated annual salary for this role is $120,000 - $180,000, depending on location and experience.
About UsProdapt is a leading provider of digital transformation solutions to the telecom and technology industries. We are committed to helping our clients succeed in a rapidly changing market by leveraging our expertise in data analytics, artificial intelligence, and cloud computing.
-
AWS Data Engineer
4 weeks ago
india Vantage Point Consulting Inc. Full timeAWS Data Engineer - Hadoop MigrationLocation: Chennai or BengaluruRole Type: Full-TimeWe’re seeking a skilled AWS Principal Data Architect to lead the migration of Hadoop DWH workloads from on-premise to AWS EMR. Join our team and help design and optimize scalable, secure, and resilient cloud data architectures for enterprise data processing.Key...
-
Big Data
3 months ago
india Myananta Technologies Full timeAt Myananta Technologies, we’re looking for a Big Data (Hadoop). The ideal candidate is excited by experimentation and looking for a new challenge that stretches their talents. Job descriptionFull-Time Big Data (Hadoop) DeveloperMyananta Technologies | Gurugram is hiring for “Big Data (Hadoop) Developer” Experience: 3 - 5 Years.Salary: 5.0 - 12.0...
-
Hadoop Developer for Data Engineering Team
14 hours ago
India Coffeee Full timeWe are seeking an experienced Hadoop developer to join our innovative team at Coffeee. As a Senior Hadoop Developer, you will play a key role in designing and implementing scalable big data solutions using the Hadoop ecosystem.Our ideal candidate has hands-on experience with Hadoop tools such as HDFS, Hive, and Pig. Proficiency in Spark and Scala for data...
-
Aws data engineer
2 weeks ago
India ITI Data Full timeJob Description We are looking for an AWS Data with primary skills on Py Spark development who will be able to design and build solutions for one of our Fortune 500 Client programs, which aims towards building an Enterprise Data Lake on AWS Cloud platform, build Data pipelines by developing several AWS Data Integration, Engineering & Analytics resources....
-
ITI Data | PySpark Data Engineer
17 hours ago
india ITI Data Full timeLocation : IndiaType : Full-timeExperience : 10 – 13 years Functions : Consulting, Finance, Information Technology, Big Data Engineering Industries : Capital Markets, Investment Banking, Alternative Investments, Financial Services, Management Consulting, Information Technology and Services, HealthcareJob DescriptionWe are looking for a PySpark solutions...
-
AWS Data Engineer
4 months ago
India ITI Data Full timeJob Description We are looking for an AWS Data with primary skills on PySpark development who will be able to design and build solutions for one of our Fortune 500 Client programs, which aims towards building an Enterprise Data Lake on AWS Cloud platform, build Data pipelines by developing several AWS Data Integration, Engineering & Analytics resources....
-
AWS Data Engineer
4 months ago
India ITI Data Full timeJob DescriptionWe are looking for an AWS Data with primary skills on PySpark development who will be able to design and build solutions for one of our Fortune 500 Client programs, which aims towards building an Enterprise Data Lake on AWS Cloud platform, build Data pipelines by developing several AWS Data Integration, Engineering & Analytics resources. There...
-
AWS Data Engineer
1 month ago
india ITI Data Full timeJob Description We are looking for an AWS Data with primary skills on PySpark development who will be able to design and build solutions for one of our Fortune 500 Client programs, which aims towards building an Enterprise Data Lake on AWS Cloud platform, build Data pipelines by developing several AWS Data Integration, Engineering & Analytics resources....
-
AWS Data Engineer
4 weeks ago
India ITI Data Full timeJob Description We are looking for an AWS Data with primary skills on PySpark development who will be able to design and build solutions for one of our Fortune 500 Client programs, which aims towards building an Enterprise Data Lake on AWS Cloud platform, build Data pipelines by developing several AWS Data Integration, Engineering & Analytics resources....
-
AWS Data Engineer
3 months ago
India ITI Data Full timeJob Description We are looking for an AWS Data with primary skills on PySpark development who will be able to design and build solutions for one of our Fortune 500 Client programs, which aims towards building an Enterprise Data Lake on AWS Cloud platform, build Data pipelines by developing several AWS Data Integration, Engineering & Analytics resources....
-
india Data Warehouse Engineer Full timeExperience : 2- 5 YearsPrimary Skills : Strong SQL knowledge, Data warehouse concepts and ETL hands on experience, Azure services like Data Factory, Azure Data Lake, and Good analysis skills.Good to have skills: Power BI, Databricks, Python.
-
Data Warehouse Engineer
2 weeks ago
India Data Warehouse Engineer Full timeExperience : 2- 5 Years Primary Skills : Strong SQL knowledge, Data warehouse concepts and ETL hands on experience, Azure services like Data Factory, Azure Data Lake, and Good analysis skills. Good to have skills: Power BI, Databricks, Python.
-
Cloud Data Engineering Lead
7 days ago
India ITI Data Full timeITI Data is seeking a highly skilled Cloud Data Engineering Lead to spearhead the design and development of scalable data pipelines on AWS. With a strong background in PySpark, Python, and AWS services, you will be responsible for building robust data integration solutions that enable data-driven insights across various internal and external sources.This is...
-
india Vantage Point Consulting Inc. Full timeAWS Data Engineer - Hadoop Migration Location: Chennai or Bengaluru Role Type: Full-Time We’re seeking a skilled AWS Principal Data Architect to lead the migration of Hadoop DWH workloads from on-premise to AWS EMR. Join our team and help design and optimize scalable, secure, and resilient cloud data architectures for enterprise data processing. Key...
-
Big Data Engineer: Scalable Solutions Developer
14 hours ago
India ITI Data Full timeWe are seeking an experienced PySpark Data Engineer to join our team at ITI Data. As a key member of our team, you will design and build scalable data solutions for one of our Fortune 500 Client programs.About the Role:The ideal candidate will have extensive experience in working with Hadoop, NoSQL databases, and Spark framework on Python. You will be...
-
india Senior Data Integration Engineer Full timeMust Have Skills/Skill Requirement:Design and architect integration solutions to connect various enterprise applications, systems, and databases.Develop and implement integration workflows, APIs, and data pipelines to enable smooth communication and data exchange between different applications.Utilize Azure Integration Services such as Azure Logic Apps,...
-
india Senior Data Integration Engineer Full timeMust Have Skills/Skill Requirement: Design and architect integration solutions to connect various enterprise applications, systems, and databases. Develop and implement integration workflows, APIs, and data pipelines to enable smooth communication and data exchange between different applications. Utilize Azure Integration Services such as Azure Logic Apps,...
-
Senior Data Integration Engineer
2 weeks ago
India Senior Data Integration Engineer Full timeMust Have Skills/Skill Requirement: Design and architect integration solutions to connect various enterprise applications, systems, and databases. Develop and implement integration workflows, APIs, and data pipelines to enable smooth communication and data exchange between different applications. Utilize Azure Integration Services such as Azure Logic...
-
Cloud Native Data Engineer
1 week ago
India Intuitive Full timeAbout IntuitiveWe are a fast-growing Cloud & SDx solution and services company supporting enterprise customers globally.Our team delivers measurable value and key business outcomes through DataOps, AI/ML, Cloud Native, AppSecOps, DevSecOps, Cloud Migration, Cloud FinOps, Cybersecurity, and SDx expertise.Job OverviewWe seek an experienced Cloud Native Data...
-
Data Warehouse Expert for Analytics Projects
1 week ago
India Data Warehouse Engineer Full timeAbout the RoleWe are seeking an experienced Data Warehouse Engineer to join our team. In this role, you will design, develop, and maintain data warehouses that support business intelligence and analytics initiatives.
