Senior Hadoop Data Ingestion Engineer
3 weeks ago
Hadoop Data Ingestion Expertise
We are looking for a skilled Hadoop Testing Engineer to join our team at ValueMomentum. As a key member of our quality engineering team, you will be responsible for testing and validating our Hadoop data ingestion pipelines to ensure they meet the highest standards of quality and reliability.
About the Role
- Design, develop, and execute test plans and test cases for our Hadoop data ingestion pipelines.
- Ensure the completeness, correctness, and timeliness of data ingested into Hadoop.
- Validate source to target data mapping and transformations.
- Evaluate the performance and scalability of our data ingestion processes and recommend improvements.
- Work closely with data engineers, data scientists, and other stakeholders to understand the data requirements and provide feedback on data quality issues.
- Troubleshoot and identify root causes of any data discrepancies or failures in the data ingestion process.
- Maintain thorough documentation of testing processes, results, and recommendations.
Requirements
We are seeking a candidate with the following qualifications:
- 5+ years of experience in ETL testing with a focus on Hadoop-based systems.
- Familiarity with Hadoop ecosystem tools like HDFS, Hive, Spark, Kafka, etc.
- Proven experience with data validation, reconciliation, and performance testing tools.
- Seasoned tester with a strong background in Hadoop data ingestion and ETL testing.
- Knowledge of SQL and querying large datasets.
- Strong analytical and problem-solving skills.
- Excellent written and verbal communication skills.
Benefits
We offer a comprehensive benefits package, including career advancement opportunities, comprehensive training and certification programs, performance management, benefits, culture, and more.
-
Hadoop Data Ingestion Specialist
1 month ago
Hyderabad, Telangana, India ValueMomentum Full timeJob Summary:We are seeking a skilled Hadoop Testing Engineer to join our team at ValueMomentum. As a Hadoop Testing Engineer, you will be responsible for testing products or systems to ensure they function properly and meet business needs.Key Responsibilities:Design, develop, and execute test plans and test cases for our Hadoop data ingestion...
-
Hadoop Data Ingestion Tester
4 weeks ago
Hyderabad, Telangana, India ValueMomentum Full timeJob Summary:We are seeking a skilled Hadoop Tester to join our team at ValueMomentum. As a Hadoop Testing Engineer, you will be responsible for ensuring the quality and reliability of our data pipelines. Your primary focus will be on testing and validating our Hadoop data ingestion processes to guarantee the completeness, correctness, and timeliness of the...
-
Data Ingestion Specialist
1 week ago
Hyderabad, Telangana, India ValueMomentum Full timeAbout the OpportunityWe are seeking an experienced Data Ingestion Specialist to join our team at ValueMomentum. As a key member of our data-driven decision-making processes, you will play a crucial role in ensuring the quality and reliability of our data pipelines.With a strong background in Hadoop data ingestion and ETL testing, you will be responsible for...
-
Senior Data Engineer
4 weeks ago
Hyderabad, Telangana, India DATAECONOMY Full timeJob Title: Senior Data Engineer - Data Ingestion PipelinesAbout the Role:We are seeking a highly skilled Senior Data Engineer to join our team at DataEconomy. As a Senior Data Engineer, you will be responsible for designing and implementing robust metadata-driven data ingestion pipelines using PySpark.Key Responsibilities:Data Ingestion Pipelines: Design and...
-
Senior Big Data Developer
3 days ago
Hyderabad, Telangana, India Virtusa Full timeVirtusa seeks a seasoned Senior Big Data Developer to spearhead the development of large-scale data processing systems using Hadoop and Spark. As a key member of our team, you will design, implement, and deploy complex big data solutions that drive business growth and innovation.Job SummaryWe are looking for an experienced Senior Big Data Developer with a...
-
Hadoop Software Quality Engineer
3 weeks ago
Hyderabad, Telangana, India ValueMomentum Full time{"Responsibilities": "Key Responsibilities:Design, develop, and execute test plans and test cases for our Hadoop data ingestion pipelines.Ensure the completeness, correctness, and timeliness of data ingested into Hadoop. Validate source to target data mapping and transformations.Evaluate the performance and scalability of our data ingestion processes and...
-
Big Data Engineer
2 months ago
Hyderabad, Telangana, India TECHSTAR SOFTWARE DEVELOPMENT INDIA PVT LTD Full timeResponsibilities of the Candidate :- Be responsible for the design and development of big data solutions. - Partner with domain experts, product managers, analysts, and data scientists to develop Big Data pipelines in Hadoop- Be responsible for moving all legacy workloads to a cloud platform- Work with data scientists to build Client pipelines using...
-
Senior Data Engineer
4 weeks ago
Hyderabad, Telangana, India METAFOLKS TECHNOLOGIES Full timeJob Title: Data Engineering SpecialistAs a key member of the METAFOLKS TECHNOLOGIES team, the Data Engineering Specialist will be responsible for designing and building data pipelines to process large volumes of data. This will involve working with various technologies such as Airflow, Kubernetes, and Hadoop to ensure efficient ingestion, processing, and...
-
Senior Data Analyst
3 weeks ago
Hyderabad, Telangana, India Ivy comptech Full timeAbout The RoleAs a Senior Data Analyst at Ivy Comptech, you will contribute to various phases and activities of the software development process or software testing. You will work in a fast-paced, multi-tasking, team environment with tech leads, software engineers, internal partners, and stakeholders.Key Responsibilities:Strong understanding of Apache Druid...
-
Senior Data Analyst
1 month ago
Hyderabad, Telangana, India Ivy comptech Full timeAbout The RoleAt Ivy Comptech, we are seeking a highly skilled Senior Data Analyst to contribute to various phases and activities of the software development process or software testing. The ideal candidate will be willing to work in a fast-paced, multi-tasking, team environment, collaborating with tech leads, software engineers, internal partners, and...
-
Big Data Engineer for Ivy Comptech
3 days ago
Hyderabad, Telangana, India Ivy comptech Full timeAbout the RoleIvy Comptech is seeking a highly skilled Big Data Engineer to join our team in Hyderabad, India. As a Senior Data Analyst, you will play a crucial role in various phases and activities of the software development process or software testing.Key Responsibilities:Strong understanding of Apache Druid and Apache Hadoop Architecture.Ability to learn...
-
Senior Data Insights Specialist
2 weeks ago
Hyderabad, Telangana, India Ivy comptech Full timeAbout the RoleWe are seeking a highly skilled Senior Data Analyst to contribute to various phases and activities of our software development process or software testing.Key Responsibilities:Strong understanding of Apache Druid and Apache Hadoop Architecture.Ability to learn new tools, languages, and operating systems.Firm understanding of database systems -...
-
Big Data Engineering Professional
2 weeks ago
Hyderabad, Telangana, India TEKNIKOZ Full timeWe are seeking a highly skilled Big Data Engineering Professional to join our team at TeknikoZ.As a Senior Associate L2 in Data Engineering, you will be responsible for translating client requirements into technical design and implementing components for data engineering solutions.You will utilize your deep understanding of data integration and big data...
-
Senior Data Architect
3 weeks ago
Hyderabad, Telangana, India METAFOLKS TECHNOLOGIES Full timeJob DescriptionAt MetaFolks Technologies, we seek a skilled Senior Data Engineer to join our team. As a key member of our data engineering function, your primary responsibilities will include designing and building high-performance data pipelines to process large datasets.Key Responsibilities:Design and build data pipelines using various tools and...
-
Senior Data Engineer
1 month ago
Hyderabad, Telangana, India NTT DATA Business Solutions Full timeA Senior Data Engineer plays a pivotal role in technology-driven organizations, responsible for designing, building, and managing the infrastructure and tools that enable efficient processing and analysis of large data sets.Responsibilities:Designing and Implementing ETL Processes:Develop and maintain scalable data pipelines.Create efficient Extract,...
-
Data Engineer
1 month ago
Hyderabad, Telangana, India DBS Bank Full timeJob SummaryDBS Bank is seeking a highly skilled Hadoop Data Engineer to join our Middle Office Technology team. As a key member of our team, you will be responsible for designing, developing, and maintaining large-scale data processing systems using Hadoop and Spark technologies.Key ResponsibilitiesDesign and develop scalable data processing pipelines using...
-
Senior Data Engineer
4 weeks ago
Hyderabad, Telangana, India ProcessQ Tecnologies Full timeCompany OverviewProcessQ Technologies is an IT consulting company with a strong focus on delivering high-quality IT development solutions, collaborative enterprise solutions, and IT infrastructure management. Our team of industry experts has a reputation for providing innovative services to our clients, with headquarters in Hyderabad and a dedicated...
-
Senior Data Architect
3 weeks ago
Hyderabad, Telangana, India Publicis Sapient Full timeJob Summary:As a Cloud Data Engineering Manager, you will be responsible for translating client requirements into design, architecting, and implementing GCP Cloud-based big data solutions for clients.For this role, you will provide technical leadership and hands-on implementation of data engineering including data ingestion, data access, modeling, data...
-
Big Data Engineer
4 weeks ago
Hyderabad, Telangana, India data Full timeOverview: We're seeking a skilled Big Data Engineer to join our team at data.ai. As a key member of our engineering team, you will be responsible for designing and implementing innovative data solutions that drive business growth. If you're passionate about working with large data sets, have experience with big data technologies, and are eager to...
-
Big Data Engineer, Data Modeling Expert
1 month ago
Hyderabad, Telangana, India data Full timeUnlock the Power of Data with UsWe're seeking an experienced Big Data Engineer to join our team and contribute to the development of innovative analytics and data products. As a key member of our engineering team, you will work closely with Data Scientists, Data Engineers, Product Managers, and Software Architects to design and implement complex data product...