![Andor Tech](https://media.trabajo.org/img/noimg.jpg)
Hadoop Developer
3 weeks ago
Job Description :
We are seeking a skilled Hadoop Developer with mandatory working experience in Elasticsearch to join our team.
The ideal candidate should have a minimum of 2 years of experience in Hadoop and Spark development.
This role will involve working with large datasets and implementing data processing solutions using Hadoop and Spark, with a particular emphasis on Elasticsearch integration.
Responsibilities :
- Design, develop, and implement data processing solutions using Hadoop and Spark technologies.
- Work closely with cross-functional teams to understand data requirements and develop scalable solutions to meet business needs.
- Implement and maintain Elasticsearch integration with Hadoop and Spark for efficient data retrieval and analysis.
- Optimize and tune Hadoop and Spark jobs for performance and scalability.
- Develop and maintain ETL (Extract, Transform, Load) processes to ingest and process large volumes of data.
- Troubleshoot and debug issues related to Hadoop and Spark applications, ensuring smooth operation of data pipelines.
- Collaborate with data engineers, data scientists, and other stakeholders to deliver high-quality solutions.
- Stay updated on emerging technologies and best practices in big data processing and distributed computing.
Skills Required :
- Minimum of 2 years of experience in Hadoop development.
- Minimum of 2 years of experience in Spark development.
- Mandatory working experience in Elasticsearch.
- Strong understanding of big data concepts and distributed computing principles.
- Proficiency in programming languages such as Java, Scala, or Python.
- Experience with Hadoop ecosystem tools such as HDFS, MapReduce, Hive, and HBase.
- Experience with Spark RDDs, DataFrames, and Spark SQL.
- Familiarity with Elasticsearch querying, indexing, and data visualization.
- Excellent problem-solving skills and attention to detail.
- Strong communication and collaboration skills.
-
Big Data Developer
2 months ago
Bangalore, Karnataka, India Codersbrain technology pvt ltd Full timeSalary : 12 - 20 LPARequirements :- Bachelor's/Master's degree in Computer Science, Engineering, or a related field.- Master's degree preferred.- Proven experience as a Big Data Developer or similar role, with strong knowledge of Big Data and Hadoop ecosystems.- Hands-on experience with HDFS, Spark, MapReduce, Sqoop, and Hive.- Experience in...
-
Unison Consulting
2 months ago
Bangalore, Karnataka, India Unison consulting pte ltd Full timeWe are seeking a talented Big Data Engineer to join our team and play a key role in designing, developing, and maintaining our big data infrastructure. You will leverage your expertise in Java, Hadoop, and Kafka to build efficient data pipelines, handle real-time data streams, and ensure high-quality data processing for our data analytics...
-
Unison Consulting
3 weeks ago
Bangalore, Karnataka, India Unison consulting pte ltd Full timeWe are seeking a talented Big Data Engineer to join our team and play a key role in designing, developing, and maintaining our big data infrastructure. You will leverage your expertise in Java, Hadoop, and Kafka to build efficient data pipelines, handle real-time data streams, and ensure high-quality data processing for our data analytics...
-
Technical Lead
6 days ago
Bangalore, Karnataka, India Suitable.AI Full timeSkills required : - Minimum 2+ years in Data Engineering- Last 5 years of experience should be from consulting companies- Skillsets - (Java/Scala/Python) + Big Data stack+ DSA + cloud experience- Proven track record of building and shipping large-scale engineering products and/or knowledge of cloud infrastructure such as GCP/AWS preferred- Must have strong...
-
Data Engineer
2 months ago
Bangalore, Karnataka, India gethyr Full timeResponsibilities:- Designing and implementing fine-tuned production-ready data/ML pipelines in Hadoop platform.- Driving optimization, testing, and tools to improve quality.- Reviewing and approving high-level & detailed design to ensure that the solution delivers to the business needs and aligns with the data & analytics architecture principles and...
-
Data Engineer
3 weeks ago
Bangalore, Karnataka, India Gethyr Full timeResponsibilities:- Designing and implementing fine-tuned production-ready data/ML pipelines in Hadoop platform.- Driving optimization, testing, and tools to improve quality.- Reviewing and approving high-level & detailed design to ensure that the solution delivers to the business needs and aligns with the data & analytics architecture principles and...
-
Data Scientist
3 weeks ago
Bangalore, Karnataka, India Freelancer Recruiter Full timeMandatory Skills:- Data scientist exp- Hadoop, Scala- Python- Machine learning- SQL- Only from product OrgsRequirements from Past Experience :- Prior experience of working with large-scale datasets (10s of millions of documents) is strongly preferred.- End-to-end ownership of developing the model, writing production quality code and deploying the model is an...
-
Data Scientist
2 months ago
Bangalore, Karnataka, India Freelancer Recruiter Full timeMandatory Skills:- Data scientist exp- Hadoop, Scala- Python- Machine learning- SQL- Only from product OrgsRequirements from Past Experience :- Prior experience of working with large-scale datasets (10s of millions of documents) is strongly preferred.- End-to-end ownership of developing the model, writing production quality code and deploying the model is an...
-
Thoucentric - Big Data Engineer - Hive/Hadoop
4 weeks ago
Bangalore, Karnataka, India Thoucentric Full timeJob Description :As a Big Data Engineer, you will be responsible for designing, developing, and maintaining our big data infrastructure. You will work with large datasets, perform data processing, and support various business functions by creating data pipelines, data processing jobs, and data integration solutions. You will be working in a dynamic and...
-
Thoucentric - Big Data Engineer - Hive/Hadoop
3 weeks ago
Bangalore, Karnataka, India Thoucentric Full timeJob Description :As a Big Data Engineer, you will be responsible for designing, developing, and maintaining our big data infrastructure. You will work with large datasets, perform data processing, and support various business functions by creating data pipelines, data processing jobs, and data integration solutions. You will be working in a dynamic and...
-
Big Data Engineer
2 months ago
Bangalore/Hyderabad, Karnataka, India TalentXo Full timeRole & Responsibilities :Good development practices :- Hands on coder with good experience in programming languages like Java or Python.- Hands-on experience on the Big Data stack like PySpark, Hbase, Hadoop, Mapreduce and ElasticSearch.- Good understanding of programming principles and development practices like checkin policy, unit testing, code...
-
Big Data Engineer
3 weeks ago
Bangalore/Hyderabad, Karnataka, India TalentXo Full timeRole & Responsibilities :Good development practices :- Hands on coder with good experience in programming languages like Java or Python.- Hands-on experience on the Big Data stack like PySpark, Hbase, Hadoop, Mapreduce and ElasticSearch.- Good understanding of programming principles and development practices like checkin policy, unit testing, code...
-
Data Engineer
3 weeks ago
Bangalore, Karnataka, India Business Fundamental Consultancy Full timeDesignation - Data Engineer Working Days - 5 DaysLocation - Bangalore (on-site)Experience - 5 -7 years ( experience in either Java or Python or Both)Big Data Experience - 2-5 Years - (Hadoop, snowflake, or Kafka)Notice period - Immediate or maximum up to 30 daysPosition Overview : We are excited to offer a challenging opportunity for an experienced Data...
-
Data Engineer
3 weeks ago
Bangalore, Karnataka, India Business Fundamental Consultancy Full timeDesignation - Data Engineer Working Days - 5 DaysLocation - Bangalore (on-site)Experience - 5 -7 years ( experience in either Java or Python or Both)Big Data Experience - 2-5 Years - (Hadoop, snowflake, or Kafka)Notice period - Immediate or maximum up to 30 daysPosition Overview : We are excited to offer a challenging opportunity for an experienced Data...
-
Data Engineer
1 month ago
Bangalore, Karnataka, India Andor Tech Full timeThis role is for staff augmentation support and resources will be assisting non-core activities MID (5-9 YRS OF EXPERIENCE).Roles & Responsibilities :- Support to Develop and test code to deliver functionality that meets the overall business strategy and objectives.- Support to Build the work needed to implement features from the product backlog.- Size user...
-
Data Engineer
3 weeks ago
Bangalore, Karnataka, India Andor Tech Full timeThis role is for staff augmentation support and resources will be assisting non-core activities MID (5-9 YRS OF EXPERIENCE).Roles & Responsibilities :- Support to Develop and test code to deliver functionality that meets the overall business strategy and objectives.- Support to Build the work needed to implement features from the product backlog.- Size user...
-
Senior Data Engineer
3 weeks ago
Bangalore, Karnataka, India Consulting Pandits Full timeRoles and Responsibilities :- Owning the design, operations and improvements for the Customer Data Warehouse infrastructure- Engineering solutions to aggregate and automate large scale data flows from varying sources- Collaborate with others to construct complex data sources for algorithms and machine learning models- Gather business requirements from...
-
Senior Data Engineer
2 months ago
Bangalore, Karnataka, India Consulting Pandits Full timeRoles and Responsibilities :- Owning the design, operations and improvements for the Customer Data Warehouse infrastructure- Engineering solutions to aggregate and automate large scale data flows from varying sources- Collaborate with others to construct complex data sources for algorithms and machine learning models- Gather business requirements from...
-
Data Engineer
2 months ago
Bangalore, Karnataka, India Huquo Full timeJob Description : - Commercial experience leading on client-facing projects, including working in close-knit teams- 3+ years of experience and interest in Big Data technologies (Hadoop / Spark / Relational DBs)- 3+ years of experience working on projects within the cloud ideally AWS or Azure- Data Warehousing experience with cloud products like Snowflake,...
-
Data Engineer
3 weeks ago
Bangalore, Karnataka, India Huquo Full timeJob Description : - Commercial experience leading on client-facing projects, including working in close-knit teams- 3+ years of experience and interest in Big Data technologies (Hadoop / Spark / Relational DBs)- 3+ years of experience working on projects within the cloud ideally AWS or Azure- Data Warehousing experience with cloud products like Snowflake,...