Data Engineer
6 days ago
Skills : Apache Spark & Scala
Key Responsibilities :
Spark Framework Expertise :
- Demonstrate a thorough understanding of the Spark framework, including its architecture and core components.
- Optimize Spark applications for performance, ensuring efficient data processing and resource management.
Programming Skills :
- Utilize Scala or PySpark for developing data processing applications, with a minimum of 4 years of hands-on experience.
- Write clean, efficient, and maintainable code following best practices.
Hadoop Ecosystem Knowledge :
- Possess comprehensive knowledge of the Hadoop ecosystem, with mandatory experience in Hive for data warehousing.
- Integrate Spark applications with Hadoop components for data storage and processing.
Unix and Shell Scripting :
- Exhibit strong skills in Unix environments and shell scripting to automate processes and manage data workflows.
- Troubleshoot and resolve issues in a Unix-based system.
Interpersonal and Leadership Skills :
- Foster effective communication and collaboration within teams, ensuring smooth project execution.
- For experienced candidates, demonstrate excellent leadership skills to guide and mentor junior team members.
Cloud Service Provider Knowledge :
- Have a solid understanding of at least one Cloud Service Provider (CSP) such as Azure, AWS, or GCP.
- Leverage cloud technologies to enhance data processing capabilities and deployment Skills and Experience :
- 4+ years of experience in data engineering and data processing
- Strong proficiency in Apache Spark and Scala
- In-depth knowledge of Hadoop ecosystem (HDFS, YARN, Hive)
- Experience with Unix/Linux environments and shell scripting
- Strong problem-solving and analytical skills
- Excellent communication and collaboration skills
- Experience with cloud platforms (Azure, AWS, GCP) is a plus
(ref:hirist.tech)-
Data Engineering Director
6 days ago
Chennai, Tamil Nadu, India Wavicle Data Solutions Full timeOverviewWelcome to Wavicle Data Solutions, a leading provider of innovative data management solutions. We are seeking an experienced Data Engineering Director to join our team and lead the development of our data engineering initiatives.
-
Lead Data Engineer
2 weeks ago
Chennai, Tamil Nadu, India Wavicle Data Solutions Full timeJob Title: Lead Data Engineer**Overview**We are seeking an experienced Lead Data Engineer to join our team at Wavicle Data Solutions. The successful candidate will play a pivotal role in architecting and implementing data solutions, leveraging their expertise in managing data-related projects, including Data Engineering and Data Analytics...
-
Hevo Data
6 days ago
Bangalore/Bangalore, India HEVO DATA Full timeThis role provides a great opportunity to own and build highly scalable and fault-tolerant platform services that will help support thousands of customers' data pipelines and load data reliability to the different cloud warehouses. These services are the core of the Hevo platform that helps provide building no code-low pipeline. Also, makes a huge...
-
Data Analytics Engineer
4 weeks ago
Pune, Maharashtra, India Data Dynamics Full timeAbout Data Dynamics">Data Dynamics is a leading data-driven company that leverages cutting-edge technologies to drive business growth. Our team of experts collaborates with clients across various industries to deliver innovative solutions.Job Summary">We are seeking an experienced Senior Machine Learning Specialist to join our team. As a key member, you will...
-
Solution Engineer
1 month ago
Bangalore, India HEVO DATA Full timeOverview :. We're seeking a talented Solutions Engineer with strong background in Data Domain to join our growing Sales team. You'll work one-on-one with the sales team to help discover our customers' business and technical needs and demonstrate how Hevo's platform can solve their real-time data replication needs. In this role, you will...
-
Data engineer
3 months ago
Bangalore, India Data Labs - LANDMARK GROUP Full timeJob Title: Lead Data Engineer Location: Yemalur, Bangalore Your Key Responsibilities: Lead our engineering team successfully build and deploy cutting edge analytics products for consumption by different stakeholders. Lead the architecture, design, and delivery of enterprise grade microservices. Deliver assigned projects within budgeted time, cost...
-
Data Engineer
3 months ago
Bangalore, India Data Labs - LANDMARK GROUP Full timeJob Title: Lead Data Engineer Location: Yemalur, Bangalore Your Key Responsibilities: Lead our engineering team successfully build and deploy cutting edge analytics products for consumption by different stakeholders. Lead the architecture, design, and delivery of enterprise grade microservices. Deliver assigned projects within budgeted time, cost and...
-
Data Engineer
2 months ago
bangalore, India Data Labs - LANDMARK GROUP Full timeJob Title: Lead Data EngineerLocation: Yemalur, BangaloreYour Key Responsibilities:Lead our engineering team successfully build and deploy cutting edge analytics products for consumption by different stakeholders.Lead the architecture, design, and delivery of enterprise grade microservices.Deliver assigned projects within budgeted time, cost and agreed...
-
Data Engineer
3 months ago
bangalore, India Data Labs - LANDMARK GROUP Full timeJob Title: Lead Data Engineer Location: Yemalur, Bangalore Your Key Responsibilities: Lead our engineering team successfully build and deploy cutting edge analytics products for consumption by different stakeholders.Lead the architecture, design, and delivery of enterprise grade microservices. Deliver assigned projects within budgeted time, cost and agreed...
-
Data Engineer
3 months ago
bangalore, India Data Labs - LANDMARK GROUP Full timeJob Title: Lead Data Engineer Location: Yemalur, Bangalore Your Key Responsibilities: Lead our engineering team successfully build and deploy cutting edge analytics products for consumption by different stakeholders. Lead the architecture, design, and delivery of enterprise grade microservices. Deliver assigned projects within budgeted time, cost and...
-
Data Engineering Consultant
5 days ago
Gurgaon/Gurugram/Bangalore/Pune, India Publicis Sapient Full timeSenior Associate Data Engineering Level 2The Senior Associate in Data Engineering, you will translate client requirements into technical design and implement components for data engineering solutions.You will utilize a deep understanding of data integration and big data design principles to create custom solutions or implement package solutions.You will...
-
Data Engineer
4 weeks ago
Chennai/Bangalore/Pune/Hyderabad/Noida, India MNR Solutions Full timeJob Description : We are looking for an experienced AWS Data Engineer to join our team. The ideal candidate will have extensive knowledge of AWS data services and a strong background in data engineering. This role involves designing, implementing, and maintaining data pipelines and architectures to support business intelligence and analytics initiatives.Key...
-
Data Engineer
3 weeks ago
Bangalore/Gurgaon/Gurugram, India InstaTalent Recruit LLP Full timeData Engineer (Snowflake). Required : Insta Talent Reruit LLP, a leading company in the None industry, is seeking a skilled Data Engineer to join our dynamic team. In this role, you will be responsible for building and running the data pipelines and services that are required to support business functions, reports, and dashboards. We heavily rely on...
-
Data Engineering Leader
3 weeks ago
Chennai/Gurgaon/Gurugram, India T D Newton Full timeAbout T D NewtonT D Newton is a leading company in the industry, seeking a talented Data Engineer to join our team.Job DescriptionWe are looking for a highly skilled Data Engineer to work with us in Gurgaon or Chennai. The ideal candidate will have experience in designing and developing robust data pipelines using Python, SQL, and PySpark.Key...
-
Data Architect
6 days ago
Pune, India NTT DATA Full time**Req ID**:229970 We are currently seeking a Data Architect to join our team in Pune, Mah\u0101r\u0101shtra (IN-MH), India (IN). **Technical Skill Sets (mandatory)**: - Must have significant level knowledge on implementing cloud data warehouses - Snowflake, AWS Redshift, Azure SQL Data Warehouse, or Google BigQuery experience considered - Must have...
-
Data Engineering Strategist
5 days ago
Chennai/Bangalore/Kolkata/Pune/Gurgaon/Gurugram, India SMARTWORK IT SERVICES Full timeJob Title: Data Engineering Strategist">About the Role: We are seeking an analytical and innovative leader to drive our data engineering strategy and implement cutting-edge solutions on Google Cloud Platform. As a Senior Data Engineering Manager, you will play a critical role in creating and analyzing deliverables to provide critical content for fact-based...
-
Tatras Data | Data Analyst
4 weeks ago
bangalore, India Tatras Data Full timeTatras Data, an emerging player in Data Science and Artificial Intelligence is looking to hire multiple dataanalysts.Location: Bangalore/Hyderabad (Hybrid – 3 days in office)Experience Required: 3+ relevant years of experienceEducational Qualification: B.Tech, B.Sc., or Software EngineeringKey Skills and Requirements:● Programming Expertise: Strong...
-
Tatras Data | Data Analyst
4 weeks ago
bangalore, India Tatras Data Full timeTatras Data, an emerging player in Data Science and Artificial Intelligence is looking to hire multiple data analysts. Location: Bangalore/Hyderabad (Hybrid – 3 days in office) Experience Required: 3+ relevant years of experience Educational Qualification: B.Tech, B.Sc., or Software Engineering Key Skills and Requirements: ● Programming Expertise:...
-
Senior Data Engineer Specialist
6 days ago
Chennai/Bangalore/Pune/Hyderabad/Noida, India MNR Solutions Full timeAWS Data Engineering ExpertWe are seeking an experienced AWS Data Engineer to contribute to our team's mission-critical data initiatives. The ideal candidate will possess extensive knowledge of AWS data services and a strong background in data engineering, with a proven track record of designing, implementing, and maintaining scalable data pipelines and...
-
Data Platform Engineer
6 days ago
Noida/Chennai/Bangalore, India TETRAHED INC Full timeJob Description : Data Platform Engineer Job Title : Data Platform Engineer Location : India-based - Noida preferred, Chennai or Bangalore optional Job Type : Full-time Band : E2 Job Summary :We are seeking a skilled and motivated Data Platform Engineer to join our team. The role focuses on DB integration, data pre-processing, data pipeline creation, and...