Big Data Engineer/Manager
5 months ago
Job Description :
Must Have :
Tech savvy engineer - willing and able to learn new skills, track industry trend.
- 5 - 7 years of total experience of solid data engineering experience, especially in Open Source, data-intensive, distributed environments with minimum 5 years of experience in big data related technologies like Spark, Hive, HBase, Hadoop, etc.
- Programming background - Mandatory- Scala, Spark and Java / Python
- Experience in following technologies - MapReduce, HDFS, YARN, Spark Streaming.
- Experience in creating e2e pipelines in Hadoop.
- Experience in SQL, Hive and NoSQL databases
- Experience in Linux / Unix platform
- Experience of cloud design patterns
- Experience in Jenkins, GitHub, Debugging the code, and error handling.
- Experience in Building end to end ETL Pipelines
- Self-starter & resourceful personality with the ability to manage pressure situations.
- Experience working with geographically distributed teams.
- Work on high- level business and technical problems, contribute to architectural decisions.
- Create the core framework/ templates that gives a starting point for the team members to get started with implementation/ execution.
Role & Responsibilities :
- Build Data and ETL pipelines in Hadoop.
- Support migration of data to the cloud using Big Data Technologies like Spark, Hive, Hadoop, Scala, Python
- Interact with customers daily to ensure smooth engagement.
- Exposure to GCP
- Responsible for timely and quality deliveries.
- Exposure to Scrum and Agile Development best practices
- Fulfil organization responsibilities
- Sharing knowledge and experience within the other groups in the organization, conducting various technical sessions and training.
-
Data Engineer
3 weeks ago
Pune, Maharashtra, India NTT DATA Services Full timeJob Title: Data Engineer - Big Data SpecialistWe are seeking a highly skilled Data Engineer to join our team in Pune, India. As a Data Engineer, you will work on exciting big data related projects that require large data sets to be processed via a vendor sourced solution on a daily, weekly and monthly basis.Key Responsibilities:Analyzing data sets and...
-
Big Data Engineer/Manager
4 weeks ago
Pune, Maharashtra, India Huquo Full timeJob Title: Big Data Engineer/ManagerAbout the Role:We are seeking a highly skilled Big Data Engineer/Manager to join our team at Huquo. As a key member of our data engineering team, you will be responsible for designing, building, and maintaining large-scale data processing systems using Big Data technologies such as Hadoop, Spark, and NoSQL databases.Key...
-
Big Data Engineer
4 weeks ago
Pune, Maharashtra, India Seven N Half Full timeJob Title: Lead Big Data DeveloperThis is an exciting opportunity to join our team at Seven N Half as a Lead Big Data Developer. We are a fast-paced software company that partners with innovative B2B and B2C SaaS companies for their digital transformation needs.Job Summary:We are seeking a highly skilled and experienced Big Data Developer to lead our team in...
-
Big Data Engineer/Manager
2 weeks ago
Pune, Maharashtra, India Huquo Full timeJob Overview :Huquo is seeking a highly skilled Data Architect and Engineer to lead our data engineering team. As a key member of our team, you will design and implement scalable, secure, and high-performance data architectures.Key Responsibilities :Design and develop data pipelines using Hadoop, Spark, and other big data technologies.Collaborate with...
-
Data Engineer
6 days ago
Pune, Maharashtra, India Virtusa Full timeAbout the RoleAt Virtusa, we are seeking a highly skilled Data Engineer (Big Data) to join our team. As a key member of our data engineering team, you will be responsible for designing, developing, and maintaining large-scale data processing systems using big data technologies such as Apache Spark, Hadoop, and Hive.Responsibilities• Design, develop, and...
-
Big Data Engineer
4 weeks ago
Pune, India SGS Technical Services Pvt. Ltd Full timeJob Title: Big Data EngineerJob Summary:We are seeking a highly skilled Big Data Engineer to join our team at SGS Technical Services Pvt. Ltd. The successful candidate will be responsible for designing, developing, and maintaining scalable data processing systems using Hadoop and PySpark.Key Responsibilities:Design and develop data processing systems using...
-
Data Engineer
3 months ago
Pune, India Rao Career Solutions Full timeJob Summary :- We are looking for a skilled Data Engineer with hands-on experience in PySpark and Big Data platforms to join our growing team. The ideal candidate will have strong expertise in building data pipelines, working with big data technologies like Apache Hive and Parquet, and handling diverse data use cases. You will work closely with data...
-
Big Data Engineer
4 weeks ago
Chennai/Pune, India Pan Asia Man power Consultants Recruiting agency Full timeJob Title: Big Data EngineerWe are seeking a skilled Big Data Engineer to join our team and contribute to building backend data applications and services that support our analytics platforms.Key Responsibilities:Design, develop, and maintain backend data applications and services.Collaborate with product owners and team members to gather requirements and...
-
Big Data Engineer
2 weeks ago
Chennai/Pune, India Pan Asia Man power Consultants Recruiting agency Full timeBig Data EngineerWe are seeking a skilled Big Data Engineer to contribute to building backend data applications and services. This role requires expertise in various technologies to drive our data initiatives.Key Responsibilities:Design, develop, and maintain backend data applications and services.Collaborate with product owners and team members to gather...
-
Senior Big Data Engineer
4 weeks ago
Pune, Maharashtra, India Circana Full timeJob DescriptionCircana is seeking a highly skilled Senior Big Data Engineer to lead our big data initiatives and drive innovation in data engineering.Key ResponsibilitiesDesign and develop scalable big data architectures using Hadoop and Spark frameworks.Lead a team of data engineers to develop and deploy big data solutions.Collaborate with cross-functional...
-
Big Data Engineer
4 weeks ago
Chennai/Pune, India Pan Asia Man power Consultants Recruiting agency Full timeJob Title: Big Data EngineerWe are seeking a skilled Big Data Engineer to join our team and contribute to building backend data applications and services that support our analytics platforms.Key Responsibilities:Design, develop, and maintain backend data applications and services.Collaborate with product owners and team members to gather requirements and...
-
Big Data Engineer
4 weeks ago
Pune/Maharashtra, India Talent Sketchers Full timeJob Title: Big Data EngineerAt Talent Sketchers, we are seeking a highly skilled Big Data Engineer to join our team.Key Responsibilities:Design and develop scalable data processing systems using Apache Spark.Work with various programming languages such as Java and Scala.Expertise in database modeling and working with SQL and NoSQL databases.Experience with...
-
Big Data Engineer
1 month ago
Pune, India RiDiK (a Subsidiary of CLPS. Nasdaq: CLPS) Full timeJob Summary:We are seeking a skilled and innovative Big Data Engineer to join our dynamic team. The ideal candidate will be responsible for designing, building, and maintaining scalable data processing systems. You will work with large datasets and implement data pipelines to ensure data quality and availability for analytics and business intelligence...
-
Big Data Engineer
2 weeks ago
Pune, India Mig Staffing Full timeWe are looking to hire a talented big data engineer to develop and manage our company's Big Data solutions. In this role, you will be required to design and implement Big Data tools and frameworks, implement ELT processes, collaborate with development teams, build cloud platforms, and maintain the production system.To ensure success as a big data...
-
Big Data Engineer
1 month ago
Pune, Maharashtra, India Mig Staffing Full timeWe are looking to hire a talented big data engineer to develop and manage our company's Big Data solutions. In this role, you will be required to design and implement Big Data tools and frameworks, implement ELT processes, collaborate with development teams, build cloud platforms, and maintain the production system.To ensure success as a big data...
-
Big Data Engineer
2 months ago
Pune, India Mig Staffing Full timeWe are looking to hire a talented big data engineer to develop and manage our company's Big Data solutions. In this role, you will be required to design and implement Big Data tools and frameworks, implement ELT processes, collaborate with development teams, build cloud platforms, and maintain the production system.To ensure success as a big data...
-
Senior Big Data Engineer
2 weeks ago
Pune, Maharashtra, India Virtusa Full timeAbout the RoleAt Virtusa, we are looking for a skilled Senior Big Data Engineer to join our team. As a key member of our data engineering team, you will be responsible for designing, developing, and maintaining large-scale data processing systems using Apache Spark, Hadoop, Hive, and Impala.Key Responsibilities• Develop and implement data pipelines using...
-
Senior Data Engineer
4 weeks ago
Pune, Maharashtra, India Data Axle Full timeAbout Data Axle:Data Axle Inc. has been a leading provider of data, marketing solutions, sales, and research for 50 years in the US. With a strategic global centre of excellence in Pune, Data Axle delivers mission-critical data services to its global customers powered by its proprietary cloud-based technology platform and leveraging proprietary business &...
-
Big Data Engineer
1 day ago
pune, India UST Full timeDear Candidate , Please share following details over email. To Proceed further . Nitin.patil@ust.com Total Years of Experience – Relevant Experience - Big Data Relevant Experience - hadoop Relevant Experience - Airflow Relevant Experience - Scala in Spark Relevant Experience - Hive Current CTC – Expected CTC – Current Location – Expected Location...
-
Big Data Engineer
2 weeks ago
Pune, Maharashtra, India F337 Deutsche India Private Limited, Pune Branch Full timeJob SummaryF337 Deutsche India Private Limited, Pune Branch is seeking a highly skilled Big Data Engineer to join our team. As a Big Data Engineer, you will be responsible for designing, developing, and maintaining large-scale data processing systems using Hadoop and Scala technologies.Key ResponsibilitiesDesign and develop data processing pipelines using...