Big Data Engineer
1 week ago
Job description :
Role : Data Engineer
Location : Pune,chennai,noida,delhi
1. Overall 5+ Years of IT experience and 2+ Years of relevant experience with Big Data Technologies (such as - Spark Scala, Hadoop, Hive, HBase, Python, Kafka)
2. Hands on experience in Basic & Advance Java
3. Hands on experience in Apache Spark - Scala and deep understanding of distributed systems
4. Hands on experience in Core Spark API and Spark Streaming APIs
5. Relevant experience with handling different file formats - JSON, Avro, Parquet, CSV, XML, Text files
6. Experience working with HDFS, Hive, S3, Mongo DB and SQL database integration
7. Hands on experience in creating Scala/Spark Jobs for data transformation & aggregation
8. Sound exposure to ETL pipelines implementation, batch scheduling and automation
9. Proficient in writing hive queries and understand hive internals
10. Have good work exposure with Data integration/Data acquisition framework or similar kind of framework
11. Strong understanding of big data concepts and distributed computing
12. Experience with source control management like git , bitbucket
13. Familiar with all phases of development life cycle and agile development methodologies
14. Excellent problem-solving skills and attention to details
15. Strong communication and collaboration skills
16. Strong exposure to Unix commands and Unix shell scripting
17. Strong exposure to Oracle/SQL database
18. Must be able to code, and assist of other team members
-
Big Data Engineer
2 weeks ago
Pune, Maharashtra, India beBee Careers Full timeBig Data EngineerWe are seeking a highly skilled engineer to join our big data team. As a key member, you will be responsible for designing and implementing big data solutions using Big Query, Big Data, Hadoop, and Snowflake.The ideal candidate will have:Hands-on experience in designing and implementing big data solutions.Strong knowledge of machine learning...
-
Big Data Engineer
2 weeks ago
Pune, Maharashtra, India beBee Careers Full timeBig Data EngineerWe are looking for a Big Data Engineer to join our team. As a Big Data Engineer, you will be responsible for developing and maintaining large-scale data processing systems using big data technologies.Responsibilities:Develop and maintain clean, efficient, and well-tested Scala/Spark code.Perform in-depth data analysis to support development...
-
Big Data Engineer
7 days ago
Pune, Maharashtra, India beBee Careers Full timeJob Title: Big Data EngineerJob Overview:We are seeking a highly skilled big data engineer to join our team. As a big data engineer, you will be responsible for designing, implementing, and optimizing large-scale data processing systems using technologies such as Hadoop, Spark, and NoSQL databases.Key Responsibilities:Design, implement, and optimize...
-
Big Data Engineer
2 weeks ago
Pune, Maharashtra, India beBee Careers Full timeOur ideal candidate will have a strong background in big data technologies, data engineering, and distributed systems. The main responsibilities of this role include designing, developing, and implementing scalable big data solutions using Hadoop, Spark, and other data processing frameworks.Skill Set:Hadoop Ecosystem (HDFS, Hive, HBase, YARN)Apollo...
-
Big Data Engineer
2 weeks ago
Pune, Maharashtra, India beBee Careers Full timeAbout this Role:We are looking for a talented Big Data Engineer to join our team. As a Spark Scala Developer, you will play a key role in designing and implementing scalable data pipelines using distributed systems and Big Data technologies.
-
Big Data Engineer
7 days ago
Pune, Maharashtra, India beBee Careers Full timeJob Title: Big Data EngineerJob Summary:We are seeking an experienced Big Data Engineer to design and develop business-critical backend systems using stream processors and high-quality data pipelines.This role involves assembling large, complex data sets that meet functional / non-functional business requirements. You will build the infrastructure required...
-
Big Data Engineer
2 weeks ago
Pune, Maharashtra, India beBee Careers Full timeData Engineering ExpertiseWe are seeking an experienced Data Engineer to lead the design and implementation of our data infrastructure. The successful candidate will have a deep understanding of big data tools, experience with data pipeline and workflow management tools, and excellent problem-solving skills.ResponsibilitiesLead the design and implementation...
-
Big Data Engineer
4 weeks ago
Pune, Maharashtra, India WorkiFicient Technologies Pvt Ltd Full timeJob Title- Lead Big Data Engineer.Location- Pune.Experience- 8 to 10 years.Notice Period- Looking for immediate joiners/30 days.To be successful in this role, you should possess:Collaborate closely with Product Management and Engineering leadership to devise and build the right solution.Participate in Design discussions and brainstorming sessions to select,...
-
Big Data Engineer
2 weeks ago
Pune, Maharashtra, India beBee Careers Full timeJob Description:- Develop Big Data Engineering solutions for on-premises systems, with a focus on Spark development and streaming experience.- Collaborate on ETL implementation and migration to Spark, utilizing programming knowledge in Java, Scala, and Python.- Design and implement data pipelines using Apache Kafka, HDFS, Hive, and Spark Streaming (DStream...
-
Big Data Engineer
2 weeks ago
Pune, Maharashtra, India beBee Careers Full timeJob Title: Big Data EngineerAbout the RoleWe are seeking an experienced Big Data Engineer to design, build, and maintain large-scale data processing systems on cloud platforms such as AWS/Azure Stack.Key ResponsibilitiesAs a Big Data Engineer, you will be responsible for:Designing and developing data warehouses and ETL pipelines using Databricks and...