Big Data Engineer/Manager
1 month ago
Job Description :
Must Have :
Tech savvy engineer - willing and able to learn new skills, track industry trend.
- 5 - 7 years of total experience of solid data engineering experience, especially in Open Source, data-intensive, distributed environments with minimum 5 years of experience in big data related technologies like Spark, Hive, HBase, Hadoop, etc.
- Programming background - Mandatory- Scala, Spark and Java / Python
- Experience in following technologies - MapReduce, HDFS, YARN, Spark Streaming.
- Experience in creating e2e pipelines in Hadoop.
- Experience in SQL, Hive and NoSQL databases
- Experience in Linux / Unix platform
- Experience of cloud design patterns
- Experience in Jenkins, GitHub, Debugging the code, and error handling.
- Experience in Building end to end ETL Pipelines
- Self-starter & resourceful personality with the ability to manage pressure situations.
- Experience working with geographically distributed teams.
- Work on high- level business and technical problems, contribute to architectural decisions.
- Create the core framework/ templates that gives a starting point for the team members to get started with implementation/ execution.
Role & Responsibilities :
- Build Data and ETL pipelines in Hadoop.
- Support migration of data to the cloud using Big Data Technologies like Spark, Hive, Hadoop, Scala, Python
- Interact with customers daily to ensure smooth engagement.
- Exposure to GCP
- Responsible for timely and quality deliveries.
- Exposure to Scrum and Agile Development best practices
- Fulfil organization responsibilities
- Sharing knowledge and experience within the other groups in the organization, conducting various technical sessions and training.
-
AWS Data Engineer
3 weeks ago
Pune, Maharashtra, India HNM Solutions Full timeNote : Only Immediate JoinerRole : AWS Data EngineerLocation : Pune, IndiaExperience : 8 YearsJD: Roles and responsibilities :- With over 8 yrs. of hands-on experience with Data Technologies - Requirement analysis and assess the technical feasibility of proposed solutions. - Act as the technical specialist in designing and recommending architecture for...
-
Senior Hadoop Engineer
1 month ago
Pune, Maharashtra, India HuQuo Consulting Pvt. Ltd. Full timeJob Description :- 5-8 years of total experience of solid data engineering experience, especially in Open Source, data-intensive, distributed environments with minimum 5 years of experience in big data related technologies like Spark, Hive, HBase, Hadoop, etc. Programming background : - Mandatory- Scala, Spark and Java / Python - Experience in following...
-
Principal Software Engineer
1 month ago
Pune, Maharashtra, India Bask HR Consulting Pvt ltd Full timeJob Description : - Build, design and, implement our highly scalable, fault-tolerant big data platform to process terabytes of data and provide customers with in depth analytics.- Developing Big Data pipelines using modern technology stacks such as Spark, Hadoop, Kafka, HBase, Hive, and Presto.- Developing analytics applications using modern technology...
-
Data Architect
5 hours ago
Pune, Maharashtra, India THRIVEFORCE PRIVATE LIMITED Full timeJob Description : Skill Sets : Looking for Banking domain or Finance domain - Overall 12+ years of experience with a 3+ years of relevant experience as data architect or data specialist.- Proficiency in Data Design, Data Modelling, schema modelling across SQL, BigData and No-SQL technologies.- In Depth knowledge on database technologies such as Oracle,...
-
AI/ML Engineer
1 month ago
Pune, Maharashtra, India ARR Recruitment Solutions Full timeWe are seeking a highly skilled Senior AI/ML Engineer with extensive experience in data integration, data processing, and building applications that handle large-scale data in the order of Terabytes from multiple sources. The ideal candidate will possess strong programming skills, particularly in Python, along with proficiency in AWS services and tools such...
-
Big Data Engineer
1 month ago
Pune, Maharashtra, India HyrEzy Talent Solutions Full timeRole : Big Data EngineerAbout Organization :Our Client is an IT consulting organization focused on providing AI Led Digital Transformation Consulting services to enterprise customers. They have adopted AI First strategy to drive value in form of Agility, Quality, Efficiency, Competitive advantage, Customer experience as core principles. Our focus is to drive...
-
Senior Data Engineer
2 days ago
Pune, Maharashtra, India timesjobs Full timeJob DescriptionThe role entails building data processing frameworks that handle the businesss growing database and maintaining optimized and highly available data pipelines that facilitate deeper analysis and reporting by the Data and Analytics department.NutaNXT Technologies offers a compelling and rewarding work environment. We offer market competitive...
-
WovV Technologies
1 month ago
Pune, Maharashtra, India WovV Technologies Full timeLocation : Pune (Hybrid Work module compulsory, WFH not available).Experience : 5-7 years.Contract Duration : Contract position for 6 months (can be extended).Mandatory Technology : Product development, Application development, Spark, Apache Airflow, Snowflake, BigQuery.Role and Responsibilities :- Scala is a mandatory skill here.- Please ensure that the...
-
Data Engineer
5 hours ago
Pune, Maharashtra, India Krishna Global Services Pvt. Ltd Full timeJob Opportunity : Data Engineer. Location : Pune. Experience : 3 to 6 Years. We are seeking a highly skilled Data Engineer to join our team in Pune. The ideal candidate will possess strong stakeholder management abilities, excellent communication skills, and solid technical expertise in SQL/PLSQL, ETL tools, Big Query, and Cloud technologies.Key...
-
Technical Architect
3 weeks ago
Pune, Maharashtra, India Consulting Pandits Full timeJob Description :Mandatory Skills :- 7-15 years of total experience in software development - At least 4 years of experience with Big data technologies- Proficiency in at least one of the following programming languages : Python/Scala/Java- Experience of development and deployment of at least two end-to-end big data solutions- Understanding of RDBMS-...
-
Big Data Engineer
1 month ago
Pune, Maharashtra, India Consulting Pandits Full timeMandatory Skills:- 4+ years' experience in software development with Big data technologies- Proficiency in at least one of the following programming languages: Java/Scala/Python- Experience of development and deployment of at least one end-to-end data storage/processing pipeline- Basic understanding of RDBMS- Intermediate level expertise in Apache Spark,...
-
Data Engineer
24 hours ago
Pune, Maharashtra, India worldline Full timeData Engineer M2C PuneThis is Worldline We are the innovators at the heart of the payments technology industry, shaping how the world pays and gets paid. The solutions our people build today power the growth of millions of businesses tomorrow. From your local coffee shop to unicorns and international banks. From San Francisco to Auckland. We are in every...
-
Manager , Data Engineering and Integrations
5 days ago
Pune, Maharashtra, India Workday Full timeYour work days are brighter here.At Workday, it all began with a conversation over breakfast. When our founders met at a sunny California diner, they came up with an idea to revolutionize the enterprise software market. And when we began to rise, one thing that really set us apart was our culture. A culture which was driven by our value of putting our people...
-
Senior Data Engineer
7 days ago
Pune, Maharashtra, India sistemasgl Full timeWe are a digitally native company that helps organizations reinvent themselves and unleash their potential. We are the place where innovation, design and engineering meet scale. Globantis 20 years old, NYSE listed public organization with more than 27,000 employees worldwide working out of 25 countries globally. Positions Open: Azure Data EngineerExperience:...
-
AWS Data Engineer
5 hours ago
Pune, Maharashtra, India Krishna Global Services Pvt. Ltd Full timeJob Title : AWS Data Engineer. Location : Pune. Experience Required : 6-9 Years. Job Description : We are looking for a highly skilled AWS Data Engineer with a strong background in data and analytics to join our team in Pune. The ideal candidate will have extensive experience in designing, implementing, and managing data infrastructure on AWS. This role...
-
Zimetrics Technologies
1 month ago
Pune, Maharashtra, India Zimetrics Technologies Private Limited Full timeExperience :- 4+ years of data engineering or software engineering- 4+ years building data applications in Scala, Java, and Python- Proficient with distributed data processing with Apache Spark- Proficient with SQL and modern data warehouse platforms - Snowflake, Redshift, Big Query, or Synapse- Proficient with workflow management platforms - Airflow, AWS...
-
Data Engineer
1 month ago
Pune, Maharashtra, India ADVANSOFT Full timePosition: Data EngineerNotice Period: Immediately -20 Days (Early Joiners / Candidates Serving Notice Period will be Preferred)Location: PuneExperience: 5+ yearsMust Skills : Python, Hive, SQL, Airflow, Pyspark, Hadoop, Data Structure, GitHub, Backend Technologies Duration: Full TimeJob Description :Technical & Other Skills :- 5+ years of working experience...
-
Data Engineer
2 weeks ago
Pune, Maharashtra, India HNM Solutions Full timeNote : immediate joinerRole : Data EngineerLocation : Onsite (Pune)Language : EnglishRoles and responsibilities :With over 3+ yrs. of hands-on experience with Data TechnologiesRequirement analysis and assess the technical feasibility of proposed solutions.Act as the technical specialist in designing and recommending architecture for application...
-
Data Engineer
3 weeks ago
Pune, Maharashtra, India Nurturing Interns Private Limited Full timeRole Summery:You will be responsible for Analysing archiving and reporting requirements, source and destination systems and their data models and designing data transformation, archiving, reporting and analytics solutions that meet the functional and non-functional requirements.- You will work closely with Project Managers to deliver the program.Dimension of...
-
Lead/Senior Engineer
3 weeks ago
Pune, Maharashtra, India Coders Brain Technology & Private Limited Full timeTo be successful in this role, you should possess :- Collaborate closely with Product Management and Engineering leadership to devise and build the right solution.- Participate in Design discussions and brainstorming sessions to select, integrate, and maintain Big Data tools and frameworks required to solve Big Data problems at scale.- Design and implement...