Big Data Engineer/Manager

1 month ago


Pune, Maharashtra, India Huquo Full time

Job Description :


Must Have :

Tech savvy engineer - willing and able to learn new skills, track industry trend.

- 5 - 7 years of total experience of solid data engineering experience, especially in Open Source, data-intensive, distributed environments with minimum 5 years of experience in big data related technologies like Spark, Hive, HBase, Hadoop, etc.

- Programming background - Mandatory- Scala, Spark and Java / Python

- Experience in following technologies - MapReduce, HDFS, YARN, Spark Streaming.

- Experience in creating e2e pipelines in Hadoop.

- Experience in SQL, Hive and NoSQL databases

- Experience in Linux / Unix platform

- Experience of cloud design patterns

- Experience in Jenkins, GitHub, Debugging the code, and error handling.

- Experience in Building end to end ETL Pipelines

- Self-starter & resourceful personality with the ability to manage pressure situations.

- Experience working with geographically distributed teams.

- Work on high- level business and technical problems, contribute to architectural decisions.

- Create the core framework/ templates that gives a starting point for the team members to get started with implementation/ execution.

Role & Responsibilities :

- Build Data and ETL pipelines in Hadoop.

- Support migration of data to the cloud using Big Data Technologies like Spark, Hive, Hadoop, Scala, Python

- Interact with customers daily to ensure smooth engagement.

- Exposure to GCP

- Responsible for timely and quality deliveries.

- Exposure to Scrum and Agile Development best practices

- Fulfil organization responsibilities


- Sharing knowledge and experience within the other groups in the organization, conducting various technical sessions and training.

(ref:hirist.tech)
  • AWS Data Engineer

    3 weeks ago


    Pune, Maharashtra, India HNM Solutions Full time

    Note : Only Immediate JoinerRole : AWS Data EngineerLocation : Pune, IndiaExperience : 8 YearsJD: Roles and responsibilities :- With over 8 yrs. of hands-on experience with Data Technologies - Requirement analysis and assess the technical feasibility of proposed solutions. - Act as the technical specialist in designing and recommending architecture for...


  • Pune, Maharashtra, India HuQuo Consulting Pvt. Ltd. Full time

    Job Description :- 5-8 years of total experience of solid data engineering experience, especially in Open Source, data-intensive, distributed environments with minimum 5 years of experience in big data related technologies like Spark, Hive, HBase, Hadoop, etc. Programming background : - Mandatory- Scala, Spark and Java / Python - Experience in following...


  • Pune, Maharashtra, India Bask HR Consulting Pvt ltd Full time

    Job Description : - Build, design and, implement our highly scalable, fault-tolerant big data platform to process terabytes of data and provide customers with in depth analytics.- Developing Big Data pipelines using modern technology stacks such as Spark, Hadoop, Kafka, HBase, Hive, and Presto.- Developing analytics applications using modern technology...

  • Data Architect

    5 hours ago


    Pune, Maharashtra, India THRIVEFORCE PRIVATE LIMITED Full time

    Job Description : Skill Sets : Looking for Banking domain or Finance domain - Overall 12+ years of experience with a 3+ years of relevant experience as data architect or data specialist.- Proficiency in Data Design, Data Modelling, schema modelling across SQL, BigData and No-SQL technologies.- In Depth knowledge on database technologies such as Oracle,...

  • AI/ML Engineer

    1 month ago


    Pune, Maharashtra, India ARR Recruitment Solutions Full time

    We are seeking a highly skilled Senior AI/ML Engineer with extensive experience in data integration, data processing, and building applications that handle large-scale data in the order of Terabytes from multiple sources. The ideal candidate will possess strong programming skills, particularly in Python, along with proficiency in AWS services and tools such...

  • Big Data Engineer

    1 month ago


    Pune, Maharashtra, India HyrEzy Talent Solutions Full time

    Role : Big Data EngineerAbout Organization :Our Client is an IT consulting organization focused on providing AI Led Digital Transformation Consulting services to enterprise customers. They have adopted AI First strategy to drive value in form of Agility, Quality, Efficiency, Competitive advantage, Customer experience as core principles. Our focus is to drive...


  • Pune, Maharashtra, India timesjobs Full time

    Job DescriptionThe role entails building data processing frameworks that handle the businesss growing database and maintaining optimized and highly available data pipelines that facilitate deeper analysis and reporting by the Data and Analytics department.NutaNXT Technologies offers a compelling and rewarding work environment. We offer market competitive...

  • WovV Technologies

    1 month ago


    Pune, Maharashtra, India WovV Technologies Full time

    Location : Pune (Hybrid Work module compulsory, WFH not available).Experience : 5-7 years.Contract Duration : Contract position for 6 months (can be extended).Mandatory Technology : Product development, Application development, Spark, Apache Airflow, Snowflake, BigQuery.Role and Responsibilities :- Scala is a mandatory skill here.- Please ensure that the...

  • Data Engineer

    5 hours ago


    Pune, Maharashtra, India Krishna Global Services Pvt. Ltd Full time

    Job Opportunity : Data Engineer. Location : Pune. Experience : 3 to 6 Years. We are seeking a highly skilled Data Engineer to join our team in Pune. The ideal candidate will possess strong stakeholder management abilities, excellent communication skills, and solid technical expertise in SQL/PLSQL, ETL tools, Big Query, and Cloud technologies.Key...

  • Technical Architect

    3 weeks ago


    Pune, Maharashtra, India Consulting Pandits Full time

    Job Description :Mandatory Skills :- 7-15 years of total experience in software development - At least 4 years of experience with Big data technologies- Proficiency in at least one of the following programming languages : Python/Scala/Java- Experience of development and deployment of at least two end-to-end big data solutions- Understanding of RDBMS-...

  • Big Data Engineer

    1 month ago


    Pune, Maharashtra, India Consulting Pandits Full time

    Mandatory Skills:- 4+ years' experience in software development with Big data technologies- Proficiency in at least one of the following programming languages: Java/Scala/Python- Experience of development and deployment of at least one end-to-end data storage/processing pipeline- Basic understanding of RDBMS- Intermediate level expertise in Apache Spark,...

  • Data Engineer

    24 hours ago


    Pune, Maharashtra, India worldline Full time

    Data Engineer M2C PuneThis is Worldline We are the innovators at the heart of the payments technology industry, shaping how the world pays and gets paid. The solutions our people build today power the growth of millions of businesses tomorrow. From your local coffee shop to unicorns and international banks. From San Francisco to Auckland. We are in every...


  • Pune, Maharashtra, India Workday Full time

    Your work days are brighter here.At Workday, it all began with a conversation over breakfast. When our founders met at a sunny California diner, they came up with an idea to revolutionize the enterprise software market. And when we began to rise, one thing that really set us apart was our culture. A culture which was driven by our value of putting our people...


  • Pune, Maharashtra, India sistemasgl Full time

    We are a digitally native company that helps organizations reinvent themselves and unleash their potential. We are the place where innovation, design and engineering meet scale. Globantis 20 years old, NYSE listed public organization with more than 27,000 employees worldwide working out of 25 countries globally. Positions Open: Azure Data EngineerExperience:...

  • AWS Data Engineer

    5 hours ago


    Pune, Maharashtra, India Krishna Global Services Pvt. Ltd Full time

    Job Title : AWS Data Engineer. Location : Pune. Experience Required : 6-9 Years. Job Description : We are looking for a highly skilled AWS Data Engineer with a strong background in data and analytics to join our team in Pune. The ideal candidate will have extensive experience in designing, implementing, and managing data infrastructure on AWS. This role...


  • Pune, Maharashtra, India Zimetrics Technologies Private Limited Full time

    Experience :- 4+ years of data engineering or software engineering- 4+ years building data applications in Scala, Java, and Python- Proficient with distributed data processing with Apache Spark- Proficient with SQL and modern data warehouse platforms - Snowflake, Redshift, Big Query, or Synapse- Proficient with workflow management platforms - Airflow, AWS...

  • Data Engineer

    1 month ago


    Pune, Maharashtra, India ADVANSOFT Full time

    Position: Data EngineerNotice Period: Immediately -20 Days (Early Joiners / Candidates Serving Notice Period will be Preferred)Location: PuneExperience: 5+ yearsMust Skills : Python, Hive, SQL, Airflow, Pyspark, Hadoop, Data Structure, GitHub, Backend Technologies Duration: Full TimeJob Description :Technical & Other Skills :- 5+ years of working experience...

  • Data Engineer

    2 weeks ago


    Pune, Maharashtra, India HNM Solutions Full time

    Note : immediate joinerRole : Data EngineerLocation : Onsite (Pune)Language : EnglishRoles and responsibilities :With over 3+ yrs. of hands-on experience with Data TechnologiesRequirement analysis and assess the technical feasibility of proposed solutions.Act as the technical specialist in designing and recommending architecture for application...

  • Data Engineer

    3 weeks ago


    Pune, Maharashtra, India Nurturing Interns Private Limited Full time

    Role Summery:You will be responsible for Analysing archiving and reporting requirements, source and destination systems and their data models and designing data transformation, archiving, reporting and analytics solutions that meet the functional and non-functional requirements.- You will work closely with Project Managers to deliver the program.Dimension of...

  • Lead/Senior Engineer

    3 weeks ago


    Pune, Maharashtra, India Coders Brain Technology & Private Limited Full time

    To be successful in this role, you should possess :- Collaborate closely with Product Management and Engineering leadership to devise and build the right solution.- Participate in Design discussions and brainstorming sessions to select, integrate, and maintain Big Data tools and frameworks required to solve Big Data problems at scale.- Design and implement...