Data Engineer

1 month ago


Pune, Maharashtra, India HyrEzy Talent Solutions Full time

Job Description and Responsibilities :

  • Solicit business, functional, non-functional and technical requirements through interviewing and requirements gathering process.
  • Analyze and document above requirements and data definitions, perform data analysis, assist in change management, training and testing efforts.
  • Works with stakeholders to gather requirements on merging, de-duplicating, standardizing data.
  • Develop, support, and refine new data pipelines, data models, business logic, data schemas as code, and analytics to product specifications.
  • Prototype and optimize data type checks to ensure data uniformity prior to load.
  • Develop, and refine batch processing data pipeline frameworks.
  • Maintain, improve, and develop expertise in existing production data models, and algorithms.
  • Learn and utilize business data domain knowledge and its correlation to underlying data sources.
  • Define, document, and maintain a data dictionary including data definitions, data sources, business meaning and usage of information.
  • Identify and validate opportunities to reuse existing data and algorithms.
  • Collaborate on design and implementation of data standardization procedures.
  • Share team responsibilities, such as contributing to development of data warehouses and productizing algorithms created by Data Science team members.
  • Participate in on-call and weekly shift rotation.
Skills Set :
  • 4 - 6 years of experience building data pipelines and using ETL tools(Must-have).
  • 2+ years of experience in ETL tools like Talend /Jaspersoft ETL tools(Must-have) .
    2+ years of experience in SQL programming language (Must-have) .
  • Strong in writing stored procedures and sql queries(Must-have).
  • 2+ years of experience in python programming (Must-have) .
  • Sound knowledge of distributed systems and data processing with spark.
  • Knowledge of any tool for scheduling and orchestration of data pipelines or workflows (preferred Airflow)(must to have)
  • 1+ years experience developing modern, industry standard big data frameworks with AWS or other cloud with common GitHub developer practices and paradigms.
  • Experience working with agile methodologies and cross-functional teams.
  • Knowledge in building AWS data pipelines using python, S3 data lake(nice to have).
  • Knowledge of redshift or any other columnar database is preferred.
  • Experience with AWS services including S3, Redshift, EMR (nice to have)
  • Knowledge of distributed systems as it pertains to data storage and computing
  • Knowledge of specialty pharmaceutical and retail pharmacy is a plus.
  • Good to have knowledge of the Data integration process.
  • Ability to effectively communicate with both business and technical teams
Professional Approach :
  • Excellent verbal, written communication.
  • Flexible with the working timing.
Required Qualification : Bachelor of Engineering - Bachelor of Technology (B.E./B. Tech.)

(ref:hirist.tech)
  • Data Engineer

    20 hours ago


    Pune, Maharashtra, India worldline Full time

    Data Engineer M2C PuneThis is Worldline We are the innovators at the heart of the payments technology industry, shaping how the world pays and gets paid. The solutions our people build today power the growth of millions of businesses tomorrow. From your local coffee shop to unicorns and international banks. From San Francisco to Auckland. We are in every...


  • Pune, Maharashtra, India timesjobs Full time

    Job DescriptionThe role entails building data processing frameworks that handle the businesss growing database and maintaining optimized and highly available data pipelines that facilitate deeper analysis and reporting by the Data and Analytics department.NutaNXT Technologies offers a compelling and rewarding work environment. We offer market competitive...

  • Senior Data Engineer

    4 weeks ago


    Pune, Maharashtra, India timesjobs Full time

    Senior Data EngineerPosition: Senior Data EngineerExperience: 8 yearsJob Location: PuneSkills Required:Developing, maintaining, and documenting reliable and scalable data infrastructure and data products in complex environmentsDevelopment experience in one or more object-oriented programming languages (e.g., Py-spark, Python, Java, C )Experience of working...


  • Pune, Maharashtra, India TeacherOn Full time

    I want to learn from someone who can train me well in Azure Data Engineering topics so that i can take a job as a Data Engineer and be confident while doing it in the real time. I have 6 years of experience in market Reasearch company and know the basics of SQL, Power Bi and Alteryx. If you think you can help me in my career transition, i would be happy to...

  • AWS Data Engineer

    3 weeks ago


    Pune, Maharashtra, India HNM Solutions Full time

    Note : Only Immediate JoinerRole : AWS Data EngineerLocation : Pune, IndiaExperience : 8 YearsJD: Roles and responsibilities :- With over 8 yrs. of hands-on experience with Data Technologies - Requirement analysis and assess the technical feasibility of proposed solutions. - Act as the technical specialist in designing and recommending architecture for...


  • Pune, Maharashtra, India sistemasgl Full time

    We are a digitally native company that helps organizations reinvent themselves and unleash their potential. We are the place where innovation, design and engineering meet scale. Globantis 20 years old, NYSE listed public organization with more than 27,000 employees worldwide working out of 25 countries globally. Positions Open: Azure Data EngineerExperience:...

  • Senior Data Engineer

    2 months ago


    Pune, Maharashtra, India Procore Full time

    Job DescriptionWe're looking for a Data Engineer to join Procore's data platform and who wants to make an impact. This is a great opportunity to work with an amazing team and help them achieve their mission to deliver actionable insights from data to the business. As a member of our Data team, you'll help define the future of our next-generation global data...


  • Pune, Maharashtra, India EDGESOFT Full time

    Project Role : Data Platform EngineerProject Role Description : Assists with the data platform blueprint and design, encompassing the relevant data platform components. Collaborates with the Integration Architects and Data Architects to ensure cohesive integration between systems and data models.Must have Skills : Google BigQueryGood to Have Skills : No...

  • Data Engineer

    1 month ago


    Pune, Maharashtra, India EDGESOFT Full time

    Data Engineer - DBX We are seeking a skilled Data Engineer with 4 to 5 years of experience specializing in DataBricks. The ideal candidate should have a robust understanding and hands-on expertise in PySpark and various components within DataBricks. As a crucial member of our data team, you will play a pivotal role in developing, optimizing, and maintaining...

  • Senior Data Engineer

    1 month ago


    Pune, Maharashtra, India Tekfortune IT India Pvt Ltd Full time

    Role/Title: Senior Data EngineerExperience: 6-10 Years' experienceLocation: PuneNotice period: 0-30days only.Key Skills: Oracle HCM Cloud, Fast formulas, HDL, OTBI, BI PublisherJob Summary:As a Senior Data Engineer, you will support the European World Area using the Windows & Azure suite of Analytics & Data platforms. The focus of the role is on the...

  • AWS Data Engineer

    2 hours ago


    Pune, Maharashtra, India Krishna Global Services Pvt. Ltd Full time

    Job Title : AWS Data Engineer. Location : Pune. Experience Required : 6-9 Years. Job Description : We are looking for a highly skilled AWS Data Engineer with a strong background in data and analytics to join our team in Pune. The ideal candidate will have extensive experience in designing, implementing, and managing data infrastructure on AWS. This role...


  • Pune, Maharashtra, India Workday Full time

    Your work days are brighter here.At Workday, it all began with a conversation over breakfast. When our founders met at a sunny California diner, they came up with an idea to revolutionize the enterprise software market. And when we began to rise, one thing that really set us apart was our culture. A culture which was driven by our value of putting our people...


  • Pune, Maharashtra, India RapidBraiins Full time

    Job Description :- As a MicroStrategy Engineer, you will be responsible for developing and maintaining MicroStrategy applications, ensuring the delivery of high-quality business intelligence solutions.- You will work closely with business analysts, data engineers, and other stakeholders to gather requirements, design reports, and dashboards, and optimize the...

  • Data Engineer

    2 weeks ago


    Pune, Maharashtra, India HNM Solutions Full time

    Note : immediate joinerRole : Data EngineerLocation : Onsite (Pune)Language : EnglishRoles and responsibilities :With over 3+ yrs. of hands-on experience with Data TechnologiesRequirement analysis and assess the technical feasibility of proposed solutions.Act as the technical specialist in designing and recommending architecture for application...


  • Pune, Maharashtra, India NTT Data Vertex Software Inc. Full time

    Apply for Digital Engineering Staff Engineer, Career Progress Consultants in Pune for Year of Experience on


  • Pune, Maharashtra, India Antal International Full time

    Role :As a Senior Software Engineer, you will collaborate closely with the data engineering team and work on developing and maintaining data pipelines, data processing applications, and data integration solutions. You will get a chance to work with brilliant minds in the industry, work on complex use cases enabling steep learning curve, and build products...

  • AWS Data Engineer

    2 weeks ago


    Pune, Maharashtra, India AAR Consultancy Full time

    Role : AWS Data EngineerJob Description :Your role includes :- Collect, manage and convert raw data into usable information for business analysts- Improve data reliability and quality by combining raw information from different sources to create consistent and machine-readable formats- Able to integrate various data types and sources (stream, API, various...

  • Data Engineer

    1 month ago


    Pune, Maharashtra, India SGS Technical Services Pvt. Ltd Full time

    Experience : Total 4+ Years of experience Notice Period : Immediate to 15 daysLocation : PuneJob Title : Data Engineer (Snowflake and Matillion) Job Description : Overview : - Design, implement, and optimize data pipelines and workflows using Snowflake and Matillion to support our data integration, transformation, and analytics initiatives. - Collaborate...


  • Pune, Maharashtra, India Menteechain Consultancy Full time

    Job Description :Seeking an experienced Data Engineering Manager to join our dynamic team remotely from Pune, working with a prestigious client in the telecommunications industry. The successful candidate will be responsible for leading the design, architecture, and delivery of data engineering solutions, ensuring seamless client communication and...

  • Data Engineer

    1 month ago


    Pune, Maharashtra, India ADVANSOFT Full time

    Position: Data EngineerNotice Period: Immediately -20 Days (Early Joiners / Candidates Serving Notice Period will be Preferred)Location: PuneExperience: 5+ yearsMust Skills : Python, Hive, SQL, Airflow, Pyspark, Hadoop, Data Structure, GitHub, Backend Technologies Duration: Full TimeJob Description :Technical & Other Skills :- 5+ years of working experience...