Data Engineer

7 months ago


Pune, India HyrEzy Talent Solutions Full time

Job Description and Responsibilities :

  • Solicit business, functional, non-functional and technical requirements through interviewing and requirements gathering process.
  • Analyze and document above requirements and data definitions, perform data analysis, assist in change management, training and testing efforts.
  • Works with stakeholders to gather requirements on merging, de-duplicating, standardizing data.
  • Develop, support, and refine new data pipelines, data models, business logic, data schemas as code, and analytics to product specifications.
  • Prototype and optimize data type checks to ensure data uniformity prior to load.
  • Develop, and refine batch processing data pipeline frameworks.
  • Maintain, improve, and develop expertise in existing production data models, and algorithms.
  • Learn and utilize business data domain knowledge and its correlation to underlying data sources.
  • Define, document, and maintain a data dictionary including data definitions, data sources, business meaning and usage of information.
  • Identify and validate opportunities to reuse existing data and algorithms.
  • Collaborate on design and implementation of data standardization procedures.
  • Share team responsibilities, such as contributing to development of data warehouses and productizing algorithms created by Data Science team members.
  • Participate in on-call and weekly shift rotation.
Skills Set :
  • 4 - 6 years of experience building data pipelines and using ETL tools(Must-have).
  • 2+ years of experience in ETL tools like Talend /Jaspersoft ETL tools(Must-have) .
    2+ years of experience in SQL programming language (Must-have) .
  • Strong in writing stored procedures and sql queries(Must-have).
  • 2+ years of experience in python programming (Must-have) .
  • Sound knowledge of distributed systems and data processing with spark.
  • Knowledge of any tool for scheduling and orchestration of data pipelines or workflows (preferred Airflow)(must to have)
  • 1+ years experience developing modern, industry standard big data frameworks with AWS or other cloud with common GitHub developer practices and paradigms.
  • Experience working with agile methodologies and cross-functional teams.
  • Knowledge in building AWS data pipelines using python, S3 data lake(nice to have).
  • Knowledge of redshift or any other columnar database is preferred.
  • Experience with AWS services including S3, Redshift, EMR (nice to have)
  • Knowledge of distributed systems as it pertains to data storage and computing
  • Knowledge of specialty pharmaceutical and retail pharmacy is a plus.
  • Good to have knowledge of the Data integration process.
  • Ability to effectively communicate with both business and technical teams
Professional Approach :
  • Excellent verbal, written communication.
  • Flexible with the working timing.
Required Qualification : Bachelor of Engineering - Bachelor of Technology (B.E./B. Tech.)

(ref:hirist.tech)
  • Senior Data Engineer

    7 months ago


    Pune, India Data Axle Full time

    Job Description About Data Axle: Data Axle Inc. has been an industry leader in data, marketing solutions, sales and research for 50 years in the US. Data Axle has set up a strategic global centre of excellence in Pune. This centre delivers mission critical data services to its global customers powered by its proprietary cloud-based technology...


  • Pune, Maharashtra, India Data Dynamics Full time

    About Data Dynamics">Data Dynamics is a leading data-driven company that leverages cutting-edge technologies to drive business growth. Our team of experts collaborates with clients across various industries to deliver innovative solutions.Job Summary">We are seeking an experienced Senior Machine Learning Specialist to join our team. As a key member, you will...


  • Pune, Maharashtra, India NTT DATA Full time

    About the RoleWe are seeking a highly skilled Senior Data Protection Engineer to join our team at NTT DATA. This is an exciting opportunity to work with a leading global innovator of business and technology services.Key Responsibilities:Implement and maintain data protection systems, ensuring high levels of security and efficiency.Configure and manage data...


  • Pune, Maharashtra, India NTT DATA Full time

    About the JobThis exciting opportunity is for a highly skilled Data Centre Backup Engineer to join our team at NTT DATA. As a key member of our data centre operations team, you will be responsible for driving best practices, innovation and process improvements across multiple data centre locations.Key Responsibilities include:Installation and configuration...


  • Pune, Maharashtra, India Data Axle Full time

    About Data Axle:Data Axle Inc. is a 50-year-old industry leader in data, marketing solutions, sales, and research in the US.We have set up a strategic global centre of excellence in Pune, delivering mission-critical data services to our global customers powered by our proprietary cloud-based technology platform and leveraging our proprietary business &...

  • Data Scientist

    6 months ago


    Pune, Maharashtra, India Data Dynamics Full time

    **Objectives of this role**: - Collaborate with product design and engineering teams to develop an understanding of needs. - Research and devise innovative statistical models for data analysis. - Build innovative models and integrate them in our product. - Communicate findings to all stakeholders. - Keep current with technical and industry...

  • Senior Data Scientist

    7 months ago


    Pune, India Data Axle Full time

    Job Description About Data Axle: Data Axle Inc. has been an industry leader in data, marketing solutions, sales and research for 50 years in the USA. Data Axle has set up a strategic global centre of excellence in Pune. This centre delivers mission critical data services to its global customers powered by its proprietary cloud-based technology...

  • Data Scientist

    7 days ago


    Pune, Maharashtra, India Data Axle Full time

    **About Data Axle**: **Data Axle Inc. has been an industry leader in data, marketing solutions, sales and research for over 45 years in the USA. Data Axle has set up a strategic global centre of excellence in Pune. This centre delivers mission critical data services to its global customers powered by its proprietary cloud-based technology platform and by...


  • Pune, Maharashtra, India NTT DATA Full time

    Job TitleA Digital Engineering Sr. Engineer position is available at NTT DATA in Remote, India.About the RoleWe are seeking an experienced Digital Engineering Sr. Engineer to join our team. The ideal candidate will have a strong background in digital engineering and be able to work independently with minimal supervision.About the CompanyNTT DATA is a $30...


  • Pune, Maharashtra, India NTT DATA Full time

    **Req ID**: 304038 We are currently seeking a Data Governance Architect to join our team in Pune, Mahārāshtra (IN-MH), India (IN). Job Duties: Lead the data management practice that includes but not limited to - Data Governance/catalog - MDM - Data Quality - Testing Minimum Skills Required: Must have experience in data analysis, data engineering for 10+...


  • Pune, Maharashtra, India NTT DATA Full time

    About the RoleWe are seeking a Chief Data Governance Strategist to join our team in Pune, India. This role is responsible for leading our data management practice and implementing best practices in data governance, master data management, and data quality.Key Responsibilities:Develop and implement data governance policies and proceduresLead the development...

  • Data Scientist

    2 months ago


    Pune, India Data Dynamics Full time

    Objective of this role :- Collaborate with product design and engineering teams to develop an understanding of needs.- Research and devise innovative statistical models for data analysis.- Build innovative models and integrate them in our product.- Communicate findings to all stakeholders.- Keep current with technical and industry developments. Key...

  • Data Scientist

    3 weeks ago


    Pune, India Data Dynamics Full time

    Objective of this role :- Collaborate with product design and engineering teams to develop an understanding of needs.- Research and devise innovative statistical models for data analysis.- Build innovative models and integrate them in our product.- Communicate findings to all stakeholders.- Keep current with technical and industry developments. Key...

  • Data Scientist

    3 months ago


    Pune, Maharashtra, India Data Direct Networks Full time

    Overview: This is an incredible opportunity to be part of a company that has been at the forefront of AI and high performance data storage innovation for over two decades. DDN Storage is a global market leader renowned for powering many of the world's most demanding AI data centers, in industries ranging from life sciences and healthcare, to financial...


  • Pune, India NTT DATA Full time

    Job Description Req ID: 295083 NTT DATA strives to hire exceptional, innovative and passionate individuals who want to grow with us. If you want to be part of an inclusive, adaptable, and forward-thinking organization, apply now.We are currently seeking a Digital Engineering Engineer to join our team in Pune, Mahārāshtra (IN-MH), India (IN).Job Duties:...


  • Pune, Maharashtra, India Data Axle Full time

    Data Axle Inc. has been an industry leader in data, marketing solutions, sales, and research for over 50 years in the USA. Data Axle now has an established strategic global centre of excellence in Pune. This centre delivers mission critical data services to its global customers powered by its proprietary cloud-based technology platform and by leveraging...


  • Pune, Maharashtra, India Data Axle Full time

    Data Axle Inc. has been an industry leader in data, marketing solutions, sales, and research for over 50 years in the USA. Data Axle now has an established strategic global centre of excellence in Pune. This centre delivers mission critical data services to its global customers powered by its proprietary cloud-based technology platform and by leveraging...


  • Pune, India NTT DATA Full time

    Job Description Req ID: 292804 NTT DATA Services strives to hire exceptional, innovative and passionate individuals who want to grow with us. If you want to be part of an inclusive, adaptable, and forward-thinking organization, apply now.We are currently seeking a Digital Engineering Engineer to join our team in Pune, Mahārāshtra (IN-MH), India...

  • Software Engineer

    7 months ago


    Pune, India Data Axle Full time

    Job Description About Data Axle: Data Axle Inc. has been an industry leader in data, marketing solutions, sales and research for 50 years in the US. Data Axle has set up a strategic global centre of excellence in Pune. This centre delivers mission critical data services to its global customers powered by its proprietary cloud-based technology...


  • Pune, India NTT DATA Full time

    Job Description Req ID: 277728 NTT DATA Services strives to hire exceptional, innovative and passionate individuals who want to grow with us. If you want to be part of an inclusive, adaptable, and forward-thinking organization, apply now.We are currently seeking a Digital Engineering Lead Engineer to join our team in Pune, Mahārāshtra (IN-MH), India...