Data Engineer

5 months ago

Pune, Maharashtra, India HyrEzy Talent Solutions Full time

Job Description and Responsibilities :

  • Solicit business, functional, non-functional and technical requirements through interviewing and requirements gathering process.
  • Analyze and document above requirements and data definitions, perform data analysis, assist in change management, training and testing efforts.
  • Works with stakeholders to gather requirements on merging, de-duplicating, standardizing data.
  • Develop, support, and refine new data pipelines, data models, business logic, data schemas as code, and analytics to product specifications.
  • Prototype and optimize data type checks to ensure data uniformity prior to load.
  • Develop, and refine batch processing data pipeline frameworks.
  • Maintain, improve, and develop expertise in existing production data models, and algorithms.
  • Learn and utilize business data domain knowledge and its correlation to underlying data sources.
  • Define, document, and maintain a data dictionary including data definitions, data sources, business meaning and usage of information.
  • Identify and validate opportunities to reuse existing data and algorithms.
  • Collaborate on design and implementation of data standardization procedures.
  • Share team responsibilities, such as contributing to development of data warehouses and productizing algorithms created by Data Science team members.
  • Participate in on-call and weekly shift rotation.
Skills Set :
  • 4 - 6 years of experience building data pipelines and using ETL tools(Must-have).
  • 2+ years of experience in ETL tools like Talend /Jaspersoft ETL tools(Must-have) .
    2+ years of experience in SQL programming language (Must-have) .
  • Strong in writing stored procedures and sql queries(Must-have).
  • 2+ years of experience in python programming (Must-have) .
  • Sound knowledge of distributed systems and data processing with spark.
  • Knowledge of any tool for scheduling and orchestration of data pipelines or workflows (preferred Airflow)(must to have)
  • 1+ years experience developing modern, industry standard big data frameworks with AWS or other cloud with common GitHub developer practices and paradigms.
  • Experience working with agile methodologies and cross-functional teams.
  • Knowledge in building AWS data pipelines using python, S3 data lake(nice to have).
  • Knowledge of redshift or any other columnar database is preferred.
  • Experience with AWS services including S3, Redshift, EMR (nice to have)
  • Knowledge of distributed systems as it pertains to data storage and computing
  • Knowledge of specialty pharmaceutical and retail pharmacy is a plus.
  • Good to have knowledge of the Data integration process.
  • Ability to effectively communicate with both business and technical teams
Professional Approach :
  • Excellent verbal, written communication.
  • Flexible with the working timing.
Required Qualification : Bachelor of Engineering - Bachelor of Technology (B.E./B. Tech.)

(ref:hirist.tech)

  • Senior Data Engineer

    2 weeks ago

    Pune, Maharashtra, India Data Axle Full time

    About Data Axle:Data Axle Inc. has been a leading provider of data, marketing solutions, sales, and research for 50 years in the US. With a strategic global centre of excellence in Pune, Data Axle delivers mission-critical data services to its global customers powered by its proprietary cloud-based technology platform and leveraging proprietary business &...

  • Senior Data Engineer

    1 week ago

    Pune, Maharashtra, India Data Axle Full time

    About Data AxleData Axle Inc. is a leading provider of data, marketing solutions, sales, and research. With a 50-year history in the US, the company has established a strategic global centre of excellence in Pune, delivering mission-critical data services to its global customers powered by its proprietary cloud-based technology platform and leveraging...

  • Senior Data Engineer

    6 days ago

    Pune, Maharashtra, India Data Axle Full time

    About Data AxleData Axle Inc. has been a leading provider of data, marketing solutions, sales, and research for over five decades in the US. Our global centre of excellence in Pune delivers mission-critical data services to our customers worldwide, leveraging our proprietary cloud-based technology platform and business & consumer databases.Job SummaryWe are...

  • Senior Data Engineer

    2 days ago

    Pune, Maharashtra, India Data Axle Full time

    About Data Axle Data Axle Inc. has been a leading provider of data, marketing solutions, sales and research for decades in the US. We have established a strategic global centre of excellence in Pune, delivering mission-critical data services to our global customers through our proprietary cloud-based technology platform and leveraging our proprietary...

  • Data Engineer

    2 weeks ago

    Pune, Maharashtra, India NTT DATA Services Full time

    Job Title: Data EngineerLocation: Pune, IndiaWe are seeking a skilled Data Engineer to join our team in Pune, India. As a Data Engineer, you will work on exciting big data related projects that require processing large data sets from various sources. You will design and code stable and scalable data ingestion workflows and integrate them into existing...

  • Data Engineer

    2 weeks ago

    Pune, Maharashtra, India NTT DATA Services Full time

    Job Title: Data Engineer - Big Data SpecialistWe are seeking a highly skilled Data Engineer to join our team in Pune, India. As a Data Engineer, you will work on exciting big data related projects that require large data sets to be processed via a vendor sourced solution on a daily, weekly and monthly basis.Key Responsibilities:Analyzing data sets and...

  • Senior Data Engineer

    2 weeks ago

    Pune, Maharashtra, India NTT DATA Services Full time

    Req ID: 298868 NTT DATA is a global leader in business and technology services, committed to helping clients innovate, optimize and transform for long term success. We are seeking a talented Senior Data Engineer to join our team in India.About the Role:We are looking for a skilled Data Engineer with expertise in designing and developing big data platforms....

  • Senior Data Engineer

    2 weeks ago

    Pune, Maharashtra, India NTT DATA Services Full time

    Senior Data EngineerWe are seeking a highly skilled Senior Data Engineer to join our team in Pune, India. As a key member of our data engineering team, you will be responsible for designing and developing big data platforms using Spark, HBase, Hive, and other Hadoop ecosystem technologies.Key Responsibilities:Design and develop big data platforms using...

  • AWS Data Engineer

    6 days ago

    Pune, Maharashtra, India NTT DATA Services Full time

    Job Title: AWS Data EngineerAbout the Role:We are seeking a highly skilled AWS Data Engineer to join our team at NTT DATA Services. As an AWS Data Engineer, you will be responsible for designing, developing, and deploying data pipelines on Amazon Web Services (AWS).Key Responsibilities:Design and develop data pipelines using AWS services such as Glue,...

  • Senior Data Engineer

    6 days ago

    Pune, Maharashtra, India NTT DATA Services Full time

    Job Requirements:We are seeking a highly skilled Senior Data Engineer to join our team at NTT DATA Services. The ideal candidate will have a strong background in data engineering, with expertise in designing and developing big data platforms.Key Responsibilities:Design and develop big data platforms using Spark, HBase, Hive, and other Hadoop ecosystem...

  • Senior Data Engineer

    1 week ago

    Pune, Maharashtra, India NTT DATA Services Full time

    Job Requirements:We are seeking a highly skilled Senior Data Engineer to join our team in Pune, India. The ideal candidate will have a bachelor degree with 5+ years of programming experience on data platforms.Key Responsibilities:Design and develop big data platforms using expertise in Data Engineering.Deep understanding of data processing technology stacks:...

  • Senior Data Engineer Lead

    2 weeks ago

    Pune, Maharashtra, India Data Axle India Full time

    Job Title: Senior Data Engineer LeadData Axle India is a leading provider of data, marketing solutions, sales, and research services. We are seeking a highly experienced and dynamic Senior Data Engineer Lead to join our team.Key Responsibilities:Lead and manage a team of data engineers to design and implement scalable and efficient data solutions.Provide...

  • Data Axle India Technical Lead

    2 weeks ago

    Pune, Maharashtra, India Data Axle India Full time

    Job Title: Technical Lead - Data EngineerData Axle India is a leading provider of data, marketing solutions, sales, and research services. We are seeking a highly experienced Technical Lead - Data Engineer to join our team.Key Responsibilities:Lead and manage a team of data engineers to design, develop, and deploy scalable and efficient data...

  • AWS Data Engineer

    7 days ago

    Pune, Maharashtra, India NTT DATA Services Full time

    Job SummaryWe are seeking a highly skilled AWS Data Engineer to join our team in Pune, Madhya Pradesh, India. The successful candidate will contribute to our client and have the following responsibilities:Key ResponsibilitiesWork with technical development team and team lead to understand desired application capabilities.Develop code using Python, such as...

  • Data Analyst

    2 weeks ago

    Pune, Maharashtra, India Data Dynamics Full time

    Job Title: Data ScientistObjective:We are seeking a highly skilled Data Scientist to join our team at Data Dynamics. As a Data Scientist, you will play a key role in developing and deploying machine learning models to drive business growth and improve customer experiences.Key Responsibilities:Custom Model Development: Design, develop, and deploy custom...

  • Senior Data Architect

    2 weeks ago

    Pune, Maharashtra, India Data Axle Full time

    About Data AxleData Axle Inc. is a leading provider of data, marketing solutions, and research services. With a strategic global centre of excellence in Pune, we deliver mission-critical data services to our global customers using our proprietary cloud-based technology platform and leveraging our proprietary business & consumer databases.Job SummaryWe are...

  • Senior Data Engineer Lead

    1 week ago

    Pune, Maharashtra, India Data Axle India Full time

    Data Axle India is seeking a highly experienced Technical Lead - Data Engineer to join its team in Pune. The ideal candidate will possess strong expertise in Python, PySpark, and AWS technologies, specifically Glue, S3, Redshift, Lambda, and EMR. Knowledge of .NET, C#, and Angular is advantageous but not mandatory.Key Responsibilities:Lead and manage a team...

  • Digital Engineering Sr. Engineer

    6 days ago

    Pune, Maharashtra, India NTT DATA Full time

    Job Title: Digital Engineering Sr. EngineerJob Summary:We are seeking a highly skilled Digital Engineering Sr. Engineer to join our team in Pune, India. The successful candidate will be responsible for designing and implementing custom accelerators, infrastructure, and automation frameworks.Key Responsibilities:Design and implement custom accelerators,...

  • Senior Data Scientist

    2 weeks ago

    Pune, Maharashtra, India Data Axle Full time

    About Data AxleData Axle Inc. is a leading provider of data, marketing solutions, and research services with a 50-year history in the USA. Our global centre of excellence in Pune delivers mission-critical data services to customers worldwide, leveraging our proprietary cloud-based technology platform and business & consumer databases.Job SummaryWe are...

  • Digital Engineering Sr. Engineer

    2 weeks ago

    Pune, Maharashtra, India NTT DATA Full time

    Job Title: Digital Engineering Sr. EngineerJob Summary: We are seeking a highly skilled Digital Engineering Sr. Engineer to join our team in Remote, Mahārāshtra (IN-MH), India (IN). The successful candidate will be responsible for designing, developing, and implementing software solutions using NetSuite technology infrastructure.Key Responsibilities:Design...