Data Engineer

3 weeks ago


Pune, India ElementSkill Full time

Key Responsibilities :

- Design, develop, and optimize scalable data processing pipelines using Spark and PySpark.

- Implement Spark optimization techniques to enhance performance and efficiency.

- Develop and execute complex SQL queries for data manipulation and transformation.

- Collaborate closely with data scientists, analysts, and engineering teams to address data needs.

- Work with AWS Cloud services such as Redshift, AWS Glue, SQL Server, and Databricks.

- Use Python for data processing tasks, ensuring modularization, packaging, and reusability.

- Basic knowledge of Informatica for data integration.

- Engage in real-time data streaming and integration with tools like NiFi, Kafka, and EventHub (preferred but optional).

- Hands-on experience with Snowflake for data warehousing and analytics.

Required Skills :

- Spark Expertise : Proven experience in Spark and PySpark, including optimization techniques.

- Complex SQL : Strong knowledge of SQL and hands-on experience with complex data processing.

- Cloud Exposure : Familiarity with AWS services (Redshift, Glue, etc.) and Databricks.

- Python Proficiency : Expertise in Python for data processing, scripting, and automation.

- Data Streaming : Experience with NiFi, Kafka, and EventHub is a plus.

- Informatica : Basic understanding of Informatica tools and their integration with other systems.

- Snowflake : Hands-on experience with Snowflake for data warehousing and analytics.

(ref:hirist.tech)

  • Pune, Maharashtra, India Data Dynamics Full time

    About Data Dynamics">Data Dynamics is a leading data-driven company that leverages cutting-edge technologies to drive business growth. Our team of experts collaborates with clients across various industries to deliver innovative solutions.Job Summary">We are seeking an experienced Senior Machine Learning Specialist to join our team. As a key member, you will...

  • Data Architect

    6 days ago


    Pune, India NTT DATA Full time

    **Req ID**:229970 We are currently seeking a Data Architect to join our team in Pune, Mah\u0101r\u0101shtra (IN-MH), India (IN). **Technical Skill Sets (mandatory)**: - Must have significant level knowledge on implementing cloud data warehouses - Snowflake, AWS Redshift, Azure SQL Data Warehouse, or Google BigQuery experience considered - Must have...

  • Data Scientist

    7 months ago


    Pune, Maharashtra, India Data Dynamics Full time

    **Objectives of this role**: - Collaborate with product design and engineering teams to develop an understanding of needs. - Research and devise innovative statistical models for data analysis. - Build innovative models and integrate them in our product. - Communicate findings to all stakeholders. - Keep current with technical and industry...


  • Pune, India Data Axle Full time

    **About Data Axle**: - Data Axle Inc. has been an industry leader in data, marketing solutions, sales and research for 50 years in the USA. Data Axle has set up a strategic global centre of excellence in Pune. This centre delivers mission critical data services to its global customers powered by its proprietary cloud-based technology platform and by...


  • Pune, India Data Axle Full time

    **About Data Axle**: Data Axle Inc. has been an industry leader in data, marketing solutions, sales and research for 50 years in the USA. Data Axle has set up a strategic global centre of excellence in Pune. This centre delivers mission critical data services to its global customers powered by its proprietary cloud-based technology platform and by leveraging...

  • Data Scientist

    3 weeks ago


    Pune, Maharashtra, India Data Axle Full time

    **About Data Axle**: **Data Axle Inc. has been an industry leader in data, marketing solutions, sales and research for over 45 years in the USA. Data Axle has set up a strategic global centre of excellence in Pune. This centre delivers mission critical data services to its global customers powered by its proprietary cloud-based technology platform and by...

  • Data Entry

    1 week ago


    Pune, India Optimeret Data Solutions Full time

    **Optimeret Data Solutions** PUNE Welcome to **Optimeret Data Solutions** This guide is meant to provide team-specific information to help you get to know the great and productive work we do at ODS. **JOB PURPOSE** **DATA ENTRY EXECUTIVE** **DUTIES AND RESPONSIBILITIES** 1. Transfer data from paper/digital formats into computer files or database...

  • Data Architect

    6 days ago


    Pune, India NTT Data Services Full time

    **Req ID**: 229970 We are currently seeking a Data Architect to join our team in Pune, Mahārāshtra (IN-MH), India (IN). Technical Skill Sets (mandatory): - Must have significant level knowledge on implementing cloud data warehouses - Snowflake, AWS Redshift, Azure SQL Data Warehouse, or Google BigQuery experience considered - Must have significant level...


  • Pune, Maharashtra, India NTT DATA Full time

    **Req ID**: 304038 We are currently seeking a Data Governance Architect to join our team in Pune, Mahārāshtra (IN-MH), India (IN). Job Duties: Lead the data management practice that includes but not limited to - Data Governance/catalog - MDM - Data Quality - Testing Minimum Skills Required: Must have experience in data analysis, data engineering for 10+...

  • Data Scientist

    3 months ago


    Pune, India Data Dynamics Full time

    Objective of this role :- Collaborate with product design and engineering teams to develop an understanding of needs.- Research and devise innovative statistical models for data analysis.- Build innovative models and integrate them in our product.- Communicate findings to all stakeholders.- Keep current with technical and industry developments. Key...

  • Data Scientist

    1 month ago


    Pune, India Data Dynamics Full time

    Objective of this role :- Collaborate with product design and engineering teams to develop an understanding of needs.- Research and devise innovative statistical models for data analysis.- Build innovative models and integrate them in our product.- Communicate findings to all stakeholders.- Keep current with technical and industry developments. Key...

  • Data Scientist

    4 months ago


    Pune, Maharashtra, India Data Direct Networks Full time

    Overview: This is an incredible opportunity to be part of a company that has been at the forefront of AI and high performance data storage innovation for over two decades. DDN Storage is a global market leader renowned for powering many of the world's most demanding AI data centers, in industries ranging from life sciences and healthcare, to financial...


  • Pune, Maharashtra, India Data Axle Full time

    Data Axle Inc. has been an industry leader in data, marketing solutions, sales, and research for over 50 years in the USA. Data Axle now has an established strategic global centre of excellence in Pune. This centre delivers mission critical data services to its global customers powered by its proprietary cloud-based technology platform and by leveraging...


  • Pune, Maharashtra, India Data Axle Full time

    Data Axle Inc. has been an industry leader in data, marketing solutions, sales, and research for over 50 years in the USA. Data Axle now has an established strategic global centre of excellence in Pune. This centre delivers mission critical data services to its global customers powered by its proprietary cloud-based technology platform and by leveraging...

  • Data Scientist

    3 months ago


    Pune, Maharashtra, India Optimum Data Analytics Full time

    **Skills: Computer Vision + Image Processing+ OCR+Document Processing Python + Tesserac, AL/ML, Gen AI/LLM** - Extensive knowledge of data science and data engineering methodologies including but not limited to classical regression, machine learning, deep learning, association rules, sequence analysis, cluster analysis, computer vision and natural language...


  • Pune, Maharashtra, India Data Dynamics Full time

    About Data DynamicsWe are a forward-thinking organization seeking a highly skilled Data Science Expert for Machine Learning and NLP to join our team. As a key member of our data science division, you will be responsible for developing and deploying innovative machine learning models to drive business growth.Estimated Salary: $140,000 - $180,000 per yearJob...


  • Pune, Maharashtra, India Data Dynamics Full time

    **About the Role**We are seeking a talented Storage Solutions Engineer to join our team at Data Dynamics.The ideal candidate will have a strong background in storage solutions and excellent communication skills.Responsibilities:Design and implement scalable storage architectures for clients.Conduct technical assessments to identify customer...


  • Pune, India Data Dynamics Full time

    Company DescriptionData Dynamics is a global leader in enterprise data management, focusing on Digital Trust and Data Democracy. Trusted by over 300 organizations, including 25% of the Fortune 20, Data Dynamics is committed to creating a transparent, unified, and empowered data ecosystem. The company's AI-powered self-service data management software...

  • Data Dynamics

    4 weeks ago


    Pune, India Data Dynamics Full time

    As a Storage Solutions Architect at Data Dynamics, you will play a pivotal role in shaping our customers' data management strategies. You will be responsible for understanding their unique business needs, recommending optimal storage solutions, and ensuring seamless implementation. This position requires a blend of technical expertise, strong...

  • Data engineer

    4 weeks ago


    Pune, India NorthStar HR Consultants Full time

    Job Title - Data EngineerJob Location - PuneAbout Client -Our client is a cutting-edge Data Sciences and Data Engineering startup based in Pune, India. They believe in continuous learning and evolving together. And let the data speak!What will you be doing?You will be discovering trends in the data sets and developing algorithms to transform raw data for...