Data Engineer

4 weeks ago

Pune, India NonStop Full time

About NonStop io Technologies :

NonStop io Technologies is a value-driven company with a strong focus on process-oriented software engineering.

We specialize in Product Development and have a decade's worth of experience in building web and mobile applications across various domains.

NonStop io Technologies follows core principles that guide its operations and believes in staying invested in a product's vision for the long term.

We are a small but proud group of individuals who believe in the 'givers gain' philosophy and strive to provide value in order to seek value.

We are committed to and specialize in building cutting-edge technology products and serving as trusted technology partners for startups and enterprises.

We pride ourselves on fostering innovation, learning, and community engagement.

Join us to work on impactful projects in a collaborative and vibrant environment.

Brief Description :

We are looking for a talented Data Engineer to join our team.

In this role, you will design, implement, and manage data pipelines, ensuring the accessibility and reliability of data for critical business processes.

This is an exciting opportunity to work on scalable solutions that power data-driven decisions

Skillset :

Here is a list of some of the technologies you will work with (the list below is not set in stone)

Data Pipeline Orchestration and Execution :

- AWS Glue

- AWS Step Functions

- Databricks Change

Data Capture :

- Amazon Database Migration Service

- Amazon Managed Streaming for Apache Kafka with Debezium Plugin

Batch :

- AWS step functions (and Glue Jobs)

- Asynchronous queueing of batch job commands with RabbitMQ to various ETL Jobs

- Cron and subervisord processing on dedicated job server(s) : Python & PHP

Streaming :

- Real-time processing via AWS MSK (Kafka), Apache Hudi, & Apache Flink

- Near real-time processing via worker (listeners) spread over AWS Lambda, custom server (daemons) written in Python and PHP Symfony

- Languages : Python & PySpark, Unix Shell, PHP Symfony (with Doctrine ORM)

- Monitoring & Reliability : Datadog & Cloudwatch

Things you will do :

- Build dashboards using Datadog and Cloudwatch to ensure system health and user support

- Build schema registries that enable data governance

- Partner with end-users to resolve service disruptions and evangelize our data product offerings

- Vigilantly oversee data quality and alert upstream data producers of issues

- Support and contribute to the data platform architecture strategy, roadmap, and implementation plans to support the companys data-driven initiatives and business objective

- Work with Business Intelligence (BI) consumers to deliver enterprise-wide fact and dimension data product tables to enable data-driven decision-making across the organization.

- Other duties as assigned


(ref:hirist.tech)

  • Data Engineer

    4 weeks ago

    Pune, India Data Axle Full time

    About Data Axle: Data Axle Inc. has been an industry leader in data, marketing solutions, sales and research for 50 years in the US. Data Axle has set a strategic global centre of excellence in Pune. This centre delivers mission critical data services to its global customers powered by its proprietary cloud-based technology platform and leveraging...

  • Data Engineer

    2 weeks ago

    Pune, Maharashtra, India Data Axle Full time ₹ 15,00,000 - ₹ 28,00,000 per year

    About Data Axle:Data Axle Inc. has been an industry leader in data, marketing solutions, sales and research for 50 years in the US. Data Axle has set a strategic global centre of excellence in Pune. This centre delivers mission critical data services to its global customers powered by its proprietary cloud-based technology platform and leveraging proprietary...

  • Data Engineer

    4 weeks ago

    Pune, India Jash Data Sciences Full time

    Do you love solving real-world data problems with the latest and best techniques? And having fun while solving them in a team Then come join our high-energy team of passionate data people. Jash Data Sciences is the right place for you. We are a cutting-edge Data Sciences and Data Engineering startup based in Pune, India. We believe in continuous learning and...

  • Senior Data Engineer

    2 weeks ago

    Pune, India Data Axle Full time

    Job Description About Data Axle: Data Axle Inc. has been an industry leader in data, marketing solutions, sales and research for 50 years in the US. Data Axle has set up a strategic global centre of excellence in Pune. This centre delivers mission critical data services to its global customers powered by its proprietary cloud-based technology...

  • Data Engineer

    4 weeks ago

    Pune, Maharashtra, India NTT DATA Full time

    Req ID 324612NTT DATA strives to hire exceptional innovative and passionate individuals who want to grow with us If you want to be part of an inclusive adaptable and forward-thinking organization apply now We are currently seeking a Data Engineer to join our team in Pune Mahxc4x81rxc4x81shtra IN-MH India IN Key Responsibilities Design and...

  • Data Operations Engineer

    4 weeks ago

    Pune, India Mars Data Insights Full time

    Title: Data Operations Engineer & RUN Support Skills: Data Operations Engineering, data manipulation, Python, Talend, GCP, Bigquery, DataIku, ITSM/ticketing tools, Helix, Jira, task management, data pipelines,  RUN Service, data infrastructure, data quality  Job Location: Pune  Job Type: Fulltime/Hybrid  Work Experience: 5+ years  We are seeking a...

  • Azure Data Engineer

    6 days ago

    Pune, India Fragma Data Systems Full time

    Job Description Technology Skills - Building and operationalizing large scale enterprise data solutions and applications using one or more of AZURE data and analytics services in combination with custom solutions - Azure Synapse/Azure SQL DWH, Azure Data Lake, Azure Blob Storage, Spark, HDInsights, Databricks, CosmosDB, EventHub/IOTHub. - Experience in...

  • Data Architect

    1 week ago

    Pune, India NTT DATA Full time

    **Req ID**:229970 We are currently seeking a Data Architect to join our team in Pune, Mah\u0101r\u0101shtra (IN-MH), India (IN). **Technical Skill Sets (mandatory)**: - Must have significant level knowledge on implementing cloud data warehouses - Snowflake, AWS Redshift, Azure SQL Data Warehouse, or Google BigQuery experience considered - Must have...

  • Data Scientist

    4 days ago

    Pune, Maharashtra, India Data Dynamics Full time

    **Objectives of this role**: - Collaborate with product design and engineering teams to develop an understanding of needs. - Research and devise innovative statistical models for data analysis. - Build innovative models and integrate them in our product. - Communicate findings to all stakeholders. - Keep current with technical and industry...

  • Mid Data Science

    2 weeks ago

    Pune, India NTT DATA Full time

    Job Description Req ID:     NTT DATA strives to hire exceptional, innovative and passionate individuals who want to grow with us. If you want to be part of an inclusive, adaptable, and forward-thinking organization, apply now. We are currently seeking a Mid Data Science & AIML, GenAI Lead/Engineer to join our team in Pune, Mahārāshtra (IN-MH), India...