Data Engineer

4 weeks ago


Pune, India NonStop Full time

About NonStop io Technologies : NonStop io Technologies is a value-driven company with a strong focus on process-oriented software engineering. We specialize in Product Development and have a decade's worth of experience in building web and mobile applications across various domains. NonStop io Technologies follows core principles that guide its operations and believes in staying invested in a product's vision for the long term. We are a small but proud group of individuals who believe in the 'givers gain' philosophy and strive to provide value in order to seek value. We are committed to and specialize in building cutting-edge technology products and serving as trusted technology partners for startups and enterprises. We pride ourselves on fostering innovation, learning, and community engagement. Join us to work on impactful projects in a collaborative and vibrant environment.Brief Description : We are looking for a talented Data Engineer to join our team. In this role, you will design, implement, and manage data pipelines, ensuring the accessibility and reliability of data for critical business processes. This is an exciting opportunity to work on scalable solutions that power data-driven decisionsSkillset : Here is a list of some of the technologies you will work with (the list below is not set in stone)Data Pipeline Orchestration and Execution : - AWS Glue- AWS Step Functions- Databricks ChangeData Capture : - Amazon Database Migration Service- Amazon Managed Streaming for Apache Kafka with Debezium PluginBatch : - AWS step functions (and Glue Jobs)- Asynchronous queueing of batch job commands with RabbitMQ to various ETL Jobs- Cron and subervisord processing on dedicated job server(s) : Python & PHPStreaming : - Real-time processing via AWS MSK (Kafka), Apache Hudi, & Apache Flink- Near real-time processing via worker (listeners) spread over AWS Lambda, custom server (daemons) written in Python and PHP Symfony- Languages : Python & PySpark, Unix Shell, PHP Symfony (with Doctrine ORM)- Monitoring & Reliability : Datadog & CloudwatchThings you will do : - Build dashboards using Datadog and Cloudwatch to ensure system health and user support- Build schema registries that enable data governance- Partner with end-users to resolve service disruptions and evangelize our data product offerings- Vigilantly oversee data quality and alert upstream data producers of issues- Support and contribute to the data platform architecture strategy, roadmap, and implementation plans to support the companys data-driven initiatives and business objective- Work with Business Intelligence (BI) consumers to deliver enterprise-wide fact and dimension data product tables to enable data-driven decision-making across the organization.- Other duties as assigned (ref:hirist.tech)


  • Data Engineer

    6 days ago


    Pune, Maharashtra, India Jash Data Sciences Full time ₹ 15,00,000 - ₹ 25,00,000 per year

    Do you love solving real-world data problems with the latest and best techniques? And having fun while solving them in a team Then come join our high-energy team of passionate data people. Jash Data Sciences is the right place for you.We are a cutting-edge Data Sciences and Data Engineering startup based in Pune, India.We believe in continuous learning and...


  • Pune, India Data Axle Full time

    Job Description About Data Axle: Data Axle Inc. has been an industry leader in data, marketing solutions, sales and research for 50 years in the US. Data Axle has set up a strategic global centre of excellence in Pune. This centre delivers mission critical data services to its global customers powered by its proprietary cloud-based technology platform and...


  • Pune, Maharashtra, India Data Axle Full time ₹ 15,00,000 - ₹ 30,00,000 per year

    About Data Axle:Data Axle Inc.  has been an industry leader in data, marketing solutions, sales, and research for over 50 years in the USA. Data Axle now as an established strategic global centre of excellence in Pune. This centre delivers mission critical data services to its global customers powered by its proprietary cloud-based technology platform and...


  • Pune, Maharashtra, India NTT DATA Full time

    Req ID: 345385NTT DATA strives to hire exceptional, innovative and passionate individuals who want to grow with us. If you want to be part of an inclusive, adaptable, and forward-thinking organization, apply now. We are currently seeking a Business Consulting-Data Engineer with Power BI to join our team in Pune, Mahārāshtra (IN-MH), India (IN).Job...


  • Pune, India NTT Data Full time

    Job Description NTT DATA strives to hire exceptional, innovative and passionate individuals who want to grow with us. If you want to be part of an inclusive, adaptable, and forward-thinking organization, apply now. We are currently seeking a Data Engineer Senior Consultant to join our team in Pune, Mahrshtra (IN-MH), India (IN). Location: | Experience: 5+...


  • Pune, Maharashtra, India Data Axle Full time

    About Data Axle Data Axle Inc has been an industry leader in data marketing solutions sales and research for over 45 years in the US Data Axle has set up a strategic global centre of excellence in Pune This centre delivers mission critical data services to its global customers powered by its proprietary cloud-based technology platform and leveraging...

  • Data Scientist

    5 days ago


    Pune, Maharashtra, India Data Axle Full time ₹ 12,00,000 - ₹ 36,00,000 per year

    About Data Axle:Data Axle Inc.  has been an industry leader in data, marketing solutions, sales and research for over 45 years in the USA. Data Axle has set up a strategic global centre of excellence in Pune. This centre delivers mission critical data services to its global customers powered by its proprietary cloud-based technology platform and by...

  • Data Scientist

    6 days ago


    Pune, Maharashtra, India Data Axle Full time ₹ 12,00,000 - ₹ 36,00,000 per year

    About Data Axle:Data Axle Inc. has been an industry leader in data, marketing solutions, sales and research for over 45 years in the USA. Data Axle has set up a strategic global centre of excellence in Pune. This centre delivers mission critical data services to its global customers powered by its proprietary cloud-based technology platform and by leveraging...

  • Data Scientist

    1 week ago


    Pune, Maharashtra, India Data Dynamics Full time

    **Objectives of this role**: - Collaborate with product design and engineering teams to develop an understanding of needs. - Research and devise innovative statistical models for data analysis. - Build innovative models and integrate them in our product. - Communicate findings to all stakeholders. - Keep current with technical and industry...


  • Pune, India Data Axle Full time

    Job Description About Data Axle: Data Axle Inc. has been an industry leader in data, marketing solutions, sales and research for 50 years in the USA. Data Axle has set up a strategic global centre of excellence in Pune. This centre delivers mission critical data services to its global customers powered by its proprietary cloud-based technology platform and...