Data/Platform Engineer

4 weeks ago


Noida, India Minutes to Seconds Pty Ltd Full time
Job Description
About the job

At Minutes to Seconds, we match people having great skills with tailor-fitted jobs to achieve well-deserved success. We know how to match people to the right job roles to create that perfect fit. This changes the dynamics of business success and catalyzes the growth of individuals. Our aim is to provide both our candidates and clients with great opportunities and the ideal fit every time. We have partnered with the best people and the best businesses in Australia in order to achieve success on all fronts. We’re passionate about doing an incredible job for our clients and job seekers. Our success is determined by the success of individuals at the workplace.

We would love the opportunity to work with YOU

Minutes to Seconds is looking for an Data/Platform Engineer in a Contract position.

RequirementsJob Overview

The primary goal of developers is efficiency, consistency, scalability and reliability.

 We are responsible for the Platform … all the tooling integrations, security, access-control, data classification/management, orchestration, self-service “lab” concept, observability, reliability … as well as data availability (data ingestion)

 We are NOT responsible for – Data Modeling, Data Warehousing, Reporting (PowerBI)

… although we do work with PBI team for access control from PBI to Snowflake.

 Everything we do is achieved through code – nothing is manual (or ClickOps) – everything is automated – through the effectiveness of our CI/CD framework – GitHub, GitHub-Actions, Terraform, Python.

Orchestration is centrally managed using Managed Airflow

We manage RBAC / Access Control

We’re responsible for Tooling Integrations and all the connectivity and authentication requirements

·         Ingestion Methods/Patterns

o    Fivetran

o    Snowflake-Snowpipe (File-Based sources)

o    Snowflake-Secure Data Share

·         Solid Software Development (Full SDLC) Experience with excellent Coding skills:

o    Python (required).

o    Good knowledge of Git and GitHub (required)

o    Good code-management experience/best practices (required).

·         Understanding of CI/CD to automate and improve the efficiency, speed, and reliability of software delivery.

    • Best Practices/principals
    • Github Actions
      • automate workflows directly from their GitHub repositories.
      • Automation of building, testing, and deploying code – inc. code linting, security scanning, and version management.
    • Experience with testing frameworks
    • Good knowledge of IaC (Infrastructure as Code) using Terraform (required)
      • EVERYTHING we do is IaC
  • Strong verbal and written skills are a must, ideally with the ability to communicate in both technical and some business language
  • A good level of experience with cloud technologies – AWS - namely S3, Lambda, SQS, SNS, API Gateway (API Development), Networking (VPCs), PrivateLink and Secrets Manager.
  • Extensive hands-on experience engineering data pipelines and a solid understanding of the full data supply chain, from discovery & analysis, data ingestion, processing & transformation, to consumption/downstream data-integration.

·         A passion for continuous improvement and learning, for optimization both in terms of cost and efficiency, as well as ways of working. Obsessed with data observability (aka data reconciliation), ensuring pipeline and data integrity.

  • Experience working with large structured/semi-structured datasets
    • A good understanding of Parquet, Avro, JSON/XML
  • Experience with Apache Airflow / MWAA or similar orchestration tooling.
  • Experience with Snowflake as a Data Platform
    • Solid understanding of Snowflake Architecture – compute, storage, partitioning etc.
    • Key features - such as COPY-INTO, Snowpipe, object-level tagging and masking policies
    • RBAC (security model) – design and administration – intermediate skill required

o    query performance tuning, and zero copy clone – nice to have

o    virtual warehouse (compute) sizing

  • TSQL experience – ability to understand complex queries and think about optimisation - advantageous
  • Data Modelling experience – advantageous
  • Exposure to dbt (data build tool) for data transformations – advantageous
  • Exposure to Alation or other Enterprise Metadata Management (EMM) tooling – advantageous
  • Documentation: architectural designs, operational procedures, and platform configurations to ensure smooth onboarding and troubleshooting for team members.
Please send resume at soumik.saha@minutestoseconds.com

Requirements
Job Description: Extensive experience and ample hands-on using IBM Cognos tool Experience in designing & developing dashboards and complex reports Understanding of India Insurance domain is plus Practical knowledge of connecting Cognos with on-prem DBs (like DB2) and cloud platform database services like GCP BQ , AWS S3/Redshift Good knowledge of using javascript in Cognos reports Knowledge of Cognos Administration is plus Experience in collaborating with cross-functional teams Experience Range: 5 - 8 years Educational Qualifications: B.Tech/B.E Skills Required: IBM cognos tool, AWS, Redshift, GCP BQ. Click to apply the role or get in touch with us at soumik.saha@minutestoseconds.com

  • Noida, India TETRAHED INC Full time

    Job Description : Data Platform Engineer Job Title : Data Platform Engineer Location : India-based - Noida preferred, Chennai or Bangalore optional Job Type : Full-time Band : E2 Job Summary :We are seeking a skilled and motivated Data Platform Engineer to join our team. The role focuses on DB integration, data pre-processing, data pipeline creation, and...


  • Noida, Uttar Pradesh, India Minutes to Seconds Pty Ltd Full time

    Job OverviewAt Minutes to Seconds, we're looking for a skilled Data Platform Engineer to join our team. As a key member of our platform team, you'll be responsible for designing, building, and maintaining our data platform.Key Responsibilities:Development of data pipelines and integrations using Python, Terraform, and AWS services.Design and implementation...


  • Noida, India Infostride Technologies Pvt Ltd Full time

    About the job :As Senior Data Platform Engineer, you'll maintain and build out our Databricks based platform for our solution teams. You'll help to identify meaningful improvements to our infrastructure and pipelines to reduce costs, increase user access without violating HIPAA contracts, and streamline our deployment processes. You'll provide...


  • Noida, India Minutes to Seconds Pty Ltd Full time

    About the job At Minutes to Seconds, we match people having great skills with tailor-fitted jobs to achieve well-deserved success. We know how to match people to the right job roles to create that perfect fit. This changes the dynamics of business success and catalyzes the growth of individuals. Our aim is to provide both our candidates and clients with...


  • Noida, India TETRAHED INDIA Private LIMITED Full time

    Job Title : Data Platform EngineerLocation: India-based - Noida preferred, Chennai or Bangalore optionalJob Type: Full-timeExperience : 5-9 YearsLocation : India-based - Noida preferred, Chennai or Bangalore optionalJob Type : Full-timeJob Summary :We are seeking a skilled and motivated Data Platform Engineer to join our team. The role focuses on DB...


  • Noida, Uttar Pradesh, India Minutes to Seconds Pty Ltd Full time

    About the JobAt Minutes to Seconds, we match people with exceptional skills to tailor-fitted jobs, ensuring well-deserved success. Our goal is to provide both candidates and clients with great opportunities and the ideal fit every time.We're passionate about delivering an exceptional experience for our clients and job seekers. Our success is determined by...


  • Noida, Uttar Pradesh, India Microsoft Full time

    OverviewAs a key member of the Cloud Growth and Insights team, you will play a pivotal role in shaping Microsoft's data platform ecosystem. This involves collaborating with engineering counterparts and business teams to drive innovation and operationalize Azure products, services, and business plans within C+E.The goal of the team is to foster a data-driven...


  • Noida, Uttar Pradesh, India Microsoft Full time

    OverviewMicrosoft is seeking a seasoned cloud data platform engineer to help shape the emerging data platform ecosystem with Cloud and Enterprise. As a key member of the Cloud Growth and Insights team, you will lead the effort of enabling millions of Microsoft customers and partners by delivering key insights on big data.Key ResponsibilitiesArchitect and...

  • Data Engineer

    3 weeks ago


    Noida, Uttar Pradesh, India ET Media Labs Full time

    About the Role:The ideal candidate is a seasoned technologist with hands-on experience in developing scalable data applications and platforms. Strong technical, analytical, and problem-solving skills are essential for success in this position. The ideal candidate must be comfortable working in an agile environment with minimal supervision.Key...


  • Noida, Uttar Pradesh, India Microsoft Full time

    About the RoleWe are seeking a highly skilled Data Platform Leader to join our Cloud Growth and Insights team at Microsoft. This is an exceptional opportunity for someone who wants to shape the emerging data platform ecosystem with Cloud and Enterprise into a competitive differentiator.The goal of our team is to foster a data-driven culture, encourage and...

  • Azure Data Engineer

    2 weeks ago


    Noida, India NuFolks Full time

    Job Description :The Azure data engineer will play a vital role by contributing in building a unified data warehouse platform for the organization on Azure cloud. This involves data modeling, data management, data pipeline creation, ensuring data quality and integrity, ensuring performance and scalability for current and future data models and support for BI...


  • Noida, Uttar Pradesh, India Infostride Technologies Pvt Ltd Full time

    About the JobWe're looking for a skilled Senior Data Platform Engineer to lead our Databricks-based data platform, ensuring high system health, usability, and scalability. As a key member of our team, you'll drive meaningful improvements to our infrastructure and pipelines, focusing on cost reduction, user access, and HIPAA compliance.Key Responsibilities-...

  • Platform Solution

    5 months ago


    Noida, India NTT DATA Full time

    We are currently seeking a Platform Solution - IRM to join our team in Noida, Uttar Pradesh, India. Primary Responsibilities: - Manage work queues for multiple clients, ensure work is well defined and scoped, and assigned to ServiceNow Technical Consultants for development - Lead weekly meetings with clients to discuss their needs and ensure current work...


  • Noida, Uttar Pradesh, India NTT DATA Full time

    Job Title: Digital Engineering Staff EngineerJob Summary:We are seeking a highly skilled Digital Engineering Staff Engineer to join our team in Noida, Uttar Pradesh, India. The successful candidate will have extensive experience in cloud database administration, particularly with PostgreSQL, and a strong background in cloud infrastructure engineering.Key...


  • Noida, Uttar Pradesh, India NTT DATA Services Full time

    About the RoleWe are seeking a highly skilled Network Data Center Engineer to join our team in Noida, Uttar Pradesh, India. As a key member of our team, you will be responsible for designing and implementing network solutions that meet the business requirements of our clients.Key ResponsibilitiesPrepare network designs with bill of materials and detailed...


  • Noida, Uttar Pradesh, India Oracle Full time

    About the RoleThis is a challenging and rewarding opportunity to join our team as a Data Platform Software Developer. As a key member of our software engineering division, you will play a vital role in defining and evolving standard practices and procedures.Job SummaryWe are seeking an experienced Data Platform Software Developer to join our team. In this...


  • Noida, India NTT DATA Services Full time

    Req ID: 288252 NTT DATA Services strives to hire exceptional, innovative and passionate individuals who want to grow with us. If you want to be part of an inclusive, adaptable, and forward-thinking organization, apply now.We are currently seeking a Network Data Center Engineer to join our team in Noida, Uttar Pradesh (IN-UP), India (IN).Role...


  • Noida, Uttar Pradesh, India NTT DATA Full time

    Job Title: CommVault Backup EngineerJob Summary:NTT DATA Services is a global business and IT services provider specializing in digital, cloud and automation across a comprehensive portfolio of consulting, applications, infrastructure and business process services. We are part of the NTT family of companies, a partner to 85% of the Fortune 100.Key...


  • Noida, Uttar Pradesh, India NTT DATA Full time

    Job Title: Senior Desktop Engineering ProfessionalJob Summary:We are seeking a highly skilled Senior Desktop Engineering Professional to join our team at NTT DATA. The ideal candidate will have extensive experience in desktop engineering, SCCM, and Intune operations.Key Responsibilities:Technical engineer supporting EPM desktop engineering SCCM/Intune...


  • Noida, Uttar Pradesh, India Innovaccer Full time

    Innovaccer is seeking a highly skilled Data Ops Engineer-I to join our team and help our customers explore their healthcare data, understand how to improve the health of the population, and bring down the cost of healthcare.