Data Platform Engineer

1 month ago

GurgaonGurugramDelhi NCR, India ARC Consulting Full time

Purpose of the role :

To configure, design, build, and maintain our integration of both software and hardware platforms, collaborating closely with cross-functional teams to ensure our data systems are efficient, scalable, and secure and comply with IT guardrails. As platform SME, this role also consults on change initiatives involving the data platform

Responsibilities :

- To work with the wider IT services & functions to understand requirements for the data platform and data infrastructure and build and evolve platforms to integrate systems and manage varying applications.

- Responsibility for testing to verify that the infrastructure can handle the expected load and can recover from failures and perform functionally in line with IT guardrails and standards.

- Responsibility to configure servers, databases and other services to run applications across our infrastructure.

- To collaborate with IT Services and Functions to ensure data platform reliability, scalability, performance, and security

- Work closely with Architecture to deliver enhancement, incremental value and optimisation to the data platform and infrastructure, secure and manage ingestion methods and ensure the platform is performing as designed

- To apply scripts to bridge both hardware and software across all our platforms and environments to create a seamless experience for the user.

- Develop and maintain platform integration with third party systems and services, ensuring seamless data flow and compatibility

- Work from a prioritised backlog of business and technical priorities to align the data platform to IT strategy and guardrails and to deliver enhanced business value to achieve objectives

- Monitor platform performance and take action to improve performance and overcome issues to enhance user experience and increase efficiency

- To work alongside test resources and release governance to ensure the positive deployment of code to enhance the user experience.

- To maintain the underlying data platform infrastructure including hardware, software, and storage resources to ensure the infrastructure's reliability, scalability and security.

- To implement and manage data governance frameworks, ensuring compliance with regulatory standards and best practices.

- Maintain platform and process documentation to ensure it accurately and appropriately defines the operation, status and relevant data points of the current platform.

- Collaborate with colleagues across services and functions to inform and share best practice, educate on platform concepts and definitions and share knowledge and understanding

- As platform SME, proactively involve yourself in change initiatives and project with potential to impact the data platform, including supporting innovation activity and help to ideate and use expert knowledge to support delivery of change to the platform and related infrastructure.

- Support with knowledge and experience the assessment of additional platform capabilities, tools and emerging technologies in the data and analytics/presentation sphere

- To undertake ad hoc projects and duties as and when required, to support the needs of the business or to achieve departmental objectives.

Critical skills required :

- Ability to apply logical thinking to bridge the software/hardware gap in real-life situations.

- Ability to problem solve and identify solutions.

- Ability to analyse multiple sources of data to interpret performance and opportunities for enhancement

- Ability to manage multiple priorities and stakeholders to meet business needs while ensuring compliance and regulatory requirements.

- Technical understanding of data platform and application development, maintenance and best practice

- Critical knowledge required

- Knowledge of scripting code applications such as Python, Java etc

- Knowledge and in-depth understanding of code debugging

- In depth knowledge of database technologies (e.g. SQL)

- Knowledge of Apache Spark, Kafka, or similar

- Technical expertise in Azure cloud, Azure Data Storage and Azure DataBricks

- Good understanding of alerting and monitoring best practices

- In depth knowledge of data ingestion and integration methods and the ability to select the right option for the relevant scenario

- Expertise of scripting languages and frameworks in a complex environment to help streamline the process of deploying and managing infrastructure.

- An understanding of scripting languages, frameworks and templates in a complex environment to streamline the process of deploying and managing infrastructure (e.g Arm, Terraform)

Experience required :

Essential :

- Strong proficiency in SQL and experience with database technologies (e.g., PostgreSQL, MySQL, or NoSQL databases)

- Proven experience in designing, building, and optimising data pipelines and ETL processes.

- Experience working with Azure cloud, Azure DataBricks, Azure Data Lake and PowerBI

- A minimum of 2 years experience in a similar role

(ref:hirist.tech)

  • Data Platform Engineer

    3 days ago

    Delhi, India OSD Data Services Full time

    Data Platform EngineerLocation: RemoteType: InternshipAbout UsAt OSD Data, we’re redefining how businesses leverage their data. Our mission is to empower organizations with a seamless, unified, and scalable data infrastructure that enables smarter decision-making and faster innovation. With a focus on data lakehouse technologies, we’ve built a...

  • Data platform engineer

    3 days ago

    Delhi, India OSD Data Services Full time

    Data Platform Engineer Location : RemoteType : InternshipAbout Us At OSD Data, we’re redefining how businesses leverage their data. Our mission is to empower organizations with a seamless, unified, and scalable data infrastructure that enables smarter decision-making and faster innovation. With a focus on data lakehouse technologies, we’ve...

  • Data Platform Engineer

    3 days ago

    Delhi, India OSD Data Services Full time

    Data Platform EngineerLocation : RemoteType : InternshipAbout UsAt OSD Data, we’re redefining how businesses leverage their data. Our mission is to empower organizations with a seamless, unified, and scalable data infrastructure that enables smarter decision-making and faster innovation. With a focus on data lakehouse technologies, we’ve built a...

  • Data Warehouse Engineer | Data Warehouse Engineer | delhi

    2 weeks ago

    delhi, India Data Warehouse Engineer Full time

    Experience : 2- 5 YearsPrimary Skills : Strong SQL knowledge, Data warehouse concepts and ETL hands on experience, Azure services like Data Factory, Azure Data Lake, and Good analysis skills.Good to have skills: Power BI, Databricks, Python.

  • Data Warehouse Engineer

    2 weeks ago

    Delhi, India Data Warehouse Engineer Full time

    Experience : 2- 5 YearsPrimary Skills : Strong SQL knowledge, Data warehouse concepts and ETL hands on experience, Azure services like Data Factory, Azure Data Lake, and Good analysis skills.Good to have skills: Power BI, Databricks, Python.

  • Senior Data Integration Engineer

    2 weeks ago

    Delhi, India Senior Data Integration Engineer Full time

    Must Have Skills/Skill Requirement:Design and architect integration solutions to connect various enterprise applications, systems, and databases.Develop and implement integration workflows, APIs, and data pipelines to enable smooth communication and data exchange between different applications.Utilize Azure Integration Services such as Azure Logic Apps,...

  • Senior Data Integration Engineer

    2 weeks ago

    Delhi, India Senior Data Integration Engineer Full time

    Must Have Skills/Skill Requirement:- Design and architect integration solutions to connect various enterprise applications, systems, and databases.- Develop and implement integration workflows, APIs, and data pipelines to enable smooth communication and data exchange between different applications.- Utilize Azure Integration Services such as Azure Logic...

  • Senior Data Integration Engineer | Senior Data Integration Engineer | delhi

    2 weeks ago

    delhi, India Senior Data Integration Engineer Full time

    Must Have Skills/Skill Requirement:Design and architect integration solutions to connect various enterprise applications, systems, and databases.Develop and implement integration workflows, APIs, and data pipelines to enable smooth communication and data exchange between different applications.Utilize Azure Integration Services such as Azure Logic Apps,...

  • Senior data integration engineer

    2 weeks ago

    Delhi, India Senior Data Integration Engineer Full time

    Must Have Skills/Skill Requirement:Design and architect integration solutions to connect various enterprise applications, systems, and databases.Develop and implement integration workflows, APIs, and data pipelines to enable smooth communication and data exchange between different applications.Utilize Azure Integration Services such as Azure Logic Apps,...

  • OSD Data Services | Data Platform Engineer | india

    3 days ago

    Delhi, India OSD Data Services Full time

    Data Platform Engineer Location : RemoteType : InternshipAbout Us At OSD Data, we’re redefining how businesses leverage their data. Our mission is to empower organizations with a seamless, unified, and scalable data infrastructure that enables smarter decision-making and faster innovation. With a focus on data lakehouse technologies, we’ve built a...

  • Full Stack Data Migration Engineer for Recruitment Platform

    3 days ago

    Delhi, Delhi, India Atlas - the Recruitment Platform Full time

    About Atlas TechnologiesAt Atlas Technologies, we're revolutionizing the recruitment industry with our innovative anti-CRM platform. Our mission is to empower recruitment professionals by automating data entry and providing a user-friendly experience.Job SummaryWe're seeking an experienced Full Stack Data Migration Engineer to join our team. As a key member...

  • Atlas - the Recruitment Platform | Data Engineer - migrations | delhi

    3 weeks ago

    delhi, India Atlas - the Recruitment Platform Full time

    Before you start reading, please read this carefully! I've spent a good amount of time thinking about what to write :D Who we are Atlas Technologies is an anti-CRM built solely for recruitment professionals. A customer relationship management tool is a required software to run any business. The problem is that data entry is extremely onerous and these...

  • Data Engineer

    2 weeks ago

    Delhi NCR/Gurgaon/Gurugram, India Drimlite Full time

    Job Description :- Design and build data pipelines using Spark-SQL and PySpark in Azure DatabricksJob Description : - Design and build ETL pipelines using ADF- Build and maintain a Lakehouse architecture in ADLS / Databricks.- Perform data preparation tasks including data cleaning, normalization, deduplication, type conversion etc.- Work with DevOps team to...

  • Engineering Director

    5 months ago

    Gurugram, India American Express Full time

    You Lead the Way. We’ve Got Your Back. With the right backing, people and businesses have the power to progress in incredible ways. When you join Team Amex, you become part of a global and diverse community of colleagues with an unwavering commitment to back our customers, communities, and each other. Here, you will learn and grow as we help you create...

  • Data Platform Engineer

    3 weeks ago

    delhi, India GeoTech Full time

    Location:(Remote, with occasional travel to Riyadh, Saudi Arabia)Department:Data and AIEmployment Type:Full-timeAbout GeoTechGeoTech is at the forefront of data-driven innovation, combining cutting-edge technology with advanced geospatial analytics. Our solutions empower businesses with actionable insights, leveraging the power of AI, computer vision, and...

  • Data Platform Engineer

    3 weeks ago

    Gurgaon, Haryana, India dentsu Full time

    Company OverviewDentsu is a global advertising and public relations agency with a rich history of innovation. With operations in 145 countries, the company provides comprehensive integrated communications, media, and digital services to its clients.The Dentsu Group encompasses two operational networks: dentsu japan network and dentsu international. The...

  • Data Platform Engineer

    3 weeks ago

    delhi, India GeoTech Full time

    Location: [Remote, with occasional travel to Riyadh, Saudi Arabia] Department: Data and AI Employment Type: Full-time About GeoTech GeoTech is at the forefront of data-driven innovation, combining cutting-edge technology with advanced geospatial analytics. Our solutions empower businesses with actionable insights, leveraging the power of AI, computer...

  • Data Platform Engineer

    3 weeks ago

    Delhi, India GeoTech Full time

    Location:(Remote, with occasional travel to Riyadh, Saudi Arabia)Department:Data and AIEmployment Type:Full-timeAbout GeoTechGeoTech is at the forefront of data-driven innovation, combining cutting-edge technology with advanced geospatial analytics. Our solutions empower businesses with actionable insights, leveraging the power of AI, computer vision, and...

  • Data platform engineer

    2 weeks ago

    Delhi, India GeoTech Full time

    Location: (Remote, with occasional travel to Riyadh, Saudi Arabia)Department: Data and AIEmployment Type: Full-timeAbout Geo TechGeo Tech is at the forefront of data-driven innovation, combining cutting-edge technology with advanced geospatial analytics. Our solutions empower businesses with actionable insights, leveraging the power of AI, computer...

  • Data Platform Engineer

    3 weeks ago

    delhi, India GeoTech Full time

    Location: (Remote, with occasional travel to Riyadh, Saudi Arabia)Department: Data and AIEmployment Type: Full-timeAbout GeoTechGeoTech is at the forefront of data-driven innovation, combining cutting-edge technology with advanced geospatial analytics. Our solutions empower businesses with actionable insights, leveraging the power of AI, computer vision,...