Data Platform Engineer

3 weeks ago


Bengaluru, India RapidBrains Full time

Job Title: Data Platform Engineer

Experience Level:8+years

Location: Hyderabad & Bangalore

Notice Period:0-15 Days


Job Description

We are seeking a talented Platform Engineer with expertise in Data Mesh/Virtualization technologies to join our dynamic team. The ideal candidate will possess a deep understanding of diverse data platforms, emerging technologies, and a proven track record of optimizing data infrastructure for performance and scalability.

Key Responsibilities:

  • Utilize expertise in Data Mesh/Virtualization technologies such as Dremio and Starburst to architect and maintain robust data platforms.
  • Drive optimization and efficiency through the implementation of distributed file and table formats including Iceberg, Delta, and Apache Parquet.
  • Collaborate with cross-functional teams to identify, document, and resolve technical issues and risks.
  • Implement and maintain DevOps-related tools such as GIT, Gitlab, Splunk, and Ansible to streamline development and operations processes.
  • Ensure adherence to incident management, change management, and problem management processes to minimize service disruptions.
  • Develop and maintain scripts using Python and other scripting languages for automation and optimization.

Qualifications:

  • Bachelor's degree in Computer Science, Engineering, or related field.
  • Strong experience in platform engineering/administration with a focus on Data Mesh/Virtualization technologies.
  • Proficiency in distributed file and table formats, Spark, Object Storage (preferably Dell ECS), and metadata management.
  • Solid understanding of hardware systems performance and distributed systems architecture.
  • Familiarity with major Cloud Service Providers, with MS Azure preferred.
  • Proven problem-solving skills and the ability to root-cause technical issues.
  • Excellent communication and collaboration skills.



  • Bengaluru, India New Relic, Inc. Full time

    Data Engineer, Platform Data Engineer, Platform Data Engineer Req ID FY|S&M|#4 Location(s) Bangalore, India; Work arrangement(s) Hybrid (works from home and New Relic office throughout the week), Office (works primarily in a New Relic office) Your opportunity We are looking for a Platform Data Engineer to join us in building a scalable, easy-to-use data...


  • Bengaluru, India Iron Mountain Full time

    At Iron Mountain we know that work, when done well, makes a positive impact for our customers, our employees, and our planet. That’s why we need smart, committed people to join us. Whether you’re looking to start your career or make a change, talk to us and see how you can elevate the power of your work at Iron Mountain. We provide expert, sustainable...


  • Bengaluru, India Dyson Full time

    Senior Data Platform EngineerAbout UsAt Dyson, our dedication to data and analytics excellence is powered by a diverse and collaborative global community, with the Dyson Data Platform team at its core. Our significant investment in cloud technologies and tools has established the team as integral to achieving Dyson's strategic objectives.The TeamThe Dyson...


  • Bengaluru, India Dyson Full time

    Job DescriptionAbout Us:Data and analytics excellence at Dyson is delivered by a diverse and collaborative global community, at the heart of that community is a hub team that enables all others: In Dyson’s Analytics Platform team, there has been significant investment into cloud technologies and tools; combined with an expansive scope and no shortage of...


  • Bengaluru, India Dyson Full time

    Job DescriptionAbout Us:Data and analytics excellence at Dyson is delivered by a diverse and collaborative global community, at the heart of that community is a hub team that enables all others: In Dyson’s Analytics Platform team, there has been significant investment into cloud technologies and tools; combined with an expansive scope and no shortage of...


  • Bengaluru, India Dyson Full time

    Senior Data Platform Engineer About Us At Dyson, our dedication to data and analytics excellence is powered by a diverse and collaborative global community, with the Dyson Data Platform team at its core. Our significant investment in cloud technologies and tools has established the team as integral to achieving Dyson's strategic objectives. The Team...


  • Bengaluru, India Dyson Full time

    Job Description About Us: Data and analytics excellence at Dyson is delivered by a diverse and collaborative global community, at the heart of that community is a hub team that enables all others: In Dyson’s Analytics Platform team, there has been significant investment into cloud technologies and tools; combined with an expansive scope and no...


  • Bengaluru, India Dyson Full time

    Job Description About Us: Data and analytics excellence at Dyson is delivered by a diverse and collaborative global community, at the heart of that community is a hub team that enables all others: In Dyson’s Analytics Platform team, there has been significant investment into cloud technologies and tools; combined with an expansive scope and no...

  • Data Engineer

    1 month ago


    Bengaluru, India Nityo Infotech Full time

    TitleSkills and Education Required DataKey Roles and Responsibilities Exp- 8 to 12 Years Loc- Bangalore NP-15 DAYS Budget – 30 LPA Engineer • Develop, understand, and enhance code in traditional data warehouse environments, data lake, and cloud environments like Snowflake, Azure, Databricks(Data Platform)• Build new end-to-end business intelligence...


  • Bengaluru, India Livestream Full time

    We're seeking an innovative, solution-oriented Data Engineer to join our dynamic Data Ops team. Your mission is to develop, maintain, and scale a sophisticated platform for product and event analytics capable of handling vast amounts of data. This exciting role will see you at the heart of transformative projects, turning complex datasets into accessible...


  • Bengaluru, India New Relic, Inc. Full time

    Lead Data Platform Engineer Lead Data Platform Engineer Lead Data Engineer Req ID FY|S&M|#6 Location(s) Bangalore, India; Work arrangement(s) Hybrid (works from home and New Relic office throughout the week), Office (works primarily in a New Relic office) Your opportunity We are looking for a highly skilled and motivated Lead Data Engineer to join our Data...

  • Data Engineer

    2 months ago


    Bengaluru, India Nityo Infotech Full time

    TitleSkills and Education Required DataKey Roles and Responsibilities Exp- 8 to 12 Years Loc- Bangalore NP-15 DAYS Budget – 30 LPA Engineer • Develop, understand, and enhance code in traditional data warehouse environments, data lake, and cloud environments like Snowflake, Azure, Databricks(Data Platform)• Build new end-to-end business intelligence...


  • Bengaluru, India Livestream Full time

    We're seeking an innovative, solution-oriented Data Engineer to join our dynamic Data Ops team. Your mission is to develop, maintain, and scale a sophisticated platform for product and event analytics capable of handling vast amounts of data. This exciting role will see you at the heart of transformative projects, turning complex datasets into accessible...


  • Bengaluru, India Avis Budget Group Full time

    DescriptionJob Summary:The Data Platform team in Avis is a level 3 technology specialist team to roll out new capabilities in to cloud to support data engineers, analysts, and business teams. We help to unlock the full value of data available with in enterprise systems to our partners and internal teams to achieve our business goals. Team is geographically...

  • Data Engineer I/11

    1 month ago


    Bengaluru, India Antal International Full time

    Job DescriptionWhat youʼll do:• Lead and manage a team of data engineers, providing guidance, mentorship, and support• Collaborate with data scientists and analysts to understand their data needs and develop data solutions that meet those needs• Design, build, and maintain scalable data platforms and pipelines to support the needs of the business•...

  • Data Platform

    1 month ago


    Bengaluru, India Nityo Infotech Full time

    DataKey Roles and Responsibilities Engineer • Develop, understand, and enhance code in traditional data warehouse environments, data lake, and cloud environments like Snowflake, Azure, Databricks(Data Platform)• Build new end-to-end business intelligence solutions- data extraction, ETL processes applied on data to derive useful business insights, and...


  • Bengaluru, India Zyoin group Full time

    About the Role:We are looking for a skilled and experienced Data Platform Engineer to join our team and play a vital role in designing, developing, and maintaining our data infrastructure. You will leverage your expertise in backend technologies, data processing, and cloud platforms to build robust and scalable solutions for data storage, management, and ...

  • Data Platform

    2 months ago


    Bengaluru, India Nityo Infotech Full time

    DataKey Roles and Responsibilities Engineer • Develop, understand, and enhance code in traditional data warehouse environments, data lake, and cloud environments like Snowflake, Azure, Databricks(Data Platform)• Build new end-to-end business intelligence solutions- data extraction, ETL processes applied on data to derive useful business insights, and...

  • Software Engineer II

    1 month ago


    Bengaluru, India Mimecast Full time

    Software Engineer II – Data Platform TeamThe driving force behind Big Data at MimecastDive into the forefront of innovation with our Data Platform engineering team, where we process massive volumes of data to delight our customers with insights they love! Our pioneering Data Platform pushes on the boundaries of what’s possible, leveraging the latest...


  • Bengaluru, India Mimecast Full time

    Senior Software Engineer – Data Platform TeamThe driving force behind Big Data at MimecastDive into the forefront of innovation with our Data Platform engineering team, where we process massive volumes of data to delight our customers with insights they love! Our pioneering Data Platform pushes on the boundaries of what’s possible, leveraging the latest...