Senior Data Platform Engineer

1 month ago

Bengaluru, India Zyoin group Full time

The Opportunity :

We are seeking a highly skilled and experienced Senior Data Platform Engineer to join our dynamic team.

You will play a pivotal role in designing, developing, implementing, and maintaining our data platform that supports large-scale data processing and analytics.

Responsibilities :

- Design, develop, and maintain scalable and robust data pipelines using distributed processing frameworks (e.g., Spark, Presto).

- Optimize Spark and/or Presto workloads for performance, efficiency, and cost-effectiveness.

- Deep dive into Spark/Presto source code to understand internal workings and troubleshoot complex issues (familiarity with open-source contributions a plus).

- Leverage extensive experience in distributed systems (e.g., Hadoop ecosystem) to build reliable and fault-tolerant data solutions.

- Develop and implement multithreaded programs while ensuring effective concurrency control mechanisms.

- Create comprehensive testing strategies, including unit, e2e, and performance/scale tests, utilizing debuggers and profilers for in-depth analysis.

- Manage and configure data platform infrastructure on public cloud platforms (AWS or GCP).

- Collaborate with Data Scientists, Analysts, and DevOps engineers to understand data needs and translate them into technical solutions.

- Stay up-to-date on the latest advancements in data platforms, distributed processing frameworks, and cloud technologies.

Qualifications :

- 5+ years of experience as a Data Platform Engineer or a similar role.

- Strong Java programming expertise with a deep understanding of object-oriented programming principles and design patterns.

- Solid foundation in operating systems concepts, algorithms, and data structures.

- Extensive experience in distributed systems, multithreaded programming, and concurrency control mechanisms.

- Hands-on experience in creating unit, e2e, and performance/scale tests; proficient with remote debuggers and profilers.

- In-depth knowledge and experience with public cloud platforms (AWS or GCP), including infrastructure management and configuration.

- Bachelor of Science (BS) or Master of Science (MS) degree in Computer Science or a related field (or equivalent experience).

(ref:hirist.tech)

  • Senior Software Engineer

    4 weeks ago

    Bengaluru, India Mimecast Full time

    Senior Software Engineer – Data Platform TeamThe driving force behind Big Data at MimecastDive into the forefront of innovation with our Data Platform engineering team, where we process massive volumes of data to delight our customers with insights they love! Our pioneering Data Platform pushes on the boundaries of what’s possible, leveraging the latest...

  • Senior Software Engineer

    2 weeks ago

    Bengaluru, India Yuma Energy Full time

    Role SummaryThis role as Senior Software Engineer - Data Platforms provides an exceptional opportunity for an experienced software engineer passionate about delivering high-quality, reliable, and automated infrastructure based on CI/CD, code quality, test coverage, and containerization. The role poses exciting challenges in a dynamic environment conducive to...

  • Senior Software Engineer

    1 month ago

    Bengaluru, India Mimecast Full time

    Senior Software Engineer – Data Platform TeamThe driving force behind Big Data at MimecastDive into the forefront of innovation with our Data Platform engineering team, where we process massive volumes of data to delight our customers with insights they love! Our pioneering Data Platform pushes on the boundaries of what’s possible, leveraging the latest...

  • Senior Software Engineer

    4 weeks ago

    Bengaluru, India Yuma Energy Full time

    Role Summary This role as Senior Software Engineer - Data Platforms provides an exceptional opportunity for an experienced software engineer passionate about delivering high-quality, reliable, and automated infrastructure based on CI/CD, code quality, test coverage, and containerization. The role poses exciting challenges in a dynamic environment conducive...

  • Senior Software Engineer

    3 weeks ago

    Bengaluru, India Yuma Energy Full time

    Role Summary This role as Senior Software Engineer - Data Platforms provides an exceptional opportunity for an experienced software engineer passionate about delivering high-quality, reliable, and automated infrastructure based on CI/CD, code quality, test coverage, and containerization. The role poses exciting challenges in a dynamic environment conducive...

  • Senior Software Engineer

    4 weeks ago

    Bengaluru, India Yuma Energy Full time

    Role Summary This role as Senior Software Engineer - Data Platforms provides an exceptional opportunity for an experienced software engineer passionate about delivering high-quality, reliable, and automated infrastructure based on CI/CD, code quality, test coverage, and containerization. The role poses exciting challenges in a dynamic environment conducive...

  • Senior Data Platform Engineer

    4 weeks ago

    Bengaluru, India Livestream Full time

    We're seeking an innovative, solution-oriented Data Engineer to join our dynamic Data Ops team. Your mission is to develop, maintain, and scale a sophisticated platform for product and event analytics capable of handling vast amounts of data. This exciting role will see you at the heart of transformative projects, turning complex datasets into accessible...

  • Senior Principal Software Engineer

    4 weeks ago

    Bengaluru, India Mimecast Full time

    Senior Principal Software Engineer – Data Platform TeamThe driving force behind Big Data at MimecastDive into the forefront of innovation with our Data Platform engineering team, where we process massive volumes of data to delight our customers with insights they love! Our pioneering Data Platform pushes on the boundaries of what’s possible, leveraging...

  • Senior Data Platform Engineer

    1 month ago

    Bengaluru, India Livestream Full time

    We're seeking an innovative, solution-oriented Data Engineer to join our dynamic Data Ops team. Your mission is to develop, maintain, and scale a sophisticated platform for product and event analytics capable of handling vast amounts of data. This exciting role will see you at the heart of transformative projects, turning complex datasets into accessible...

  • Senior/Staff Software Engineer

    2 weeks ago

    Bengaluru, India Squareroot Consulting Pvt Ltd Full time

    Job Description : - We are looking for a motivated senior technical leader who wants to have a big impact at a fast-growing Platform company.- You'll work on our cloud data platform and the connectors that bring in data from many sources we support.- We're looking for someone who can understand the key values that make our product great and...

  • Senior Backend Engineer

    4 weeks ago

    Bengaluru, India Fortanix Full time

    Fortanix is a dynamic start-up solving some of the world’s most demanding data protection challenges for companies and governments around the world. Our disruptive technology maintains data privacy across its entire lifecycle -- at rest, in motion, and in use across any enterprise IT infrastructure -- public cloud, on-premise, hybrid cloud, and SaaS.With...

  • Senior Principal Software Engineer

    1 month ago

    Bengaluru, India Mimecast Full time

    Senior Principal Software Engineer – Data Platform TeamThe driving force behind Big Data at MimecastDive into the forefront of innovation with our Data Platform engineering team, where we process massive volumes of data to delight our customers with insights they love! Our pioneering Data Platform pushes on the boundaries of what’s possible, leveraging...

  • Senior Backend Engineer

    1 month ago

    Bengaluru, India Fortanix Full time

    Fortanix is a dynamic start-up solving some of the world’s most demanding data protection challenges for companies and governments around the world. Our disruptive technology maintains data privacy across its entire lifecycle -- at rest, in motion, and in use across any enterprise IT infrastructure -- public cloud, on-premise, hybrid cloud, and SaaS.With...

  • Sr. Data Platform Engineer

    4 weeks ago

    Bengaluru, India Avis Budget Group Full time

    DescriptionJob Summary:The Data Platform team in Avis is a level 3 technology specialist team to roll out new capabilities in to cloud to support data engineers, analysts, and business teams. We help to unlock the full value of data available with in enterprise systems to our partners and internal teams to achieve our business goals. Team is geographically...

  • Senior Data Engineer

    2 weeks ago

    Bengaluru, India Rakuten Symphony Full time

    Job BriefOur Data Platform team is building a world-class autonomous data service platform to cater services such as data lake as a service, database as a service, data transformation as a service and AI services.We are looking for a Data Engineer to help us build functional systems for our data platform services.For our autonomous data platform services as...

  • Sr. Data Platform Engineer

    1 month ago

    Bengaluru, India Avis Budget Group Full time

    Description Job Summary: The Data Platform team in Avis is a level 3 technology specialist team to roll out new capabilities in to cloud to support data engineers, analysts, and business teams. We help to unlock the full value of data available with in enterprise systems to our partners and internal teams to achieve our business goals. Team...

  • Senior Engineer, Data

    1 month ago

    Bengaluru, India News Corp Full time

    Job Description : Senior Engineer, Data One of the most innovative and high-profile teams in News Corp is looking for a seasoned data engineer to help accelerate its vision. The role will involve combining all of News Corp’s data across categories, countries and organizations into a singular view of a customer enabling engagement, measurement and...

  • Senior Data Engineer

    1 month ago

    Bengaluru, India Mitchell Martin Inc. Full time

    JOB DESCRIPTION The client is building the Data Center of Excellence team in Bangalore, India. The client is looking to hire Senior Data Engineers. The Client Data and Commercial Technology Team is looking for Senior Data Engineers with a passion for building robust, scalable, efficient, and high-quality Data Engineering solutions to join our Engineering...

  • Senior Data Engineer

    1 month ago

    Bengaluru, India Mitchell Martin Inc. Full time

    JOB DESCRIPTIONThe client is building the Data Center of Excellence team in Bangalore, India. The client is looking to hire Senior Data Engineers.The Client Data and Commercial Technology Team is looking for Senior Data Engineers with a passion for building robust, scalable, efficient, and high-quality Data Engineering solutions to join our Engineering...

  • Senior Data Engineer

    1 month ago

    Bengaluru, India Mitchell Martin Inc. Full time

    JOB DESCRIPTIONThe client is building the Data Center of Excellence team in Bangalore, India. The client is looking to hire Senior Data Engineers.The Client Data and Commercial Technology Team is looking for Senior Data Engineers with a passion for building robust, scalable, efficient, and high-quality Data Engineering solutions to join our Engineering...