Senior Data Platform Engineer

4 weeks ago


Bangalore, Karnataka, India Zyoin group Full time

The Opportunity :

We are seeking a highly skilled and experienced Senior Data Platform Engineer to join our dynamic team.

You will play a pivotal role in designing, developing, implementing, and maintaining our data platform that supports large-scale data processing and analytics.

Responsibilities :

- Design, develop, and maintain scalable and robust data pipelines using distributed processing frameworks (e.g., Spark, Presto).

- Optimize Spark and/or Presto workloads for performance, efficiency, and cost-effectiveness.

- Deep dive into Spark/Presto source code to understand internal workings and troubleshoot complex issues (familiarity with open-source contributions a plus).

- Leverage extensive experience in distributed systems (e.g., Hadoop ecosystem) to build reliable and fault-tolerant data solutions.

- Develop and implement multithreaded programs while ensuring effective concurrency control mechanisms.

- Create comprehensive testing strategies, including unit, e2e, and performance/scale tests, utilizing debuggers and profilers for in-depth analysis.

- Manage and configure data platform infrastructure on public cloud platforms (AWS or GCP).

- Collaborate with Data Scientists, Analysts, and DevOps engineers to understand data needs and translate them into technical solutions.

- Stay up-to-date on the latest advancements in data platforms, distributed processing frameworks, and cloud technologies.

Qualifications :

- 5+ years of experience as a Data Platform Engineer or a similar role.

- Strong Java programming expertise with a deep understanding of object-oriented programming principles and design patterns.

- Solid foundation in operating systems concepts, algorithms, and data structures.

- Extensive experience in distributed systems, multithreaded programming, and concurrency control mechanisms.

- Hands-on experience in creating unit, e2e, and performance/scale tests; proficient with remote debuggers and profilers.

- In-depth knowledge and experience with public cloud platforms (AWS or GCP), including infrastructure management and configuration.

- Bachelor of Science (BS) or Master of Science (MS) degree in Computer Science or a related field (or equivalent experience).

(ref:hirist.tech)

  • Bangalore, Karnataka, India Squareroot Consulting Pvt Ltd Full time

    Job Description : - We are looking for a motivated senior technical leader who wants to have a big impact at a fast-growing Platform company.- You'll work on our cloud data platform and the connectors that bring in data from many sources we support.- We're looking for someone who can understand the key values that make our product great and implement...


  • Bangalore, Karnataka, India https:orangeshark.com Full time

    Senior Platform Engineer - Azure Job Description :About the opportunity :As a Senior Platform Engineer, you are expected to design and develop key components that power our platform. You will be building a secure, scalable and highly performant distributed platform that connects multiple cloud platforms like AWS, Azure, and GCP. Required Experience : Minimum...

  • Senior Data Engineer

    4 weeks ago


    Bangalore, Karnataka, India Squareroot Consulting Pvt Ltd Full time

    We are seeking a highly skilled and experienced Senior Data Engineer to join our team.Location : Bangalore (Work from Office all 5 days)Experience : 6+ YearsRole : Senior Data EngineerThe ideal candidate will have a strong background in big data technologies and extensive hands-on experience with Cloudera, Spark, Hive, HDFS, Flink, Data Lake, and...

  • Senior Data Engineer

    4 weeks ago


    Bangalore, Karnataka, India Muoro Full time

    Job Description :About the role :We are looking for a Senior Data Engineer to join our growing engineering team. As a member of the team:- You will work on enterprise data platforms, architect and implement data lakes both on-prem and in the cloud.- You will be responsible for evolving technical architecture, design and implementation of data solutions using...

  • Vice President

    4 weeks ago


    Bangalore, Karnataka, India Ethos HR Management & Projects Pvt. Ltd Full time

    Job Description (Minimum 100 Characters) Your Responsibility :- Lead efforts in building and delivering the data strategy for data engineering. - Manage development and support of data fabric platform that caters to needs of real time events and batch data processing. - Manage end to end development of data products that include traditional RDBMS and big...

  • Senior Data Engineer

    4 weeks ago


    Bangalore, Karnataka, India TalentPulse Consultant Full time

    Job Description:We are looking for a talented Senior Data Engineer to join our team in Bangalore. As a Senior Data Engineer, you will be responsible for designing, building, and maintaining scalable data pipelines and infrastructure to support our data-driven initiatives. This position offers a hybrid work model, allowing a combination of remote and onsite...

  • Data Engineer

    4 weeks ago


    Bangalore, Karnataka, India Magna Hire Full time

    Responsibilities :Support the data engineering team in implementing analytics solutions, ensuring adherence to project timelines and quality standards.Participate in at least one full implementation lifecycle of dbt (data build tool), contributing to design, development, and deployment phases.Assist senior team members in optimizing dbt models and...


  • Bangalore, Karnataka, India Zyoin group Full time

    About the Role:We are looking for a skilled and experienced Data Platform Engineer to join our team and play a vital role in designing, developing, and maintaining our data infrastructure. You will leverage your expertise in backend technologies, data processing, and cloud platforms to build robust and scalable solutions for data storage, management, and...

  • Data Engineer

    4 weeks ago


    Bangalore, Karnataka, India Intelli Swift Full time

    Data Engineer - Bangalore (Hybrid) Position : Data Engineer Experience : 7-12 Years Notice Period : less than 15-20 days Mode of Hiring : Permanent Work Location : Bangalore (Hybrid Must Have skills : Data Engineer, GCP, Big Query, Python, SQL, big data. Job Requirement Must Have skills : 1. Designing and implementing data pipelines and infrastructure 2....

  • Senior Director

    4 weeks ago


    Bangalore, Karnataka, India Recrud Full time

    Job Description : Recrud is excited to partner with a leading organization in the biopharmaceutical domain to find an exceptional candidate for the role of Senior Director - Data Engineering & Analytics, focusing on commercial technology. This opportunity is based in Bengaluru and offers the chance to be at the forefront of driving technological innovation...

  • Senior Data Engineer

    24 hours ago


    Bangalore, Karnataka, India Scaling Theory Full time

    As a Senior Data Engineer, you will partner with Software Engineers, Data Scientists, and Business Intelligence Engineers. You will gain a deep understanding of our services and the data they produce and become our resident expert in how to transform that data into a format that is useful for analytics and business intelligence. You will proactively help to...


  • Bangalore, Karnataka, India Dashhire Full time

    Job Description :We are seeking a passionate and experienced Senior Platform Engineer to join our dynamic team. In this role, you will play a pivotal role in designing, developing, and maintaining the core components that power our platform. You will collaborate with a talented, distributed team to tackle complex infrastructure challenges and build a secure,...

  • Senior Data Engineer

    4 weeks ago


    Bangalore, Karnataka, India SPN Globe Full time

    Must Have Skills : Spark streaming, Kafka, AWS, Python, Data Engineering, PySpark, CI/CD, Kubernetes, Docker, Dynamo DB.Job Description :1) Proven experience as a Senior Data Engineer.2) A well-rounded engineer with good appetite for learning and ramping up on cutting edge technologies.3) Good analytical and debugging skills with self-starting capabilities...


  • Bangalore, Karnataka, India Ethos HR Management & Projects Pvt. Ltd Full time

    Job Description (Minimum 100 Characters) Your Responsibility :- Lead efforts in building and delivering the data strategy for data engineering. - Manage development and support of data fabric platform that caters to needs of real time events and batch data processing. - Manage end to end development of data products that include traditional RDBMS and big...

  • Platform Architect

    4 weeks ago


    Bangalore, Karnataka, India Dashhire Full time

    We are seeking a highly skilled and experienced Architect specializing in data platforms to join our team. The ideal candidate will have a proven track record of designing, implementing, and optimizing data platforms with a minimum of 25 TB of data. As an Architect, you will be responsible for leading the design and development of scalable, secure, and...


  • Bangalore, Karnataka, India Zyoin group Full time

    Job Description :We are looking for Principal Data Engineers to help us build and enhance big data platforms to achieve availability, scalability, and operational effectiveness. The right individual will embrace the opportunity to tackle challenging problems and use their influence to drive continual improvement.You will also work on the cutting edge of...

  • Senior Director

    1 week ago


    Bangalore, Karnataka, India Recruise India Consulting Full time

    Role : Senior Director - Data Engineering & AnalyticsResponsibilities :- Provide strategic leadership and vision for the data engineering and analytics function, aligning it with the overall business goals.- Lead and manage a diverse team of data engineers, data architects, data scientists, and cloud operations specialists.- Foster a culture of innovation,...


  • Bangalore, Karnataka, India Dashhire Full time

    Actively seeking a Senior Site Reliability Engineer (Senior SRE) to elevate the reliability, scalability, and performance of our cloud management platform.You will be at the forefront of developing and maintaining sophisticated tools and systems to automate and optimize the management and monitoring of our cloud infrastructure and applications. Your...


  • Bangalore, Karnataka, India Info Origin Inc Full time

    Job Description :As a Senior Cloud Data Engineer, you will play a crucial role in designing, developing, and optimizing data pipelines and solutions on cloud platforms. You will work closely with cross-functional teams to deliver scalable and efficient data solutions. Your primary responsibilities will include :Key Responsibilities :- Cloud Data Engineering...

  • Senior Data Engineer

    3 weeks ago


    Bangalore, Karnataka, India Infimetrics Info Solutions Full time

    Position : Senior Java (Data Engineer). Reports to : Technical Lead. Responsible for : Contributing to software development as per business requirements.Purpose of Role :- We are a data driven asset management firm with a very wide variety of datasets with varying frequency of updates that essentially drive our research models which ultimately determine the...