Apache Spark/Trino Support Engineer

3 weeks ago

Bengaluru, Karnataka, India Bharat Head Hunters Full time

Job Title : Support Engineer Apache Spark with Druid/Trino (L1 Support)

Location : Bangalore, Chennai, Hyderabad

Experience : 4 to 11 Years

Employment Type : Full-time

We are seeking a dedicated Support Engineer with strong experience in Apache Spark along with Druid or Trino to provide Level 1 production support in a high-performance big data environment. In this role, the engineer will be responsible for monitoring Spark jobs, supervising data ingestion pipelines in Druid, and supporting query execution through Trino.

- The engineer will manage incidents raised during production, investigate job failures, carry out initial root cause analysis, and perform first-level troubleshooting to restore services quickly.

- Any issues beyond the scope of L1 will be documented in detail and escalated promptly to L2 and L3 teams to ensure seamless resolution.

- The Support Engineer will be expected to work extensively with enterprise monitoring and alerting tools such as Grafana, Prometheus, or Splunk to identify system performance bottlenecks and failures in real time.

- Job orchestration and scheduling tools like Autosys, Airflow, or Oozie will form part of the daily operations.

- The engineer will maintain shift-based monitoring, ensuring round-the-clock availability of the platform, while also preparing and updating knowledge base articles and standard operating procedures for recurring issues. Attention to detail and strict adherence to SLAs will be critical in maintaining production stability and delivering high-quality support.

The ideal candidate should bring a solid background in production support, application support, or big data support, with proven expertise in Apache Spark and either Druid or Trino.

- Hands-on knowledge of incident management platforms such as ServiceNow, JIRA, or Remedy is required, along with strong working skills in Linux, SQL, and basic shell scripting to diagnose and fix operational issues.

- Additional exposure to other big data tools such as Hive, Hadoop, or Kafka, and knowledge of cloud environments like AWS, Azure, or GCP will be considered advantageous.

- Strong communication and interpersonal skills are essential, as the engineer will be required to collaborate with cross-functional teams, provide timely updates on incident resolution, and interact effectively with business stakeholders.

(ref:hirist.tech)

  • Dataproc Lead, Spark, OSS Technologies, Cloud

    1 week ago

    Bengaluru, Karnataka, India Google Full time ₹ 15,00,000 - ₹ 20,00,000 per year

    Minimum qualifications:Bachelor's degree or equivalent practical experience.5 years of experience with software development in one or more programming languages, and with data structures/algorithms.Experience in software development and engineering, incorporating design methodologies, leveraging open source technologies, and working with distributed...

  • Dataproc Lead, Spark, OSS Technologies, Google Cloud

    4 weeks ago

    Bengaluru, Karnataka, India Google Inc Full time

    Job DescriptionMinimum qualifications:- Bachelor's degree or equivalent practical experience.- 5 years of experience with software development in one or more programming languages, and with data structures/algorithms.- Experience in software development and engineering, incorporating design methodologies, leveraging open source technologies, and working with...

  • Dataproc Lead, Spark, OSS Technologies, Cloud

    2 days ago

    Bengaluru, Karnataka, India Google Full time ₹ 15,00,000 - ₹ 25,00,000 per year

    Minimum qualifications:Bachelor's degree or equivalent practical experience.5 years of experience with software development in one or more programming languages, and with data structures/algorithms.Experience in software development and engineering, incorporating design methodologies, leveraging open source technologies, and working with distributed...

  • Data Engineering Lead

    2 weeks ago

    Bengaluru, Karnataka, India Apex One Full time ₹ 12,00,000 - ₹ 36,00,000 per year

    Immediate Joiners are preferrable Position Overview:We seek a highly skilled and experienced Data Engineering Lead to join our team. This role demands deep technical expertise in Apache Spark, Hive, Trino (formerly Presto), Python, AWS Glue, and the broader AWS ecosystem. The ideal candidate will possess strong hands-on skills and the ability to design and...

  • Cloud Engineer

    4 weeks ago

    Bengaluru, Karnataka, India Tredence Inc. Full time

    • Design and implement scalable batch and real-time data pipelines using Apache Iceberg, AWS services, and streaming technologies bi-directional data synch mechanisms.• Lead data migration projects from Oracle to cloud-native data lakes and warehouses.• Architect and manage real-time data ingress and egress using tools like Kafka, Kinesis, or Flink.•...

  • Data Engineers 3-5yrs

    4 weeks ago

    Bengaluru, Karnataka, India Rangam Infotech Private Limited Full time

    Job DescriptionJob DescriptionThis role outlines the day-to-day tasks which involve refactoring legacy Spark jobs to new standards, upgrading Airflow jobs, and completing migrations. Manager mentions that AI-based automations are available to assist with code refactoring, and three full-time engineers will provide support. The required skills include...

  • Principal Apache Hive Engineer

    6 days ago

    Bengaluru, Karnataka, India BairesDev Full time ₹ 20,00,000 - ₹ 25,00,000 per year

    At BairesDev, we've been leading the way in technology projects for over 15 years. We deliver cutting-edge solutions to giants like Google and the most innovative startups in Silicon Valley. Our diverse 4,000+ team, composed of the world's Top 1% of tech talent, works on roles that drive significant impact worldwide.When you apply for this position, you're...

  • Cloud Engineer

    4 weeks ago

    Bengaluru, Karnataka, India Tredence Inc. Full time

    • Design and implement scalable batch and real-time data pipelines using Apache Iceberg, AWS services, and streaming technologies bi-directional data synch mechanisms. • Lead data migration projects from Oracle to cloud-native data lakes and warehouses. • Architect and manage real-time data ingress and egress using tools like Kafka, Kinesis, or...

  • Cloud Engineer

    4 weeks ago

    Bengaluru, Karnataka, India Tredence Inc. Full time

    • Design and implement scalable batch and real-time data pipelines using Apache Iceberg, AWS services, and streaming technologies bi-directional data synch mechanisms. • Lead data migration projects from Oracle to cloud-native data lakes and warehouses. • Architect and manage real-time data ingress and egress using tools like Kafka, Kinesis, or Flink....

  • Cloud Engineer

    3 weeks ago

    Bengaluru, Karnataka, India Tredence Inc. Full time

    • Design and implement scalable batch and real-time data pipelines using Apache Iceberg, AWS services, and streaming technologies bi-directional data synch mechanisms. • Lead data migration projects from Oracle to cloud-native data lakes and warehouses. • Architect and manage real-time data ingress and egress using tools like Kafka, Kinesis, or Flink....