Sr Technical Solutions Engineer- Apache Spark

1 week ago


Bengaluru, Karnataka, India Databricks Full time

CSQ125R2

Mission

As a Sr Technical Solutions Engineer you will help our customers to be successful with the Databricks Data Intelligence platform by resolving important technical customer escalations and the support team. You will be the technical bridge between support and engineering and the first line of defense for engineering. You will ensure that all issues are vetted by you before it reaches the engineering team. You will report to the Senior Backline Manager of the Backline Escalations Team.

Outcomes

Troubleshoot, resolve and suggest deep code-level analysis of Apache SparkTM to address complex customer issues related to Apache SparkTM core internals, Apache SparkTM SQL, Structured Streaming and Databricks Delta. Provide best practices guidance around Apache SparkTM runtime performance and usage of Apache SparkTM core libraries and APIs for custom-built solutions developed by Databricks customers. Help the support team with detailed troubleshooting guides and runbooks. Contribute to automation and tooling programs to make daily troubleshooting efficient. Work with the Apache SparkTM Engineering Team and spread awareness of upcoming features and releases. Identify Apache SparkTM bugs and suggest possible workarounds. Demonstrate ownership and coordinate with engineering and escalation teams to achieve resolution of customer issues and requests Participate in weekend and weekday on call rotation.

Competencies

9+ years of experience developing , testing , and sustaining Python or Java or Scala -based applications. Comfortable with compiling, building and navigating the Apache SparkTM source code. Comfortable with identifying and applying patches/bug fixes to the Apache SparkTMk source code. Experience in Big Data/Hadoop/Apache SparkTM/Kafka/Elasticsearch data pipelines. Hands-on experience with SQL-based database systems. Experience in JVM, GC, Thread dump-based troubleshooting is required. Experience with AWS or Azure related services.

  • Bengaluru, Karnataka, India Databricks Full time

    CSQ125R2 Mission As a Technical Solutions Engineer you will help our customers to be successful with the Databricks Data Intelligence platform by resolving important technical customer escalations and the support team. You will be the technical bridge between support and engineering and the first line of defense for engineering. You will ensure that...


  • Bengaluru, Karnataka, India Quess Full time

    About Us: Quess IT Staffing is the biggest IT staffing company in India, with more than 20 years of experience placing IT professionals in 300+ companies across various levels and skill sets. Our 10,000+ associates work in 80+ cities, proficient in over 500 technological skills, helping deliver innovative solutions to top industries. Quess IT Staffing is...

  • Spark Engineer

    1 week ago


    Bengaluru, Karnataka, India Cyber Sphere LLC Full time

    Job Description :As a Spark Engineer you will help customers to be successful with the Data Intelligence platform by resolving important technical customer escalations and the support team. You will be the technical bridge between support and engineering and the first line of defense for engineering. You will ensure that all issues are vetted by you before...


  • Bengaluru, Karnataka, India RiskInsight Consulting Pvt Ltd Full time

    Design, develop, and maintain data processing pipelines using Apache Spark and Scala.Optimize Spark jobs for performance, scalability, and reliability.Work closely with data engineers and data scientists to implement data-driven solutions.Develop and maintain ETL processes to ingest, transform, and load large volumes of data.Perform data analysis and...


  • Bengaluru, Karnataka, India Encora Inc. Full time

    Important Information Experience: 5 to 8 years Job Location: Bangalore/Hyderabad/Pune Position Type: Full time. Work Mode- Hybrid Role: Data Curation Sr Engineer Job Summary: Strong knowledge of Spark SQL and/or PySpark Highly experienced with logical data modelling and/or database modeling Experienced with cataloging data and...


  • Bengaluru, Karnataka, India Wipro Full time

    Tech Lead- Python, Spark/Scala, Kafka and Cloud storage on Azure Cloud platformRoleSr.Data EngineerYears of Experience5-7 YrsPreferred LocationHYD 2Shift Timing (IST)11:00 AM - 08:30 PMShort DescriptionDevelop batch and real-time streaming data pipelines using Python, Spark/Scala, Kafka and Cloud storage on the Azure Cloud platform, as well as implement and...


  • Bengaluru, Karnataka, India Databricks Full time

    MissionAs a Apache SparkTM Backline Engineer you will help our customers to be successful with the Databricks Data Intelligence platform by resolving important technical customer escalations and the support team. You will be the technical bridge between support and engineering and the first line of defense for engineering. You will ensure that all issues are...

  • Sr. Data Engineer

    1 week ago


    Bengaluru, Karnataka, India The Nielsen Company Full time

    At Nielsen, we believe that career growth is a partnership. You ultimately own, fuel and set the journey. By joining our team of nearly 14,000 associates, you will become part of a community that will help you to succeed. We champion you because when you succeed, we do too. Embark on a new initiative, explore a fresh approach, and take license to think big,...


  • Bengaluru, Karnataka, India ARR Recruitment Solutions Full time

    Azure Databricks Engineer About the Role : We are seeking a highly skilled Azure Databricks Engineer to join our team and play a vital role in developing and maintaining our big data processing pipelines. This role is ideal for a candidate with extensive experience in Azure data services and a strong understanding of Apache Spark for largescale data...


  • Bengaluru, Karnataka, India Spruce IT Pvt. Ltd. Full time

    Job Role: Sr Python Developer. Skills: PySpark / Flink / Apache Spark / Scala. Experience: 6+ years. Location: Pan India. JD: - Sr Python Developer.- Must have Hands on experience- in python.- Develop pipeline objects using PySpark / Flink / Apache Spark / Scala. - Candidates preferred who have experience in building real-time data streams using Flink and...

  • Sr. Data Engineer

    1 week ago


    Bengaluru, Karnataka, India The Nielsen Company Full time

    At Nielsen, we believe that career growth is a partnership. You ultimately own, fuel and set the journey. By joining our team of nearly 14,000 associates, you will become part of a community that will help you to succeed. We champion you because when you succeed, we do too. Embark on a new initiative, explore a fresh approach, and take license to think big,...

  • GCP Data Engineer

    1 week ago


    Bengaluru, Karnataka, India Tredence Inc. Full time

    Have Implemented and Architected solutions on Google Cloud Platform using the components of GCPExperience with Apache Beam/Google Dataflow/Apache Spark in creating end to end data pipelines.Experience in some of the following:Python, Hadoop, Spark, SQL, Big Query, Big Table Cloud Storage, Datastore, Spanner, Cloud SQL, Machine Learning.Experience programming...

  • GCP Data Engineer

    1 week ago


    Bengaluru, Karnataka, India Tredence Inc. Full time

    Have Implemented and Architected solutions on Google Cloud Platform using the components of GCP Experience with Apache Beam/Google Dataflow/Apache Spark in creating end to end data pipelines. Experience in some of the following: Python, Hadoop, Spark, SQL, Big Query, Big Table Cloud Storage, Datastore, Spanner, Cloud SQL, Machine Learning. Experience...

  • Java + Spark

    1 week ago


    Bengaluru, Karnataka, India Wissen Full time

    Wissen Technology is now hiringJava + Spark We are seeking a skilled Java Developer with a strong background in Spark to develop and optimize data processing applications. The ideal candidate will be responsible for building robust and scalable data processing solutions, leveraging both Java and Spark. Experience–5-12years Location:Bangalore ...

  • spark developer

    1 week ago


    Bengaluru, Karnataka, India Quess Full time

    About Us "Quess IT Staffing is India's largest IT staffing company with over 20 years of experience in staffing IT professionals in 300+ companies across levels and skillsets. Our 10,000+ associates deployed in 80+ cities and towns are proficient in over 500 technological skills. Our associates help enable cutting edge solutions some of the biggest names...


  • Bengaluru, Karnataka, India Databricks Full time

    FEQ424R326As a Partner Solutions Architect (PSA) you will work with Databricks' Consulting and System Integrator (C&SI) partners, teammates, and with the technical and sales team members who work directly with our customers. You will develop 'technical champions' within our top C&SI Partners, providing enablement on technical matters related to the...


  • Bengaluru, Karnataka, India Quantiphi Full time

    Role : Associate Technical Architect - Data Experience Level : 6 to 8 Years Work location : Mumbai, Bangalore & Trivandrum What you'll do: You will be working as an Associate Data Architect within the healthcare domain, designing and delivering big data pipelines for structured and unstructured data that are running across multiple geographies, helping...


  • Bengaluru, Karnataka, India Quantiphi Full time

    Role : Associate Technical Architect - DataExperience Level : 6 to 8 YearsWork location : Mumbai, Bangalore & TrivandrumWhat you'll do:You will be working as an Associate Data Architect within the healthcare domain, designing and delivering big data pipelines for structured and unstructured data that are running across multiple geographies, helping...

  • Sr. Spark Analyst

    1 week ago


    Bengaluru, Karnataka, India Anicalls (Pty) Ltd Full time

    Candidate should be able to:Understanding of different types of testing – Unit, Acceptance, Regression, Performance, etc.open to receiving feedback and constructive criticism.Proficiency working with large data storesunderstanding of Test Driven Development (TDD) or Pair ProgrammingCandidate should have:Deep understanding of all aspects of database...


  • Bengaluru, Karnataka, India Havells India Limited Full time

    Job Description : Must have : 5- 10 years of meaningful experience in data engineering working on building ETL pipelines, big data tech like spark Very good expertise in algorithms and data structures Excellent in at least one programming language - Python, Go, R Hands-on expertise big data technologies such as Apache Spark, Hadoop, message...