Manager - Technical Solutions (Spark)

2 weeks ago

Bengaluru, Karnataka, India Databricks Full time
Job Description

CSQ426R84

Databricks helps data teams solve the worlds toughest problems. As the leader in Unified Data Analytics, Databricks helps organizations make all their data ready for analytics, empower data-driven decisions across the organization, and rapidly adopt machine learning to outpace the competition Databricks is venture-backed and founded by the original creators of popular open source projects: Apache Spark, Delta Lake and MLflow.

As a Manager of the Spark Technical Solutions team, you will lead & manage a team of Technical solution engineers and be responsible for driving deep dive technical solutions for any issues reported by Databricks customers. We expect the manager to resolve challenges with comprehensive technical and customer communication skills. You will assist our customers in their Databricks journey and provide them with the guidance, knowledge, and expertise that they need to realise value and achieve their strategic objectives using our products.

The Impact You Will Have

- As a manager and member of the leadership team, you will be directly responsible for the management of Technical solution engineers, team leads and operations personnel
- Responsible for directly monitoring, reporting, and driving improvements to team-level metrics and KPIs, acting as an escalation point with customers and internal teams, and optimising and developing support processes and tools
- Responsible for working across multiple cross functional teams that include Engineering, product management, sales and customer success; manage Hiring, mentoring and onboarding new support engineers
- Regularly meet one-on-one with your direct reports, conducting annual reviews and career development discussions throughout the year
- Be a hands on manager to assist the team members in resolving issues related to Apache Spark core internals, Spark SQL, Structured Streaming, Delta, Lakehouse and other databricks runtime features
- Manage and drive best practices guidance around Spark runtime performance and usage of Spark core libraries and APIs for custom-built solutions developed by Databricks customers; contribute in the development of tools/automation initiatives
- Own Engineering JIRA tickets and proactively work to bring quicker resolutions to customer reported issues; participate in creation of knowledge base articles
- Participate in weekend and weekday on-call rotation and run escalations during databricks runtime outages, incident situations, ability to multitask and plan day 2 day activities and provide escalated level of support for critical customer operational issues, etc

What We Look For

- Min 10-12 years of experience in designing, building, testing, and maintaining Python/Java/Scala/Spark based applications in a typical project delivery and consulting environments with 4+ years working as a Manager
- 5+ years of hands-on experience in developing and leading any two or more of the Big Data, Hadoop, Spark,Machine Learning, Artificial Intelligence, Streaming, Kafka, Data Science, ElasticSearch related industry use cases at the production scale. Spark experience is mandatory
- Hands on experience in the performance tuning/troubleshooting of Hive and Spark based applications at production scale. Real time experience in JVM and Memory Management techniques such as Garbage collections, Heap/Thread Dump Analysis is preferred
- Working and hands-on experience with Data lakes and any SQL-based databases, Data Warehousing/ETL technologies like Informatica, DataStage, Oracle, Teradata, SQL Server, MySQL is preferred
- Hands-on experience with AWS or Azure or GCP is preferred
- Experience in implementing CI/CD, Monitoring/alerting for Production Systems
- Technical lead in design, implementation and support of large scale data and analytics solutions that are highly reliable, flexible, and scalable
- Experience in leading and managing end-to-end projects and have reported and escalated to top levels
- Experience in managing and leading teams in an organisation involving multiple reporting lines
- Strong written and verbal communication skills; very good analytical, organisational, multi-tasking skills

About Databricks

Databricks is the data and AI company. More than 10,000 organizations worldwide including Comcast, Cond Nast, Grammarly, and over 50% of the Fortune 500 rely on the Databricks Data Intelligence Platform to unify and democratize data, analytics and AI. Databricks is headquartered in San Francisco, with offices around the globe and was founded by the original creators of Lakehouse, Apache Spark, Delta Lake and MLflow. To learn more, follow Databricks on Twitter, LinkedIn and Facebook.

Benefits

At Databricks, we strive to provide comprehensive benefits and perks that meet the needs of all of our employees. For specific details on the benefits offered in your region, please visit https://www.mybenefitsnow.com/databricks.

Our Commitment to Diversity and Inclusion

At Databricks, we are committed to fostering a diverse and inclusive culture where everyone can excel. We take great care to ensure that our hiring practices are inclusive and meet equal employment opportunity standards. Individuals looking for employment at Databricks are considered without regard to age, color, disability, ethnicity, family or marital status, gender identity or expression, language, national origin, physical and mental ability, political affiliation, race, religion, sexual orientation, socio-economic status, veteran status, and other protected characteristics.

Compliance

If access to export-controlled technology or source code is required for performance of job duties, it is within Employer&aposs discretion whether to apply for a U.S. government license for such positions, and Employer may decline to proceed with an applicant on this basis alone.

  • Spark Solutions Architect

    1 day ago

    Bengaluru, Karnataka, India Texplorers Inc Full time

    Key ResponsibilitiesAs a Data Engineer (Spark), you will be responsible for designing and implementing Spark solutions, building prototypes for solution architects, and developing deep technical expertise in Azure Synapse/Spark landscape.RequirementsBachelor's/Master's degree in Computer Science or a related field.5 years of experience in an Azure...

  • Full Stack Engineer with Spark Scala

    3 days ago

    Bengaluru, Karnataka, India Stackave Solutions Full time

    Job Title: Java Full Stack Developer with Spark and Scala We are seeking a highly skilled Java Full Stack Developer with expertise in Spark and Scala to join our team. About the Role: Design, develop, and deploy scalable, efficient, and reliable software applications using Java, Spark, and Scala. Collaborate closely with cross-functional teams, including...

  • Technical Data Solutions Lead

    7 days ago

    Bengaluru, Karnataka, India Protonlogics IT Solutions Full time

    Protonlogics IT Solutions is seeking a technical data solutions lead to oversee our data engineering efforts.Job Overview:The ideal candidate will have hands-on experience in designing, implementing, and maintaining large-scale data pipelines using Azure cloud services.Data Engineering Responsibilities:Implement efficient data processing code using Py Spark...

  • Spark Capital

    3 weeks ago

    Bengaluru, Karnataka, India Spark Private Wealth Full time

    BUSINESS DEVELOPMENT - Prospect & acquire new client relationship (UHNIs, family offices, corporates) through various channels sources, existing client referrals, cold calling & other client engagement activities.- Advise clients on building portfolios based on various products and solutions across asset classes - MF, PE, Structured Products, Insurance, PMS,...

  • Spark and Scala Specialist

    7 hours ago

    Bengaluru, Karnataka, India Tata Consultancy Services Full time

    About the Opportunity:Tata Consultancy Services is seeking a Spark and Scala Specialist to join our team. As a Spark and Scala Specialist, you will be responsible for designing, developing, and deploying large-scale data processing systems using Spark and Scala. The ideal candidate should have experience working with big data ecosystems and be proficient in...

  • Spark/Scala Developer

    7 days ago

    Bengaluru, Karnataka, India Tata Consultancy Services Full time

    Greetings from Tata Consulting ServicesTCS is Hiring for Spark/ScalaExperience : 5-10 yearsLocation: Bangalore/Chennai/pune/GuragonNotice period : Less than or equal to 30 days Please find the JD belowRequired Technical Skill - Knowledge of Big Data Platforms like Hadoop, Spark Scala, Hive, Impala, SQLMust-HaveGood work experience on Big Data Platforms like...

  • Spark/Scala Developer

    14 hours ago

    Bengaluru, Karnataka, India Tata Consultancy Services Full time

    Greetings from Tata Consulting ServicesTCS is Hiring for Spark/ScalaExperience : 5-10 yearsLocation: Bangalore/Chennai/pune/GuragonNotice period : Less than or equal to 30 daysPlease find the JD belowRequired Technical Skill - Knowledge of Big Data Platforms like Hadoop, Spark Scala, Hive, Impala, SQLMust-HaveGood work experience on Big Data Platforms like...

  • Senior Backend Developer with Spark and Scala Skills

    4 days ago

    Bengaluru, Karnataka, India Stackave Solutions Full time

    Key ResponsibilitiesAs a Sr. Backend Developer with Spark and Scala Skills, you will be responsible for designing, developing, and deploying high-quality software systems using Java, React/React JS, Spring Boot, ETL – Big Data / Data Warehousing, and Spark Scala.You will work closely with cross-functional teams to identify business requirements and develop...

  • Omind - Big Data Engineer - Spark/Scala

    2 days ago

    Bengaluru, Karnataka, India OMIND TECHNOLOGIES PVT LTD Full time

    We are seeking a highly skilled Big Data Engineer with expertise in distributed systems, the Hadoop ecosystem, and advanced programming techniques. The ideal candidate will possess strong technical knowledge, thought leadership, and a passion for creating scalable, high-performance systems. Key Responsibilities: - Design, develop, and optimize distributed...

  • Full Stack Engineer with Spark Scala

    5 days ago

    Bengaluru, Karnataka, India Stackave Solutions Full time

    One of our Clients is looking Java Full stack with Spark Scala for BengaluruJob title: Java Full stack with Spark ScalaExp: 3 – 6 yearsLocation: BangaloreMandatory Skills: Java, React/React JS, Spring boot, ETL – Bigdata / Data Ware housing, Spark, Scala- Strong interpersonal, communication and client facing skills- Ability to work closely with cross...

  • Spark Developer Specialist

    10 hours ago

    Bengaluru, Karnataka, India Tata Consultancy Services Full time

    Technical Requirements:We are looking for experienced professionals with a strong background in Python development and big data engineering.Responsibilities:Develop ETL integration patterns using Python on Spark.Design and develop frameworks for converting existing Power Center mappings to Py Spark jobs.Create Pyspark frames to bring data from multiple...

  • Databricks Spark Developer

    1 day ago

    Bengaluru, Karnataka, India RARR Technologies Pvt. Ltd. Full time

    RARR Technologies Pvt. Ltd. is looking for a Databricks Spark Developer to join our team of experts.Job OverviewThis role involves designing and developing large-scale data operations using Databricks, maintaining and optimizing existing data pipelines, and collaborating with cross-functional teams to identify business needs and develop solutions.The ideal...

  • Technical Solutions Strategist

    1 day ago

    Bengaluru, Karnataka, India Affine Full time

    Company OverviewAffine is a cutting-edge company that combines innovative technology with business acumen to deliver exceptional results.Solution Specialist RoleThis position plays a crucial role in driving Affine's success by collaborating with various teams, including sales, delivery, and marketing. As a Solution Specialist, you will have the opportunity...

  • Omind - Big Data Engineer - Spark/Scala

    4 weeks ago

    Bengaluru, Karnataka, India OMIND TECHNOLOGIES PVT LTD Full time

    We are seeking a highly skilled Big Data Engineer with expertise in distributed systems, the Hadoop ecosystem, and advanced programming techniques. The ideal candidate will possess strong technical knowledge, thought leadership, and a passion for creating scalable, high-performance systems.Key Responsibilities:- Design, develop, and optimize distributed...

  • Omind - Big Data Engineer - Spark/Scala

    3 weeks ago

    Bengaluru, Karnataka, India OMIND TECHNOLOGIES PVT LTD Full time

    We are seeking a highly skilled Big Data Engineer with expertise in distributed systems, the Hadoop ecosystem, and advanced programming techniques. The ideal candidate will possess strong technical knowledge, thought leadership, and a passion for creating scalable, high-performance systems.Key Responsibilities:- Design, develop, and optimize distributed...

  • Technical Lead for Innovative Solutions

    2 days ago

    Bengaluru, Karnataka, India Chase Bank Full time

    About the RoleWe have an exciting opportunity for a software engineer to take their career to the next level. As a member of our agile team, you will be responsible for carrying out critical technology solutions across multiple technical areas within various business functions in support of the firm's business objectives.Responsibilities and Qualifications-...

  • Technical Project Manager

    3 weeks ago

    Bengaluru, Karnataka, India Innovatily Full time

    About Innovatily: Innovatily is a dynamic B2B software development company, specializing in delivering cutting-edge AI, cloud, data analytics, web, and mobile solutions. We pride ourselves on our tailored approach to technology, ensuring our clients receive solutions that drive their success. What's exciting with us: - We are venturing into the uncharted...

  • Hadoop and Spark Developer

    3 hours ago

    Bengaluru, Karnataka, India Tata Consultancy Services Full time

    Greetings from Tata Consultancy ServicesWe are seeking an experienced Hadoop and Spark Developer to join our team.Job DescriptionExperience: 5-10 yearsThe successful candidate will have strong knowledge of Hadoop and Spark ecosystems, proficiency in Scala programming language, and experience with data analytics tools and techniques.The role requires working...

  • Solution Development Manager

    5 days ago

    Bengaluru, Karnataka, India Affine Full time

    We are looking for an experienced professional to fill the role of Solution Development Manager at Affine. In this position, you will be responsible for working closely with multiple teams, including sales, delivery, and marketing, to develop and implement solutions for our clients and partners. This role requires strong technical knowledge and business...

  • Technical Solutions Leader Java

    1 day ago

    Bengaluru, Karnataka, India Squareroot Consulting Pvt Ltd Full time

    Squareroot Consulting Pvt Ltd is seeking a talented Technical Solutions Leader Java to spearhead our team's technical direction. As a key member of our organization, you will be responsible for driving technical strategy, architecture, and innovation.Key ResponsibilitiesDevelop and implement technical strategy, aligning with business objectives and...