Databricks Administrator/Support Engineer

4 weeks ago


PuneBangalore, IN Tekfortune IT India Pvt Ltd Full time

Title : Databricks Engineer

Experience : 4 to 10 years

Work Location : Pune and Bangalore Location

Notice Period : Immediate to 45 Days

Job Description :

We are seeking a highly skilled and experienced Databricks Engineer to join our growing team and play a crucial role in enhancing our data processing and analytics capabilities.

As a Databricks Engineer you will be responsible for dealing with the most complex situations related to development, design, implementation, and maintenance of our Databricks environment to ensure optimal performance, scalability, and reliability while aligning with our audit and security standards. You will work closely with cross-functional teams, including data scientists, analysts, and software engineers to build robust data pipelines and deliver actionable insights.

Key Responsibilities :

Databricks Environment Management :

  • Set up and configure Databricks clusters to meet specific project requirements
  • Optimize Databricks configurations for performance and cost-effectiveness
  • Ensure the security and integrity of the Databricks environment
Data Pipeline Development :
  • Collaborate with data scientists and analysts to understand data requirements
  • Design and implement scalable and efficient data processing pipelines using Databricks
  • Troubleshoot and optimize existing data pipelines for improved performance
Integration and Collaboration :
  • Work closely with cross-functional teams to integrate Databricks solutions into the overall data architecture
  • Collaborate with software engineers to incorporate Databricks functionality into custom applications
Monitoring and Maintenance :
  • Implement robust monitoring and logging solutions for Databricks clusters
  • Conduct regular maintenance tasks, including updates and patches, to ensure system stability
  • Generate/ review consumption reports, identify abnormal consumption and take corrective action.
Documentation and Training :
  • Create and maintain comprehensive documentation for Databricks configurations and processes, document best practices and standards to be followed
  • Provide training and support to internal teams on using Databricks effectively
Qualifications :
  • Bachelor's degree in computer science, Engineering, or a related field; Master's Degree preferred
  • Proven experience as a Databricks Engineer or similar role
  • Strong proficiency in Apache Spark and Databricks
  • Experience with cloud platforms such as AWS, Azure, or Google Cloud
  • Proficient in programming languages such as Python, Scala, or Java
  • Solid understanding of data architecture and ETL processes.
Preferred Qualifications :
  • Databricks Certification
  • Experience with big data technologies and distributed computing
  • Familiarity with machine learning frameworks

(ref:hirist.tech)

  • Bangalore/Chennai/Pune, IN Tekfortune IT India Pvt. Ltd. Full time

    Title : Databricks Platform Administrator - SupportExperience : 4 to 10 YearsWork Location : Pune, Chennai & Bangalore LocationShift Timing : Max till 11PMNotice Period : Immediate to 45 DaysKey Skills : Databricks Support, SQL, Integration, Setup & Configuration of Databrick ClustersJob Description :We are seeking a highly skilled and experienced Databricks...


  • Bangalore/Hyderabad/Pune, IN iMind Your Business Solutions Private Limited Full time

    Job Description :We are hiring database administrators for the leaders in analytics and cloud applications, headquartered in San Francisco and with offices in India.Our client provides strategic guidance and technology systems for clients wishing to solve their most complex and interesting business challenges involving cloud applications, big data, business...


  • Any Location/Bangalore, IN INSIGHT GLOBAL SOLUTIONS Full time

    Required Skills and Experience - - 6+ years of hands-on experience in managing and administrating Azure PaaS environments. - 3+ years of hands-on experience setting up, solutioning, configuring, provisioning, and administering Azure Databricks platform -must be a SME. - Any experience in providing best practices around Azure Databricks for enterprise...

  • Data Engineer

    4 weeks ago


    Pune/Hyderabad, IN Huquo Full time

    Must-Have :- 4+ years of experience in Data Engineering experience on Azure and Databricks- Strong knowledge of Databricks, Azure Data Factory, Azure Blob, and Azure SQL is required- Experience Developing and tuning Spark Application and SparkSQL queries-- Expertise to Implementing Data warehousing Solutions - Good understanding of Azure Databricks platform...

  • Data Engineer

    4 weeks ago


    Pune/Hyderabad/Remote, IN HARP Technologies and Services Full time

    Job Location : Pune & Hyderabad (Initial 1 -2 months hybrid and then complete remote job. Client will offer accommodation(stay), food & travel exp. )Exp range : 6+ years Shift timings : General 9am - 6pm IST or 10am - 7pm IST Mandatory skills : Data engineering (4+years), Databricks (3.5+ years), Pyspark (3+ years), Python (preferred) or bash, Data pipeline,...

  • MLOps Engineer

    4 weeks ago


    Bangalore/Hyderabad/Pune, IN iMind Your Business Solutions Private Limited Full time

    Job Description :- Databricks ML Ops Engineers (Admin) for the leaders in analytics and cloud applications, headquartered in San Francisco and with offices in India. Our client provides strategic guidance and technology systems for clients wishing to solve their most complex and interesting business challenges involving cloud applications, big data, business...


  • Bangalore/Hyderabad/Pune, IN Huquo Full time

    Job Description :- 7+ years of Data engineering experience with 3+ years hands on Databricks (DB) experience.- Should have thorough knowledge in creation of jobs using Pyspark. Should be extremely good with SQL and possess good exposure to Python.- Should be able to create New Clusters , Cluster Pools and attach existing clusters to pool in DB.- Should have...

  • Senior Data Engineer

    4 weeks ago


    Bangalore/Trivandrum/Thiruvananthapuram/Chennai/Pune, IN Arting Digital Full time

    Senior Data EngineerExperience : 6y+ Location : Trivandrum, Chennai, Pune, Bangalore Budget : 15 - 25 LPA Work Mode : On-SiteSkills : - Ataccama, Syndigo, Snowflake, Databricks- Requirements :- 6+ Years experience as a Data Engineer, who played a key/lead role in implementing one or two large data solutions- Programming experience in Scala or Python, SQL-...

  • Vsquare Systems

    4 weeks ago


    Bangalore/Anywhere in India/Multiple Locations, IN Vsquare Systems Pvt. Ltd. Full time

    Data Engineer (Azure Databricks)Job Title : Data Engineer (Azure Databricks). Location : Bangalore / Hybrid. Job Type : Full-time. Job Description : .- Experienced Data engineer & Solutions designer with a deep understanding of data solution design and implementation, seeking a challenging role to leverage my expertise in data architecture, cloud migrations,...


  • Hyderabad/Pune, IN Coders Brain Pvt Ltd Full time

    Primary Skills : Databricks with Pyspark/Spark/ Python and SQLSecondary skills : ADFJob Overview :- 7+ years of experience with detailed knowledge of data warehouse technical architectures, ETL/ ELT and reporting/analytic tools.- 4+ years of work experience with very large data warehousing environment- 4+ years of work experience in Databricks, Pyspark and...

  • Data Engineer

    7 days ago


    Any Location/Bangalore, IN RS Consultants Full time

    About the job :Responsibilities :- Build, document, test and launch new data extract, transform and load (ETL) processes for one or more core data sets.- Collaborate with Business Intelligence team and other stakeholders for data requirements- Collaborate with the Data Management team to provide quality data to stakeholders.- Build data expertise and learn...


  • Any Location/Bangalore, IN KARYA CONSULTANTS PRIVATE LIMITED Full time

    Responsibilities :- Closely work with Architect and lead to design solutions to meet functional and non-functional- requirements.- Participate to understand architecture and solution design- artifacts.- Evangelize re-use through the implementation of shared- assets.- Proactively implement engineering methodologies, standards, and leading practices.- Provide...

  • Senior Data Engineer

    4 weeks ago


    Chennai/Bangalore/Hyderabad/Pune, IN Resourcetree Full time

    Job Description :Data engineering role requires creating and managing technological infrastructure of a data platform, be in- charge / involved in architecting, building, and managing data flows / pipelines and construct data storages (noSQL, SQL), tools to work with big data (Hadoop, Kafka), and integration tools to connect sources or other databases.Role...

  • Data Engineer

    3 weeks ago


    Bangalore/Hyderabad/Chennai/Pune, IN Nilasu consulting Full time

    Responsibilities:- Design, develop, and deploy production-ready data pipelines using Databricks, Kafka, and Snowflake.- Collaborate with data analysts, software engineers, and stakeholders to understand data requirements and develop effective data migration strategies, API configurations, and backend architecture.- Extract, transform, and load (ETL) data...


  • Anywhere in India/Multiple Locations/Hyderabad/Bangalore/Pune/Mumbai/Chennai, IN BRISKWIN IT SOLUTIONS PRIVATE LIMITED Full time

    Position/Role : Azure data bricks with Pyspark/Spark/Python and SQLExperience : 6-12 yrsLocation : Hyderabad/Bangalore/Pune/Mumbai/Chennai (Hybrid)Job Overview :Primary Skills : Databricks with Pyspark/Spark/ Python and SQLSecondary skills : ADF Job Description :7+ years of experience with detailed knowledge of data warehouse technical architectures, ETL/...

  • ETL Developer

    4 weeks ago


    Bangalore/Anywhere in India/Multiple Locations, IN HIC Global Solutions Full time

    ETL Developer Job Description :- Consultant/Sr Consultant - ETL Development - Azure (ADF and DataBricks)Job Location : Gurugram, HaryanaA successful candidate will have the following characteristics:- Responsible for design, development, and implementation of solutions to exchange data using the required ETL tool, Azure Data Factory and DataBricks.- At least...


  • Bangalore/Chennai/Hyderabad/Mumbai/Pune/Noida, IN ACZ Global Private Limited Full time

    Azure Data ArchitectMandatory Skills : Solution Architecture - Pyspark + Databricks + Adf + Synapse is mandatoryJob Description :We are seeking a highly skilled and experienced Azure Data Architect to join our team. As an Azure Data Architect, you will play a key role in designing and implementing data solutions on the Microsoft Azure platform. The ideal...


  • Bangalore/Pune, IN Right Move Staffing Solutions Private Limited Full time

    Summary :We are seeking a highly motivated and experienced Senior Network Engineer/Administrator to join our team and play a crucial role in managing and optimizing our network infrastructure. You will be responsible for the design, implementation, maintenance, and security of our network systems, ensuring optimal performance, uptime, and...


  • Bangalore/Pune, IN TELL Jobs Full time

    Job Description : The ideal candidate will have a strong background in designing, implementing, and maintaining data solutions on the Azure platform. You will collaborate closely with cross-functional teams to understand data requirements, architect solutions, and implement pipelines to enable data-driven decision-making. This role requires a deep...


  • Anywhere in India/Multiple Locations/Bangalore/Pune, IN Searchspring Full time

    Data EngineerJob Requirements :- BS degree in CS, CE or EE.- 4+ years of working experience in data integration and pipeline development.Location : Bangalore /Pune- 3+ years of relevant experience with AWS Cloud on data integration with Databricks,Apache Spark, EMR, Glue, Kafka, Kinesis, and Lambda in S3, Redshift, RDS, MongoDB/DynamoDB ecosystems- Strong...