▷ (High Salary) Senior Data Engineer

4 weeks ago

Bangalore, India USEReady Full time

Job Title: Senior Databricks Engineer Experience Level: 5-8 Years Job Summary As a Senior Databricks Engineer, you will be responsible for designing, developing, and optimizing our data architecture and pipelines on the Databricks Lakehouse Platform. You will leverage your deep expertise in Spark, Delta Lake, and cloud technologies to build scalable and reliable solutions that process large-scale data efficiently. The ideal candidate is a proactive problem-solver with a strong background in data engineering and a passion for mentoring and driving technical excellence. Key Responsibilities - Architect and Develop: Design, build, and maintain robust and scalable data pipelines and ETL/ELT processes using Databricks, Apache Spark, and Python/Scala. - Lakehouse Implementation: Architect and implement solutions on the Databricks Lakehouse Platform, including data modeling, ingestion, storage, and processing using Delta Lake. - Performance Optimization: Analyze and tune the performance of Spark jobs and Databricks clusters to ensure high efficiency, reliability, and cost-effectiveness. - Data Governance: Implement and manage data governance, data quality, and security best practices within Databricks, utilizing features like Unity Catalog. - Collaboration: Work closely with data scientists, analysts, and business stakeholders to understand their data requirements and deliver high-quality, end-to-end data solutions. - Automation & CI/CD: Develop and maintain CI/CD pipelines for automated testing and deployment of data workflows (e.G., using Azure DevOps, Jenkins, GitHub Actions). - Mentorship: Mentor junior engineers, conduct code reviews, and champion best practices in data engineering and software development. - Innovation: Stay current with the latest advancements in the Databricks platform and the broader big data ecosystem, and drive the adoption of new tools and technologies. Required Qualifications and Skills - Experience: 5-8 years of professional experience in a data engineering role. - Databricks Expertise: Proven hands-on experience architecting and building solutions on the Databricks platform. - Core Technical Skills: - Strong proficiency in Python or Scala. - Expert-level knowledge of Apache Spark, including Spark SQL and DataFrame APIs. - In-depth understanding and practical experience with Delta Lake. - Advanced SQL skills and experience with data warehousing concepts. - Cloud Proficiency: Solid experience with at least one major cloud platform (Azure, AWS, or GCP), including their data storage and processing services (e.G., Azure Data Lake Storage, AWS S3, Google Cloud Storage). - ETL/ELT: Demonstrable experience in designing and implementing complex ETL/ELT pipelines. - Problem-Solving: Excellent analytical and problem-solving abilities with a keen attention to detail. - Communication: Strong verbal and written communication skills, with the ability to explain complex technical concepts to non-technical stakeholders. - Data Visualization: Experience supporting data visualization tools like Power BI or Tableau

  • High Salary! Data Scientist

    1 week ago

    Bangalore, India Straive Full time

    About the Role Straive is looking for a talented and driven Consultant / Data Scientist / GenAI Engineer to join our Analytics & GenAI delivery team. In this role, you will work under the guidance of the Senior Project Manager / Engagement Manager to design, develop, and deploy advanced AI/ML and Generative AI solutions for global enterprise clients. You...

  • ▷ [High Salary] Senior SDET / Senior QA Engineer

    2 weeks ago

    Bangalore, India AppsForBharat Full time

    About the Job Position Title: Senior SDET / Senior QA Engineer (Automation) Department: Engineering Location: HSR Layout, Bangalore (Work From Office) Employment Type: Full-Time Company: About AppsForBharat AppsForBharat is on a mission to help millions of Indians connect with spirituality and culture through beautifully crafted, AI-first consumer...

  • [High Salary] Data Scientist Engineer

    7 days ago

    Bangalore, India Jobted IN C2 Full time

    Job Description Data Scientist Description: Degree and Qualification: • BE/B.Tech, ME/M.Tech in CSE/IT, Statistics, or a related field. • Master’s degree in data science, AI, or a related field is preferred. Number of Years of Experience as a Data Analyst / Scientist: 3-8 years Language Skills: • Good communication skills in English, proficiency in...

  • ▷ High Salary! Lead Data Engineer

    3 weeks ago

    Bangalore, Karnataka, India Acesoft Labs Full time

    Job Summary List Format Lead Engineer MarTech Digital Engineering Customer Data Management - Serve as technical lead for a data engineering team managing and activating customer data for Catalyst Brands - Lead the design and implementation of scalable data solutions for marketing analytics personalization and customer engagement - Collaborate...

  • [High Salary] Data Platform Engineer

    4 weeks ago

    Bangalore, Karnataka, India Takeda Full time

    By clicking the Apply button I understand that my employment application process with Takeda will commence and that the information I provide in my application will be processed in line with Takeda s and I further attest that all information I submit in my employment application is true to the best of my knowledge About the role The Platform Engineer is...

  • Senior DevOps Engineer

    2 weeks ago

    bangalore, India Crest Data Full time

    Company Overview: Crest Data is the global leading provider of Data Analytics, Security, DevOps, Cloud Solutions, Software integrations, Analytics, and security-based technological services. With a clientele that includes several Fortune 500 corporations and some of the innovative Silicon Valley Startups. Company URL : Job Location - Ahmedabad Job...

  • Senior DevOps Engineer

    1 week ago

    bangalore, India Crest Data Full time

    Company Overview: Crest Data is the global leading provider of Data Analytics, Security, DevOps, Cloud Solutions, Software integrations, Analytics, and security-based technological services. With a clientele that includes several Fortune 500 corporations and some of the innovative Silicon Valley Startups. Company URL : Job Location - Ahmedabad Job...

  • Senior DevOps Engineer

    1 week ago

    bangalore, India Crest Data Full time

    Company Overview: Crest Data is the global leading provider of Data Analytics, Security, DevOps, Cloud Solutions, Software integrations, Analytics, and security-based technological services. With a clientele that includes several Fortune 500 corporations and some of the innovative Silicon Valley Startups. Company URL : Job Location - Ahmedabad Job...

  • Senior DevOps Engineer

    2 weeks ago

    bangalore, India Crest Data Full time

    Company Overview:Crest Data is the global leading provider of Data Analytics, Security, DevOps, Cloud Solutions, Software integrations, Analytics, and security-based technological services. With a clientele that includes several Fortune 500 corporations and some of the innovative Silicon Valley Startups.Company URL: http://www.crestdata.aiJob Location -...

  • Senior Data Scientist

    2 days ago

    bangalore, India Enable Data Incorporated Full time

    Enable Data Incorporated is looking for a talented and experienced Senior Data Scientist to join our innovative team. In this role, you will be responsible for driving data science initiatives, developing predictive models, and providing insights that guide key business decisions. The ideal candidate has a strong background in statistical analysis, machine...