Senior Data Engineer

2 days ago

bangalore district, India USEReady Full time

Job Title: Senior Databricks Engineer Experience Level: 5-8 Years Job Summary As a Senior Databricks Engineer, you will be responsible for designing, developing, and optimizing our data architecture and pipelines on the Databricks Lakehouse Platform. You will leverage your deep expertise in Spark, Delta Lake, and cloud technologies to build scalable and reliable solutions that process large-scale data efficiently. The ideal candidate is a proactive problem-solver with a strong background in data engineering and a passion for mentoring and driving technical excellence. Key Responsibilities Architect and Develop: Design, build, and maintain robust and scalable data pipelines and ETL/ELT processes using Databricks, Apache Spark, and Python/Scala. Lakehouse Implementation: Architect and implement solutions on the Databricks Lakehouse Platform, including data modeling, ingestion, storage, and processing using Delta Lake. Performance Optimization: Analyze and tune the performance of Spark jobs and Databricks clusters to ensure high efficiency, reliability, and cost-effectiveness. Data Governance: Implement and manage data governance, data quality, and security best practices within Databricks, utilizing features like Unity Catalog. Collaboration: Work closely with data scientists, analysts, and business stakeholders to understand their data requirements and deliver high-quality, end-to-end data solutions. Automation & CI/CD: Develop and maintain CI/CD pipelines for automated testing and deployment of data workflows (e.g., using Azure DevOps, Jenkins, GitHub Actions). Mentorship: Mentor junior engineers, conduct code reviews, and champion best practices in data engineering and software development. Innovation: Stay current with the latest advancements in the Databricks platform and the broader big data ecosystem, and drive the adoption of new tools and technologies. Required Qualifications and Skills Experience: 5-8 years of professional experience in a data engineering role. Databricks Expertise: Proven hands-on experience architecting and building solutions on the Databricks platform. Core Technical Skills: Strong proficiency in Python or Scala . Expert-level knowledge of Apache Spark , including Spark SQL and DataFrame APIs. In-depth understanding and practical experience with Delta Lake . Advanced SQL skills and experience with data warehousing concepts. Cloud Proficiency: Solid experience with at least one major cloud platform ( Azure , AWS , or GCP ), including their data storage and processing services (e.g., Azure Data Lake Storage, AWS S3, Google Cloud Storage). ETL/ELT: Demonstrable experience in designing and implementing complex ETL/ELT pipelines. Problem-Solving: Excellent analytical and problem-solving abilities with a keen attention to detail. Communication: Strong verbal and written communication skills, with the ability to explain complex technical concepts to non-technical stakeholders. Data Visualization: Experience supporting data visualization tools like Power BI or Tableau

  • Senior Data Engineer

    2 days ago

    bangalore district, India Sonata Software Full time

    The Senior Software Engineer supports functions which require automation/systems development, including initial development and ongoing support of the suite of applications that would help manage loan, pricing, enterprise data pipeline, or other functions depending on the department. As the Application Developer, you must be proficient in Python, Data...

  • Senior Data Engineer

    2 days ago

    bangalore district, India ValueLabs Full time

    ValueLabs is a global technology consulting and services company, driven by innovation and excellence. With operations in over 30 countries and a client-first culture, we deliver cutting-edge digital solutions across industries. Our teams are empowered to solve complex challenges, build secure systems, and drive transformation at scale. Join us and be part...

  • Senior GCP Data Engineer

    2 weeks ago

    bangalore district, India Ascendion Full time

    Job Title: Senior GCP Data Engineer (7 - 12 Years) Job Type: Full-Time Work Mode: Hybrid Locations: Bengaluru, Hyderabad, Chennai, Pune Job Summary: We are looking for a talented GCP Big Query Data Engineer with strong SQL skills and basic proficiency in Python to join our data engineering team. The ideal candidate should have hands-on experience working...

  • Senior Data Scientist

    15 hours ago

    chennai district, India Crayon Data Full time

    Role: Sr Data Scientist Experience level: 5 to 7 years Location: Chennai Why Crayon? Why now? Crayon is transforming into an AI first company, and every Crayon (that’s what we call ourselves!) is undergoing a journey of upskilling and expanding their capabilities in the AI space. We're building an organization where AI is not a department—it’s a way of...

  • Senior Data Engineer

    4 days ago

    bangalore, India AIQU Full time

    We are hiring for Senior Data Engineer to join one of our major clients based out of KSA. Job Details: Role: Senior Data Engineer Work Location: Remote Employment Type: Contract – 12 months & extendable Role Summary: The Senior Data Engineer plays a lead role in designing, building, optimizing, and governing data pipelines and architectures that power...

  • Senior Data Engineer

    2 weeks ago

    bangalore district, India Truecaller Full time

    Hello, Truecaller is calling you from Bangalore, India! Ready to pick up? Our goal is to make communication smarter, safer, and more efficient, while building trust across the world. With our roots in Sweden and a global reach, we deliver smart services that create meaningful social impact. We are committed to protecting you from fraud, harassment, scam...

  • Senior Data Engineer

    3 days ago

    bangalore district, India Zeta Full time

    About Zeta Zeta is a Next-Gen Banking Tech company that empowers banks and fintechs to launch banking products for the future. It was founded by and Ramki Gaddipati in 2015. Our flagship processing platform - Zeta Tachyon - is the industry’s first modern, cloud-native, and fully API-enabled stack that brings together issuance, processing, lending, core...

  • Senior Data Engineer

    4 days ago

    bangalore, India AIQU Full time

    We are hiring for Senior Data Engineer to join one of our major clients based out of KSA.Job Details:Role: Senior Data EngineerWork Location: RemoteEmployment Type: Contract – 12 months & extendableRole Summary:The Senior Data Engineer plays a lead role in designing, building, optimizing, and governing data pipelines and architectures that power analytics,...

  • Senior Data Engineer

    2 weeks ago

    bangalore district, India Guidewire Software Full time

    Responsibilities: Design and Development: Architect, design, and develop robust, scalable, and efficient data pipelines. Design and manage platform solutions to support data engineering needs to ensure seamless integration and performance. Write clean, efficient, and maintainable code. Leadership and Collaboration: Lead and mentor a team of Data engineers,...

  • Senior Data Engineer

    2 weeks ago

    bangalore, India HireAlpha Full time

    Senior Data Engineer (Informatica Platform Engineer / Administrator) – Bangalore We’re looking for a Senior Data Engineer with strong expertise in Informatica platform administration to join our Group IT Data Engineering team.This role is ideal for professionals who enjoy building and maintaining enterprise-grade data platforms that power large-scale...