▷ (High Salary) Senior Data Engineer

2 days ago

Bangalore, India USEReady Full time

Job Title: Senior Databricks Engineer Experience Level: 5-8 Years Job Summary As a Senior Databricks Engineer, you will be responsible for designing, developing, and optimizing our data architecture and pipelines on the Databricks Lakehouse Platform. You will leverage your deep expertise in Spark, Delta Lake, and cloud technologies to build scalable and reliable solutions that process large-scale data efficiently. The ideal candidate is a proactive problem-solver with a strong background in data engineering and a passion for mentoring and driving technical excellence. Key Responsibilities - Architect and Develop: Design, build, and maintain robust and scalable data pipelines and ETL/ELT processes using Databricks, Apache Spark, and Python/Scala. - Lakehouse Implementation: Architect and implement solutions on the Databricks Lakehouse Platform, including data modeling, ingestion, storage, and processing using Delta Lake. - Performance Optimization: Analyze and tune the performance of Spark jobs and Databricks clusters to ensure high efficiency, reliability, and cost-effectiveness. - Data Governance: Implement and manage data governance, data quality, and security best practices within Databricks, utilizing features like Unity Catalog. - Collaboration: Work closely with data scientists, analysts, and business stakeholders to understand their data requirements and deliver high-quality, end-to-end data solutions. - Automation & CI/CD: Develop and maintain CI/CD pipelines for automated testing and deployment of data workflows (e.G., using Azure DevOps, Jenkins, GitHub Actions). - Mentorship: Mentor junior engineers, conduct code reviews, and champion best practices in data engineering and software development. - Innovation: Stay current with the latest advancements in the Databricks platform and the broader big data ecosystem, and drive the adoption of new tools and technologies. Required Qualifications and Skills - Experience: 5-8 years of professional experience in a data engineering role. - Databricks Expertise: Proven hands-on experience architecting and building solutions on the Databricks platform. - Core Technical Skills: - Strong proficiency in Python or Scala. - Expert-level knowledge of Apache Spark, including Spark SQL and DataFrame APIs. - In-depth understanding and practical experience with Delta Lake. - Advanced SQL skills and experience with data warehousing concepts. - Cloud Proficiency: Solid experience with at least one major cloud platform (Azure, AWS, or GCP), including their data storage and processing services (e.G., Azure Data Lake Storage, AWS S3, Google Cloud Storage). - ETL/ELT: Demonstrable experience in designing and implementing complex ETL/ELT pipelines. - Problem-Solving: Excellent analytical and problem-solving abilities with a keen attention to detail. - Communication: Strong verbal and written communication skills, with the ability to explain complex technical concepts to non-technical stakeholders. - Data Visualization: Experience supporting data visualization tools like Power BI or Tableau

  • ▷ (High Salary) Senior Engineer Ii

    4 weeks ago

    Bangalore, Karnataka, India American Express Full time

    You Lead the Way Weve Got Your Back With the right backing people and businesses have the power to progress in incredible ways When you join Team Amex you become part of a global and diverse community of colleagues with an unwavering commitment to back our customers communities and each other Here youll learn and grow as we help you create a career...

  • ▷ High Salary! Lead Data Engineer

    10 hours ago

    Bangalore, Karnataka, India Acesoft Labs Full time

    Job Summary List Format Lead Engineer MarTech Digital Engineering Customer Data Management - Serve as technical lead for a data engineering team managing and activating customer data for Catalyst Brands - Lead the design and implementation of scalable data solutions for marketing analytics personalization and customer engagement - Collaborate...

  • [High Salary] Data Platform Engineer

    6 days ago

    Bangalore, Karnataka, India Takeda Full time

    By clicking the Apply button I understand that my employment application process with Takeda will commence and that the information I provide in my application will be processed in line with Takeda s and I further attest that all information I submit in my employment application is true to the best of my knowledge About the role The Platform Engineer is...

  • ▷ High Salary: Senior Data Analytics

    2 weeks ago

    Bangalore, Karnataka, India Sigmoid Analytics Full time

    Senior Data Analyst Senior Data Analyst Position We are seeking a skilled Senior Data Analyst to join our dynamic team in Bangalore This role is perfect for professionals with 2-7 years of experience who are proficient in Power BI DAX and SQL As a full-time in-office position the successful candidate will have the opportunity to leverage their analytical...

  • ▷ High Salary: Senior Data Platform Engineer

    4 weeks ago

    Bangalore, Karnataka, India Antal International Full time

    Position Summary As the Senior Data Platform Engineer Azure Databricks you will be responsible for building maintaining and evolving our Azure Databricks platform ensuring it is secure reliable scalable and cost-efficient This role is pivotal in empowering our Data- AIOps team by providing a robust automated and well-governed data...

  • (High Salary) Senior Data Engineer

    2 weeks ago

    Bangalore, Karnataka, India GE Healthcare Full time

    Summary Responsible for developing testing and implementing data engineering solutions to generate analytical and reporting solutions Responsible for analyzing and preparing the data needed for data science based outcomes Also responsible for managing and maintaining metadata data structures besides providing necessary support for post-deployment related...

  • Senior Product Engineer

    2 weeks ago

    Bangalore, Karnataka, India Maersk Full time

    APM Terminals We are seeking a highly skilled and experienced Senior Product Engineer with Full Stack Development background to join our dynamic product engineering team As a Product Engineer you will play a crucial role in designing developing and maintaining our software applications using Java and Kotlin The ideal candidate should have a strong background...

  • Senior data engineer

    2 weeks ago

    Bangalore, India Persistent Systems Full time

    About Position: Senior Data Engineer / lead and coordinate a high-performing offshore squad of data engineering contractors for our higher education client. You will serve as the primary point of contact between the offshore team and U. S.-based leadership, ensuring seamless execution of data engineering projects. Role: Senior Data Engineer Location:...

  • ▷ High Salary: Principal Software Engineer

    3 weeks ago

    Bangalore, Karnataka, India AUTODESK Full time

    Job Requisition ID 24WD84211Position Overview We are seeking a highly skilled and experienced Senior NET Software Engineer with a strong emphasis on building APIs to ERP systems to join our dynamic team The ideal candidate will have a deep understanding of NET technologies and a proven track record of delivering high-quality software solutions As a...

  • ▷ High Salary! Director- Data Engineering

    10 hours ago

    Bangalore, Karnataka, India AstraZeneca Full time

    Job Title Director RDU IT - Data Engineering GCL F Introduction to role Are you ready to lead the charge in transforming patient-centric data and AI platforms As the Director RDU IT - Data Engineering at Alexion you ll spearhead the architecture and delivery of innovative enterprise-scale data platforms and pipelines with AI at the core Your mission To drive...