Senior Data Engineer

2 days ago

Bangalore Division, India USEReady Full time

Job Title: Senior Databricks Engineer Experience Level: 5-8 Years Job Summary As a Senior Databricks Engineer, you will be responsible for designing, developing, and optimizing our data architecture and pipelines on the Databricks Lakehouse Platform. You will leverage your deep expertise in Spark, Delta Lake, and cloud technologies to build scalable and reliable solutions that process large-scale data efficiently. The ideal candidate is a proactive problem-solver with a strong background in data engineering and a passion for mentoring and driving technical excellence. Key Responsibilities Architect and Develop: Design, build, and maintain robust and scalable data pipelines and ETL/ELT processes using Databricks, Apache Spark, and Python/Scala. Lakehouse Implementation: Architect and implement solutions on the Databricks Lakehouse Platform, including data modeling, ingestion, storage, and processing using Delta Lake. Performance Optimization: Analyze and tune the performance of Spark jobs and Databricks clusters to ensure high efficiency, reliability, and cost-effectiveness. Data Governance: Implement and manage data governance, data quality, and security best practices within Databricks, utilizing features like Unity Catalog. Collaboration: Work closely with data scientists, analysts, and business stakeholders to understand their data requirements and deliver high-quality, end-to-end data solutions. Automation & CI/CD: Develop and maintain CI/CD pipelines for automated testing and deployment of data workflows (e.g., using Azure DevOps, Jenkins, GitHub Actions). Mentorship: Mentor junior engineers, conduct code reviews, and champion best practices in data engineering and software development. Innovation: Stay current with the latest advancements in the Databricks platform and the broader big data ecosystem, and drive the adoption of new tools and technologies. Required Qualifications and Skills Experience: 5-8 years of professional experience in a data engineering role. Databricks Expertise: Proven hands-on experience architecting and building solutions on the Databricks platform. Core Technical Skills: Strong proficiency in Python or Scala . Expert-level knowledge of Apache Spark , including Spark SQL and DataFrame APIs. In-depth understanding and practical experience with Delta Lake . Advanced SQL skills and experience with data warehousing concepts. Cloud Proficiency: Solid experience with at least one major cloud platform ( Azure , AWS , or GCP ), including their data storage and processing services (e.g., Azure Data Lake Storage, AWS S3, Google Cloud Storage). ETL/ELT: Demonstrable experience in designing and implementing complex ETL/ELT pipelines. Problem-Solving: Excellent analytical and problem-solving abilities with a keen attention to detail. Communication: Strong verbal and written communication skills, with the ability to explain complex technical concepts to non-technical stakeholders. Data Visualization: Experience supporting data visualization tools like Power BI or Tableau

  • Senior Data Engineer

    2 days ago

    Bangalore Division, India Societe Generale Global Solution Centre Full time

    Responsibilities: The role is a Senior Data Engineer who will help shape the future of data-driven auditing. With 7 - 10 years of experience, you will design and maintain scalable data pipelines, ensure compliance with global data regulations (including GDPR), and empower auditors/inspectors with high-quality data and advanced analytics. You will masterize...

  • Senior Data Engineer

    2 days ago

    Bangalore Division, India Zeta Full time

    About Zeta Zeta is a Next-Gen Banking Tech company that empowers banks and fintechs to launch banking products for the future. It was founded by and Ramki Gaddipati in 2015. Our flagship processing platform - Zeta Tachyon - is the industry’s first modern, cloud-native, and fully API-enabled stack that brings together issuance, processing, lending, core...

  • Senior Data Engineer

    7 days ago

    bangalore, India AIQU Full time

    We are hiring for Senior Data Engineer to join one of our major clients based out of KSA. Job Details: Role: Senior Data Engineer Work Location: Remote Employment Type: Contract – 12 months & extendable Role Summary: The Senior Data Engineer plays a lead role in designing, building, optimizing, and governing data pipelines and architectures that power...

  • Principal Data Engineer

    2 days ago

    Bangalore Division, India Autodesk Full time

    #25WD9141 Position Overview We are seeking a highly experienced Principal Engineer to lead the design, development, and evolution of our Batch Processing platform , which powers Autodesk’s Analytics Data Platform (ADP). This role requires deep technical expertise in distributed data systems, large-scale pipeline orchestration, and hands-on leadership in...

  • Senior Data Scientist

    2 days ago

    Bangalore Division, India UptimeAI Inc. Full time

    ```html About the Company: UptimeAI is leading the way in predictive analytics and AI-driven solutions to optimize operational uptime and reduce downtime for industrial and enterprise clients. Our innovative platform harnesses cutting-edge data science to deliver actionable insights, ensuring maximum efficiency and reliability. UptimeAI uniquely combines...

  • Senior Data Engineer

    7 days ago

    bangalore, India AIQU Full time

    We are hiring for Senior Data Engineer to join one of our major clients based out of KSA.Job Details:Role: Senior Data EngineerWork Location: RemoteEmployment Type: Contract – 12 months & extendableRole Summary:The Senior Data Engineer plays a lead role in designing, building, optimizing, and governing data pipelines and architectures that power analytics,...

  • Senior Data Scientist

    2 days ago

    Bangalore Division, India Tundra Technical Solutions Full time

    About the Company : Tundra Technical Solutions is among North America's leading providers of Information Technology, Engineering staffing and consulting services. Our success and our clients' success are built on a foundation of service excellence. Rather than continually trying to sell to new clients and companies and simply filling databases with...

  • Senior Data Scientist

    3 weeks ago

    Bangalore, Karnataka, India Enable Data Incorporated Full time

    Enable Data Incorporated is looking for a talented and experienced Senior Data Scientist to join our innovative team In this role you will be responsible for driving data science initiatives developing predictive models and providing insights that guide key business decisions The ideal candidate has a strong background in statistical analysis machine...

  • Senior Data Engineer

    2 weeks ago

    bangalore, India 6thStreet.com Full time

    Job Title: Senior Data Engineer Location: Bangalore Experience: 3-5 Years Department: Data & Analytics Employment Type: Full-timeAbout the RoleWe’re looking for a Senior Data Engineer to lead the design, development, and scaling of our data infrastructure. You’ll shape best practices, mentor junior engineers, and ensure our data ecosystem empowers...

  • Senior Data Engineer

    6 days ago

    bangalore, India PASO Co Full time

    Job description We’re Hiring: Senior Data Engineer | Remote (Pan India) | Full-Time About the Role One of our client l is looking for a Senior Data Engineer to design and optimize data pipelines, ensure smooth data flow, and support multiple teams with reliable, scalable data solutions. If you love building data systems from the ground up and have hands-on...