Databricks engineer

Job Title: Databricks Engineer (Remote)Location: 100 % RemoteJob Type: Full-TimeShift timings: 3 pm - 11 pm ISTAbout the Role:We are looking for an experienced Databricks Engineer with a strong background in data engineering to help build and optimize scalable, high-performance data solutions. The ideal candidate has hands-on experience in Databricks production environments and a deep understanding of modern data architecture. You'll work with cross-functional teams to create robust data pipelines and ensure the reliability, quality, and observability of data across platforms.Key ResponsibilitiesDesign, develop, and maintain data pipelines and ETL processes on Databricks.Lead the architecture and implementation of scalable, secure, and high-performance data solutions.Collaborate with business stakeholders, data scientists, and analysts to gather requirements and deliver actionable data solutions.Optimize data workflows for performance, cost-efficiency, and reliability.Integrate data from multiple structured and unstructured sources into Delta Lake and cloud data warehouses.Implement best practices in data governance, security, and quality management.Mentor junior engineers and provide technical leadership in data engineering best practices.Troubleshoot and resolve issues in data pipelines, ensuring high data availability and integrity.Required Skills & Experience6-7 years of experience in Data Engineering.Proven Subject Matter Expertise in Databricks (including Databricks SQL, Delta Lake, and MLflow).Strong experience with Py Spark, Spark SQL, and Scala.Hands-on experience with cloud platforms (Azure preferred; AWS/GCP a plus).Proficiency in data modeling, ETL development, and data warehousing concepts.Solid understanding of big data ecosystems (Hadoop, Kafka, etc.).Strong SQL development skills with a focus on performance tuning.Experience in implementing CI/CD pipelines for data solutions.