Senior Data Engineer
3 weeks ago
Job Title: Senior Databricks Engineer Experience Level: 5-8 Years Job Summary As a Senior Databricks Engineer, you will be responsible for designing, developing, and optimizing our data architecture and pipelines on the Databricks Lakehouse Platform. You will leverage your deep expertise in Spark, Delta Lake, and cloud technologies to build scalable and reliable solutions that process large-scale data efficiently. The ideal candidate is a proactive problem-solver with a strong background in data engineering and a passion for mentoring and driving technical excellence. Key Responsibilities Architect and Develop: Design, build, and maintain robust and scalable data pipelines and ETL/ELT processes using Databricks, Apache Spark, and Python/Scala. Lakehouse Implementation: Architect and implement solutions on the Databricks Lakehouse Platform, including data modeling, ingestion, storage, and processing using Delta Lake. Performance Optimization: Analyze and tune the performance of Spark jobs and Databricks clusters to ensure high efficiency, reliability, and cost-effectiveness. Data Governance: Implement and manage data governance, data quality, and security best practices within Databricks, utilizing features like Unity Catalog. Collaboration: Work closely with data scientists, analysts, and business stakeholders to understand their data requirements and deliver high-quality, end-to-end data solutions. Automation & CI/CD: Develop and maintain CI/CD pipelines for automated testing and deployment of data workflows (e.g., using Azure DevOps, Jenkins, GitHub Actions). Mentorship: Mentor junior engineers, conduct code reviews, and champion best practices in data engineering and software development. Innovation: Stay current with the latest advancements in the Databricks platform and the broader big data ecosystem, and drive the adoption of new tools and technologies. Required Qualifications and Skills Experience: 5-8 years of professional experience in a data engineering role. Databricks Expertise: Proven hands-on experience architecting and building solutions on the Databricks platform. Core Technical Skills: Strong proficiency in Python or Scala . Expert-level knowledge of Apache Spark , including Spark SQL and DataFrame APIs. In-depth understanding and practical experience with Delta Lake . Advanced SQL skills and experience with data warehousing concepts. Cloud Proficiency: Solid experience with at least one major cloud platform ( Azure , AWS , or GCP ), including their data storage and processing services (e.g., Azure Data Lake Storage, AWS S3, Google Cloud Storage). ETL/ELT: Demonstrable experience in designing and implementing complex ETL/ELT pipelines. Problem-Solving: Excellent analytical and problem-solving abilities with a keen attention to detail. Communication: Strong verbal and written communication skills, with the ability to explain complex technical concepts to non-technical stakeholders. Data Visualization: Experience supporting data visualization tools like Power BI or Tableau
-
Senior Data Engineer
6 days ago
Bangalore Division, India Elements HR Services Pvt Ltd Full timeSenior Data Engineer Title Senior Data Engineer Department ISS Location Bengaluru Reports To Data Engineers – Lead Level 4,5,6 We share a commitment to making things better for clients and each other. We continually explore new technology and different ways of working to put our clients first. So, bring your boldest ideas to our (name of team/business...
-
Senior Data Engineer
3 days ago
Bangalore Division, India Veraxion Full timeWe’re Hiring: Senior Data Engineer (Azure) We are looking for a Senior Data Engineer who can design, build, and scale modern data platforms that power analytics, decision-making, and AI across the organization. If you love solving complex data problems, architecting scalable pipelines, and working with cutting-edge Azure technologies — this role is for...
-
Senior Data Engineer
4 days ago
Bangalore Division, India Cloudwick Full timeAbout the role We are seeking Senior Data Engineers to join our data engineering team, who are passionate about data & analytics. The ideal fit for the role will have a strong background in handling large volumes of data with Apache Spark to build , enhance bespoke systems to harness data .The key focus of the position is to build or maintain systems to...
-
Senior Data Engineer
2 weeks ago
Bangalore Division, India Sonata Software Full timeMandatory * Experience building data pipelines * Highly proficient in python, Data frames * Experience with AWS Lambda, Events (SQS), API calls, Kinesis, DynamoDB * Highly proficient in SQL Query * Snowflake or experience with similar analytics database * Experience extracting data from SQL and NoSQL databases. * Experience with CI/CD pipeline to release the...
-
Senior Data Engineer
3 weeks ago
Bangalore Division, India Societe Generale Global Solution Centre Full timeResponsibilities: The role is a Senior Data Engineer who will help shape the future of data-driven auditing. With 7 - 10 years of experience, you will design and maintain scalable data pipelines, ensure compliance with global data regulations (including GDPR), and empower auditors/inspectors with high-quality data and advanced analytics. You will masterize...
-
Senior Data Engineer(Big Data)
1 week ago
Bangalore Division, India Andor Tech Full timeAndor Tech is looking for a highly skilled Senior Big Data Engineer with 8–15 years of experience to join our dynamic team. If you're passionate about big data technologies and thrive in solving complex problems, we want to hear from you! 📍 Location : Deployment to a Product-Based Retail MNC 📅 Immediate Joiners Preferred 🔧 Key Skills Required :...
-
Senior DevOps Engineer
2 weeks ago
bangalore, India Crest Data Full timeCompany Overview: Crest Data is the global leading provider of Data Analytics, Security, DevOps, Cloud Solutions, Software integrations, Analytics, and security-based technological services. With a clientele that includes several Fortune 500 corporations and some of the innovative Silicon Valley Startups. Company URL : Job Location - Ahmedabad Job...
-
Senior Data Scientist
1 week ago
bangalore, India Enable Data Incorporated Full timeEnable Data Incorporated is looking for a talented and experienced Senior Data Scientist to join our innovative team. In this role, you will be responsible for driving data science initiatives, developing predictive models, and providing insights that guide key business decisions. The ideal candidate has a strong background in statistical analysis, machine...
-
Senior Data Scientist
3 days ago
bangalore, India Enable Data Incorporated Full timeEnable Data Incorporated is looking for a talented and experienced Senior Data Scientist to join our innovative team. In this role, you will be responsible for driving data science initiatives, developing predictive models, and providing insights that guide key business decisions. The ideal candidate has a strong background in statistical analysis, machine...
-
Senior Principal Data Engineer
1 week ago
Bangalore Division, India MakeMyTrip Full timeRole: Senior Principal Data Engineer Location: Bangalore Years of Experience: 10-12 Years About Role: We are looking for experienced Data engineers with excellent problem-solving skills to develop machine-learning powered Data Products design to enhance customer experiences. About us: Nurtured from the seed of a single great idea - to empower the traveler -...
