Cloud Data Engineer
3 weeks ago
Job Overview – Cloud Data Engineer we strongly believe that data and analytics are strategic drivers for future success. We are building a world class advanced analytics team that will solve some of the most complex strategic problems and deliver topline growth and operational efficiencies across our business The Analytics team at BCSS is part of the BCSS Organization and is responsible for driving organic growth by leveraging big data and advanced analytics. The team reports to the VP and Chief Data Officer at BCSS, works closely with the SVP of Corporate Strategy, and has regular interactions with the company’s C-Suite. We are on an exciting journey to build and scale our advanced analytics practice. BCSS is looking for a Cloud Data Engineer that has experience in building data products using Databricks and related technologies. In this position you will apply your skills to manage the existing cloud data platform to make it more scalable, reliable, and cost efficient. You will also work on additional projects that would leverage the existing architecture in some cases and use newer technologies where needed Primary Responsibilities · Analyze and understand existing data warehouse implementations to support migration and consolidation efforts. · Reverse-engineer legacy stored procedures (PL/SQL, SQL) and translate business logic into scalable Spark SQL code within Databricks notebooks. · Design and develop data lake solutions on AWS using S3 and Delta Lake architecture, leveraging Databricks for processing and transformation. · Build and maintain robust data pipelines using ETL tools with ingestion into S3 and processing in Databricks. · Collaborate with data architects to implement ingestion and transformation frameworks aligned with enterprise standards. · Evaluate and optimize data models (Star, Snowflake, Flattened) for performance and scalability in the new platform. · Document ETL processes, data flows, and transformation logic to ensure transparency and maintainability. · Perform foundational data administration tasks including job scheduling, error troubleshooting, performance tuning, and backup coordination. · Work closely with cross-functional teams to ensure smooth transition and integration of data sources into the unified platform. · Participate in Agile ceremonies and contribute to sprint planning, retrospectives, and backlog grooming · Triage, debug and fix technical issues related to Data Lakes · Maintain and Manage Code repositories like Git You Must Have: · 5+ years of experience working with Databricks, including Spark SQL and Delta Lake implementations. · 3 + years of experience in designing and implementing data lake architectures on Databricks. · Strong SQL and PL/SQL skills with the ability to interpret and refactor legacy stored procedures. · Hands-on experience with data modeling and warehouse design principles. · Proficiency in at least one programming language (Python, Scala, Java). · Bachelor’s degree in Computer Science, Information Technology, Data Engineering, or related field. · Experience working in Agile environments and contributing to iterative development cycles. Experience working on Agile projects and Agile methodology in general We Value · Databricks cloud certification is a big plus · Exposure to enterprise data governance and metadata management practices.
-
Data Engineering Subject Matter Expert
1 week ago
bangalore, India Data Engineer Academy Full timeWe're Hiring: Data Engineering Subject Matter Expert (SME) – Snowflake,Cloud & DatabricksRemote | Part Time | Flexible Timings | Pay: $600 – $1000/MonthlyAbout the OpportunityWe are seeking a highly experienced SME with extensive expertise in Snowflake, Databricks, and AWS cloud platforms.What We're Looking ForMinimum 9-15 years of experience in cloud...
-
Data Engineering Subject Matter Expert
7 days ago
bangalore, India Data Engineer Academy Full timeWe're Hiring: Data Engineering Subject Matter Expert (SME) – Snowflake,Cloud & Databricks Remote | Part Time | Flexible Timings | Pay: $600 – $1000/Monthly About the Opportunity We are seeking a highly experienced SME with extensive expertise in Snowflake, Databricks, and AWS cloud platforms. What We're Looking For Minimum 9-15 years of experience in...
-
Cloud Data Engineer
3 weeks ago
Bangalore Urban, India Blue Cloud Softech Solutions Limited Full timeJob Overview – Cloud Data Engineerwe strongly believe that data and analytics are strategic drivers for future success. We are building a world class advanced analytics team that will solve some of the most complex strategic problems and deliver topline growth and operational efficiencies across our business The Analytics team at BCSS is part of the BCSS...
-
Cloud Data Engineer
2 weeks ago
Bangalore Urban, Karnataka, India, IN Blue Cloud Softech Solutions Limited Full timeJob Overview – Cloud Data Engineerwe strongly believe that data and analytics are strategic drivers for future success. We are building a world class advanced analytics team that will solve some of the most complex strategic problems and deliver topline growth and operational efficiencies across our business The Analytics team at BCSS is part of the BCSS...
-
Data/ML Ops Engineer
2 days ago
Bangalore Urban, India NTT DATA, Inc. Full timeWe are looking for a MLOps Engineer / DataOps Engineer with Cloud / Databricks experience. The role will be responsible for seamless flow of information throughout the company, maintaining and managing the production data pipelines.You will be working across a variety of tasks, primarily cloud engineering, establishing best practice and building out our...
-
Data/ML Ops Engineer
2 days ago
Bangalore Urban, India NTT DATA, Inc. Full timeWe are looking for a MLOps Engineer / DataOps Engineer with Cloud / Databricks experience. The role will be responsible for seamless flow of information throughout the company, maintaining and managing the production data pipelines. You will be working across a variety of tasks, primarily cloud engineering, establishing best practice and building out our...
-
Cloud Data Engineer
3 weeks ago
Bangalore, India Blue Cloud Softech Solutions Limited Full timeJob Overview – Cloud Data Engineer we strongly believe that data and analytics are strategic drivers for future success. We are building a world class advanced analytics team that will solve some of the most complex strategic problems and deliver topline growth and operational efficiencies across our business The Analytics team at BCSS is part of the BCSS...
-
Cloud Data Engineer
2 weeks ago
bangalore district, India Blue Cloud Softech Solutions Limited Full timeJob Overview – Cloud Data Engineer we strongly believe that data and analytics are strategic drivers for future success. We are building a world class advanced analytics team that will solve some of the most complex strategic problems and deliver topline growth and operational efficiencies across our business The Analytics team at BCSS is part of the BCSS...
-
Data Engineer
1 week ago
Bangalore Urban, India AS Technology Corporation Full timeWe are seeking an experienced Data Engineer to design, build, and optimize scalable data pipelines and data infrastructure solutions. This role involves working with cloud platforms, big data frameworks, and streaming technologies to enable both batch and real-time data processing for business insights and analytics.Key Responsibilities:Design, implement,...
-
Data Engineer
3 weeks ago
Bangalore Urban, India HireAlpha Full timeJob Title: Data Engineer Location: Bengaluru (Onsite)/Pune (Onsite) We are seeking a highly skilled Data Engineer with strong experience in PySpark, AWS Data Engineering, and Snowflake development. Key Responsibilities Hands-on development using PySpark with strong understanding of RDDs, DataFrames, SparkSQL Build, test, and maintain applications on AWS...