Cloud Data Engineer
5 hours ago
Title-Cloud data Engineer
mode:Remote
Job Description:
Primary Responsibilities
· Analyze and understand existing data warehouse implementations to support migration and consolidation efforts.
· Reverse-engineer legacy stored procedures (PL/SQL, SQL) and translate business logic into scalable Spark SQL code within Databricks notebooks.
· Design and develop data lake solutions on AWS using S3 and Delta Lake architecture, leveraging Databricks for processing and transformation.
· Build and maintain robust data pipelines using ETL tools with ingestion into S3 and processing in Databricks.
· Collaborate with data architects to implement ingestion and transformation frameworks aligned with enterprise standards.
· Evaluate and optimize data models (Star, Snowflake, Flattened) for performance and scalability in the new platform.
· Document ETL processes, data flows, and transformation logic to ensure transparency and maintainability.
· Perform foundational data administration tasks including job scheduling, error troubleshooting, performance tuning, and backup coordination.
· Work closely with cross-functional teams to ensure smooth transition and integration of data sources into the unified platform.
· Participate in Agile ceremonies and contribute to sprint planning, retrospectives, and backlog grooming
· Triage, debug and fix technical issues related to Data Lakes
· Maintain and Manage Code repositories like Git
Must Have skills:
· 5+ years of experience working with Databricks, including Spark SQL and Delta Lake implementations.
· 3 + years of experience in designing and implementing data lake architectures on Databricks.
· Strong SQL and PL/SQL skills with the ability to interpret and refactor legacy stored procedures.
· Hands-on experience with data modeling and warehouse design principles.
· Proficiency in at least one programming language (Python, Scala, Java).
· Bachelor's degree in Computer Science, Information Technology, Data Engineering, or related field.
· Experience working in Agile environments and contributing to iterative development cycles. Experience working on Agile projects and Agile methodology in general
We Value
· Databricks cloud certification is a big plus
· Exposure to enterprise data governance and metadata management practices.
Job Type: Contractual / Temporary
Contract length: 14 months
Pay: ₹2,500, ₹3,000,000.00 per year
Benefits:
- Work from home
Experience:
- cloud data Engineering: 5 years (Required)
- Databricks, Spark SQL, Delta lake: 5 years (Required)
- Datalake Architecture: 3 years (Required)
Work Location: In person
-
Cloud Support Engineer
1 week ago
Bengaluru, Karnataka, India Aura Cloud Full time ₹ 15,00,000 - ₹ 25,00,000 per yearAura Cloud is a class leading cloud platform for financial institutions to launch and run their business at light-speed. Our platform is at the center of our customers' digitization path and business critical.We provide 24/7 platforms for critical core financial applications that require a very high degree of quality and stability of the platform. We are...
-
L1 Cloud Engineer
2 weeks ago
Bengaluru, Karnataka, India NTT DATA Full time ₹ 5,00,000 - ₹ 15,00,000 per yearAs an L1 cloud engineer, should have good understanding of cloud platform, networking, and storage principles with focus on Azure. Cloud administration, maintenance, and troubleshooting experience. Monitor cloud and infrastructure services to ensure uninterrupted operations. Monitor and manage support tickets during assigned shifts, ensuring timely and...
-
Cloud Data Engineer
4 days ago
Bengaluru, Karnataka, India Tata Consultancy Services (TCS) Full time ₹ 5,00,000 - ₹ 25,00,000 per yearLocation: Chennai,Bangalore,Hyderabad1) Should be able to design strategies and programs to collect, store, analyse and visualize data from various sources.2) Should be able to develop big data solution recommendations and ensure implementation of the chosen big data solution.3) Needs to be able to program, preferably in different programming/scripting...
-
Data Science Engineer
6 days ago
Bengaluru, Karnataka, India Hireginie Talent Cloud Full time ₹ 12,00,000 - ₹ 36,00,000 per yearData Science & AI LeadAbout Our Client: A leading IT and data solutions provider offering services in consulting, systems integration, data science, IoT, and business process outsourcing. The company enables organizations to enhance efficiency, solve complex challenges, and drive digital transformation.Job Description: Data Science & AI LeadLocation:...
-
Senior Cloud Engineer
4 days ago
Bengaluru, Karnataka, India Cloud Software Group Full time ₹ 12,00,000 - ₹ 36,00,000 per yearWe need you to:Own our SQL database systems and meet critical quality, availability, performance and reliability goalsDesign and build the tools, frameworks, systems, and processes related to the operation of our databases and integration with Site Reliability capabilitiesWork with the development teams to design scalable, robust systems using cloud...
-
Director Cloud Data engineer
2 weeks ago
Bengaluru, Karnataka, India Weekday AI Full time ₹ 24,00,000 - ₹ 36,00,000 per yearThis role is for one of the Weekday's clientsSalary range: Rs Rs ie INR 40-60 LPA)Min Experience: 16 yearsLocation: BangaloreJobType: full-timeAs the Director of Cloud Data Engineering, you will define, drive, and execute the organization's cloud-first data strategy. You will lead cross-functional engineering teams responsible for designing scalable data...
-
Snowflake Data Engineer
2 weeks ago
Bengaluru, Karnataka, India Kasmo Cloud Solutions Full time ₹ 20,00,000 - ₹ 25,00,000 per yearAbout the opportunity:We are seeking a highly skilled and experienced Snowflake Developer with a strong background in SQL, Python, and a minimum of 3 years of hands-on experience with Snowflake. The ideal candidate will be a Snowflake Certified with a proven track record in data warehousing, data modelling, and implementing ETL/ELT pipelines using...
-
Sr. Data Engineer
2 hours ago
Bengaluru, Karnataka, India Blue Cloud Softech Solutions Full time ₹ 24,00,000 - ₹ 30,00,000 per yearJob title-Data Engineer(Databricks with AWS & Python skills)Mode:RemoteLocation:BengaluruPrimary ResponsibilitiesDesign, develop, and maintain data lakes and data pipelines on AWS using ETL frameworks and Databricks.Integrate and transform large-scale data from multiple heterogeneous sources into a centralized data lake environment.Implement and manage Delta...
-
Data Engineering
4 days ago
Bengaluru, Karnataka, India NTT DATA Full time ₹ 12,00,000 - ₹ 18,00,000 per yearReq ID: 345813NTT DATA strives to hire exceptional, innovative and passionate individuals who want to grow with us. If you want to be part of an inclusive, adaptable, and forward-thinking organization, apply now. We are currently seeking a Data Engineering & Analytics Architect to join our team in Bangalore, Karnātaka (IN-KA), India (IN). Role: Own the...
-
Data & AI Engineer Lead
6 days ago
Bengaluru, Karnataka, India NTT DATA Full time ₹ 12,00,000 - ₹ 36,00,000 per yearFramework Design & Architecture Architect a metadata-driven, Python/Spark-based framework for automated data validation across high-volume production datasets. Define DQ rule templates for completeness, integrity, conformity, accuracy, and timeliness. Establish data quality thresholds, escalation protocols, and exception workflows. Automation & Integration...