Cloud Data Engineer

1 hour ago

Bangalore Urban Karnataka India, IN Blue Cloud Softech Solutions Limited Full time

Job Overview – Cloud Data Engineer


we strongly believe that data and analytics are strategic drivers for future success. We are building a world class advanced analytics team that will solve some of the most complex strategic problems and deliver topline growth and operational efficiencies across our business The Analytics team at BCSS is part of the BCSS Organization and is responsible for driving organic growth by leveraging big data and advanced analytics. The team reports to the VP and Chief Data Officer at BCSS, works closely with the SVP of Corporate Strategy, and has regular interactions with the company’s C-Suite.


We are on an exciting journey to build and scale our advanced analytics practice. BCSS is looking for a Cloud Data Engineer that has experience in building data products using Databricks and related technologies.


In this position you will apply your skills to manage the existing cloud data platform to make it more scalable, reliable, and cost efficient. You will also work on additional projects that would leverage the existing architecture in some cases and use newer technologies where needed


Primary Responsibilities


· Analyze and understand existing data warehouse implementations to support migration and consolidation efforts.


· Reverse-engineer legacy stored procedures (PL/SQL, SQL) and translate business logic into scalable Spark SQL code within Databricks notebooks.


· Design and develop data lake solutions on AWS using S3 and Delta Lake architecture, leveraging Databricks for processing and transformation.


· Build and maintain robust data pipelines using ETL tools with ingestion into S3 and processing in Databricks.


· Collaborate with data architects to implement ingestion and transformation frameworks aligned with enterprise standards.


· Evaluate and optimize data models (Star, Snowflake, Flattened) for performance and scalability in the new platform.


· Document ETL processes, data flows, and transformation logic to ensure transparency and maintainability.


· Perform foundational data administration tasks including job scheduling, error troubleshooting, performance tuning, and backup coordination.


· Work closely with cross-functional teams to ensure smooth transition and integration of data sources into the unified platform.


· Participate in Agile ceremonies and contribute to sprint planning, retrospectives, and backlog grooming


· Triage, debug and fix technical issues related to Data Lakes


· Maintain and Manage Code repositories like Git


You Must Have:


· 5+ years of experience working with Databricks, including Spark SQL and Delta Lake implementations.


· 3 + years of experience in designing and implementing data lake architectures on Databricks.


· Strong SQL and PL/SQL skills with the ability to interpret and refactor legacy stored procedures.


· Hands-on experience with data modeling and warehouse design principles.


· Proficiency in at least one programming language (Python, Scala, Java).


· Bachelor’s degree in Computer Science, Information Technology, Data Engineering, or related field.


· Experience working in Agile environments and contributing to iterative development cycles. Experience working on Agile projects and Agile methodology in general


We Value


· Databricks cloud certification is a big plus


· Exposure to enterprise data governance and metadata management practices.

  • Data Engineer

    2 hours ago

    Bangalore Urban, Karnataka, India, IN AS Technology Corporation Full time

    We are seeking an experienced Data Engineer to design, build, and optimize scalable data pipelines and data infrastructure solutions. This role involves working with cloud platforms, big data frameworks, and streaming technologies to enable both batch and real-time data processing for business insights and analytics.Key Responsibilities:Design, implement,...

  • Senior Data Engineer

    1 hour ago

    Bangalore Urban, Karnataka, India, IN Publicis Production Full time

    Job Summary:We are seeking a proactive and self-motivated Senior Data Engineer with a proven track record in building scalable cloud-based data solutions across multiple cloud platforms to support our work in architecting, building and maintaining the data infrastructure. The specific focus for this role will start with GCP however we require experience with...

  • GCP Data Engineer

    2 hours ago

    Bangalore Urban, Karnataka, India, IN Impetus Full time

    Job Title: GCP Data EngineerLocation: BengaluruExperience: 3-8 yearsAbout the Role:Design, build, and maintain large-scale data pipelines on BigQuery and other Google Cloud Platform (GCP) services.Use Python and PySpark/Spark to transform, clean, aggregate and prepare data for analytics/ML.Orchestrate workflows using Cloud Composer (Airflow) to schedule,...

  • AI Data Engineer

    2 hours ago

    Bangalore Urban, Karnataka, India, IN Tata Consultancy Services Full time

    Job Title: AI Data EngineerExp- 4 to 8 yearsLocation- PAN IndiaJob DescriptionKey Responsibilities:• Build and maintain data infrastructure: Design and construct scalable, reliable data pipelines, storage, and processing systems in the cloud.• Ensure data quality: Clean, transform, and enrich raw data to create "business truth" that AI models can use for...

  • Palantir Data Engineer

    2 hours ago

    Bangalore Urban, Karnataka, India, IN Tata Consultancy Services Full time

    Greetings from TCS !!!Role : Data EngineerExperience Range : 3-9 YearsLocation of Requirement : PAN IndiaJob Description :4+ years of experience in data engineering or data analytics roles3+ year of experience with Palantir FoundryJob OverviewWe are seeking a Senior Palantir Foundry Developer to join our data engineering and analytics team. In this role, you...

  • Cloud Data Engineer

    1 hour ago

    india, IN Lemongrass Full time

    About LemongrassLemongrass is a software-enabled services provider, synonymous with SAP on Cloud, focused on delivering superior, highly automated Managed Services to Enterprise customers. Our customers span multiple verticals and geographies across the Americas, EMEA and APAC. We partner with AWS, SAP, Microsoft and other global technology leaders.We are...

  • GCP data Engineer

    2 hours ago

    Bangalore Urban, Karnataka, India, IN Impetus Full time

    Provides technical leadership in Big Data space (Hadoop Stack like Spark, M/R, HDFS, Hive, HBase etc) and contributes to open source Big Data technologies.ResponsibilitiesMust have: Operating knowledge of cloud computing platforms (GCP, especially Big Query, Dataflow, Dataproc, Storage, VMs, Networking, Pub Sub, Cloud Functions, Composer services).Should be...

  • Senior Data Engineer

    1 hour ago

    Bangalore Urban district, India, IN AuxoAI Full time

    AuxoAI is seeking a Senior Data Engineer to lead the design, development, and optimization of modern data pipelines and cloud-native platforms using Google Cloud Platform (GCP). This role is ideal for someone with deep experience building scalable batch and streaming data workflows, strong hands-on engineering skills, and a drive to mentor junior...

  • Engineering Manager

    1 hour ago

    Bangalore Urban, Karnataka, India, IN HiLabs Full time

    We are looking for an experienced Data Engineering Manager to lead and scale our data engineering function. The ideal candidate will be responsible for designing, building, and maintaining high-quality data pipelines and platforms that support analytics, reporting, and data-driven decision-making across the organization. This role involves leading a team of...

  • Cloud Architect

    2 hours ago

    Bangalore Urban, Karnataka, India, IN Insight Global Full time

    Overview:Join Shell Olympus as a Lead Controls and Automation Engineer, driving automation and control systems for advanced industrial operations. This role focuses on designing, implementing, and optimizing automation solutions to ensure reliability, efficiency, and safety across complex processes.Key ResponsibilitiesSystem Design & Development:Architect...