Cloud Data Lake Lead Engineer

2 months ago


bangalore, India Anicalls (Pty) Ltd Full time
Candidate should be able to:
Consult with business stakeholders and translate their requirements into analytics and reports on the data lake
Design and implement a data catalog that democratizes data access in a secure way
Develop and execute test plans to validate code
Investigate, recommend and implement data ingestion and ETL performance improvements
Utilize best practices for the design and implementation of the data lake storage approach on Public Cloud: including data store, formats, encryption, compression, and access controls
Connect applications to the data lake for data consumption
On-board end-to-end datasets to the data lake and relevant access provisioning
Uncover and recommend remediation for data quality anomalies
Build and implement complex data solutions in the cloud
Candidate should have:
Bachelor's degree or equivalent experience in Computer Science, Engineering, or Mathematics
Experience developing software code in one or more programming languages (Java, Python, etc.)
Experience with one or more SQL-on-Hadoop technology (Hive, Impala, Spark SQL, Presto)
Experience with one or more relevant tools (Sqoop, Flume, Kafka, Oozie, Hue, Zookeeper, HCatalog, Solr, Avro)
Experience with Apache Hadoop and the Hadoop ecosystem, including hands-on experience in implementation and performance tuning Hadoop/Spark implementations.
Experience with cloud and commercial Data Lake platforms
Understanding of database and analytical technologies in the industry including MPP and NoSQL databases, Data Warehouse design, BI reporting, and Dashboard development
Implementing AWS services in a variety of distributed computing, enterprise environments
Ability to collaborate effectively across organizations
Ability to think strategically about business, product, and technical challenges in an enterprise environment
Demonstrated industry expertise in the fields of database, data warehousing, or data science

  • bangalore, India First Abu Dhabi Bank Full time

    Job Description Job Purpose  Role is required to support the transformation programme which aims at modernizing the data platforms estate for the bank. Traditional on-premises data warehouse and data lake should be transformed to meet the scalability, agility and modern capabilities needs as the bank embarks on the journey to implement the...


  • bangalore, India Recro Full time

    Job Title: Lead GCP Data EngineerLocation: Bengaluru, Karnataka, IndiaExperience: 7-10 yearsResponsibilities:Cloud Analytics Platform :Build and optimize a cloud analytics platform on Google Cloud Platform (GCP) to meet evolving business needs using lean Agile practices.Design and implement solutions for transformation and modernization on GCP.Data...

  • Lead Data Engineer

    20 hours ago


    bangalore, India Brillio Full time

    Azure data lead • 6 - 8 years of experience as Tech Lead in Azure data technologies • Hands on development experience in Azure stack- Azure Data Factory, Azure Data Lake, Azure Synapse, Azure SQL, Azure DevOps • Desired to have implementation experience in PySpark, Microsoft Fabric, Purview, and PowerBI • Strong experience in architecture, design and...

  • Lead Data Engineer

    2 weeks ago


    bangalore, India JPMorgan Chase & Co. Full time

    We have an opportunity to impact your career and provide an adventure where you can push the limits of what's possible. As a Lead Software Engineer at JPMorgan Chase within the CCB, CAMP, you are an integral part of an agile team that works to enhance, build, and deliver trusted market-leading technology products in a secure, stable, and scalable way. As...

  • Lead Data Engineer

    5 days ago


    bangalore, India Encora Inc. Full time

    What you'll get to do... • Collaborate and partner with Business Analyst teams located in US and EMEA regions. • Interface across our Business Analyst and Data Science teams • Play a key role in integrating new data sources into our data & analytical ecosystem over AWS cloud • Implement data lake solutions while addressing common data...


  • bangalore, India Genpact Full time

    Genpact (NYSE: G) is a global professional services and solutions firm delivering outcomes that shape the future. Our 125,000+ people across 30+ countries are driven by our innate curiosity, entrepreneurial agility, and desire to create lasting value for clients. Powered by our purpose – the relentless pursuit of a world that works better for people –...

  • Lead Data Engineer

    2 days ago


    bangalore, India JLL Full time

    Job Description Lead Data Engineer About JLL and JLL Technologies JLL is a leading professional services firm that specializes in real estate and investment management. Our vision is to reimagine the world of real estate, creating rewarding opportunities and amazing spaces where people can achieve their ambitions. In doing so, we will build a...


  • Bangalore Urban, India Recro Full time

    Job Title: Lead GCP Data Engineer Location: Bengaluru, Karnataka, India Experience: 7-10 years Responsibilities: Cloud Analytics Platform : Build and optimize a cloud analytics platform on Google Cloud Platform (GCP) to meet evolving business needs using lean Agile practices. Design and implement solutions for transformation and modernization on GCP. ...


  • Bangalore Urban, India Recro Full time

    Job Title: Lead GCP Data EngineerLocation: Bengaluru, Karnataka, IndiaExperience: 7-10 yearsResponsibilities:Cloud Analytics Platform:Build and optimize a cloud analytics platform on Google Cloud Platform (GCP) to meet evolving business needs using lean Agile practices.Design and implement solutions for transformation and modernization on GCP.Data...


  • bangalore, India NTT DATA Full time

    Job Description Azure Data Engineer Requirements 4+ years’ overall experience in data domain (data analysis, database developer) Minimum 3 years’ experience as a cloud-based Data Engineer Minimum 3 years’ experience and strong knowledge of Azure Data Services such as Azure Data Lake Storage, Blob Storage, Azure Data Factory, Minimum 3 years’...

  • Cloud Data Engineer

    4 weeks ago


    Bangalore/Hyderabad/Chennai/Pune/Anywhere in India/Multiple Locations Amk technologies Full time

    Job Description : We are seeking a talented and motivated Cloud Data Engineer to join our dynamic team. As a Cloud Data Engineer, you will be responsible for designing, implementing, and maintaining data pipelines and infrastructure on Azure Cloud Platform. You will work closely with cross-functional teams to ensure efficient data flow and integration...


  • Bangalore, India State Street Full time

    Role Summary Role DescriptionWe are looking for a Data Engineer with 8+ years of work experience with hands-on cloud data migration development experience. The candidate should have industry experience (preferably in Financial Services) in supporting enterprise applications  and exposure to Cloud based database engineering platforms.• Design and...


  • bangalore, India Resillion Full time

    Job DescriptionRole: Senior Data Engineer(Azure) Experience Range: 8+ years  location: Bangalore  Resillion, a leading quality engineering company with offices around the world, is seeking a talented Data Engineer to join our growing India team. In this role, you will play a critical part in building and maintaining the data infrastructure that supports...

  • Data Engineer

    2 weeks ago


    bangalore, India Idexcel Full time

    Experience: 3 to 10 yearsMode of work - Work from officeLocation: BangaloreNotice period - Immediate to 15 daysShould be available for F2F interviewJob DescriptionCandidate will join our Advance Analytics project.Will be working on Multiple Data Integration projects.Will be working on creating Data Lake in open table format.Will involve in creating Realtime...

  • Data Engineer

    6 days ago


    Bangalore, India CLOUD RAPTOR INDIA DIGITAL SERVICES Full time

    About the job:About us :- At Cloud Raptor, we specialise in providing scalable and efficient solutions to businesses across many industries.- Focused on cloud technologies and technical expertise, we help organisations navigate the ever-changing landscape of the digital era.- With dedicated Centres of Excellence across the globe, we are enabled to deliver...

  • Cloud Engineer

    3 weeks ago


    Bangalore, Karnataka, India Andor Tech Full time

    Experience Required: 5+ YearsImmediate Joiners Preferred: Max 15 Design, deploy, and maintain cloud-based solutions on the Azure platform, including Azure Databricks, Azure Data Factory, Azure Data Lake Storage (ADLS), and Azure Synapse Analytics.- Develop and optimize software applications and scripts using Python, SQL, PySpark, and Unix scripting to...

  • Cloud Engineer

    3 weeks ago


    Bangalore, India Andor Tech Full time

    Experience Required: 5+ YearsImmediate Joiners Preferred: Max 15 Design, deploy, and maintain cloud-based solutions on the Azure platform, including Azure Databricks, Azure Data Factory, Azure Data Lake Storage (ADLS), and Azure Synapse Analytics.- Develop and optimize software applications and scripts using Python, SQL, PySpark, and Unix scripting to...

  • Lead Data Engineer

    2 weeks ago


    bangalore, India TVS Motor Company Full time

    Role Title: Lead Data EngineerLocation of job : E City BangaloreEducational Qualification: B.E in Computer science / MBAExperience: 7 - 10 YearsObjective of role:This person will be responsible for overseeing all engineering related activities of the team, ensuring proper execution of duties and alignment with the business’s overall vision.The...


  • Bangalore/Noida/Hyderabad/Pune, IN Nilasu consulting Full time

    Position Overview:We are seeking a highly skilled and experienced Azure-Cloud Data Solution Architect to join our team. The Solution Architect will be responsible for designing and implementing end-to-end data solutions, including Data Warehouse, ETL, Data Lake, and Cloud Migration projects. The ideal candidate will have extensive experience in data...


  • Bangalore/Noida/Hyderabad/Pune, India Nilasu consulting Full time

    Position Overview:We are seeking a highly skilled and experienced Azure-Cloud Data Solution Architect to join our team. The Solution Architect will be responsible for designing and implementing end-to-end data solutions, including Data Warehouse, ETL, Data Lake, and Cloud Migration projects. The ideal candidate will have extensive experience in data...