Cloud Data Lake Lead Engineer
2 months ago
Consult with business stakeholders and translate their requirements into analytics and reports on the data lake
Design and implement a data catalog that democratizes data access in a secure way
Develop and execute test plans to validate code
Investigate, recommend and implement data ingestion and ETL performance improvements
Utilize best practices for the design and implementation of the data lake storage approach on Public Cloud: including data store, formats, encryption, compression, and access controls
Connect applications to the data lake for data consumption
On-board end-to-end datasets to the data lake and relevant access provisioning
Uncover and recommend remediation for data quality anomalies
Build and implement complex data solutions in the cloud
Candidate should have:
Bachelor's degree or equivalent experience in Computer Science, Engineering, or Mathematics
Experience developing software code in one or more programming languages (Java, Python, etc.)
Experience with one or more SQL-on-Hadoop technology (Hive, Impala, Spark SQL, Presto)
Experience with one or more relevant tools (Sqoop, Flume, Kafka, Oozie, Hue, Zookeeper, HCatalog, Solr, Avro)
Experience with Apache Hadoop and the Hadoop ecosystem, including hands-on experience in implementation and performance tuning Hadoop/Spark implementations.
Experience with cloud and commercial Data Lake platforms
Understanding of database and analytical technologies in the industry including MPP and NoSQL databases, Data Warehouse design, BI reporting, and Dashboard development
Implementing AWS services in a variety of distributed computing, enterprise environments
Ability to collaborate effectively across organizations
Ability to think strategically about business, product, and technical challenges in an enterprise environment
Demonstrated industry expertise in the fields of database, data warehousing, or data science
-
AVP- Cloud Data Engineer
1 week ago
bangalore, India First Abu Dhabi Bank Full timeJob Description Job Purpose Role is required to support the transformation programme which aims at modernizing the data platforms estate for the bank. Traditional on-premises data warehouse and data lake should be transformed to meet the scalability, agility and modern capabilities needs as the bank embarks on the journey to implement the...
-
Lead GCP Data Engineer
3 weeks ago
bangalore, India Recro Full timeJob Title: Lead GCP Data EngineerLocation: Bengaluru, Karnataka, IndiaExperience: 7-10 yearsResponsibilities:Cloud Analytics Platform :Build and optimize a cloud analytics platform on Google Cloud Platform (GCP) to meet evolving business needs using lean Agile practices.Design and implement solutions for transformation and modernization on GCP.Data...
-
Lead Data Engineer
20 hours ago
bangalore, India Brillio Full timeAzure data lead • 6 - 8 years of experience as Tech Lead in Azure data technologies • Hands on development experience in Azure stack- Azure Data Factory, Azure Data Lake, Azure Synapse, Azure SQL, Azure DevOps • Desired to have implementation experience in PySpark, Microsoft Fabric, Purview, and PowerBI • Strong experience in architecture, design and...
-
Lead Data Engineer
2 weeks ago
bangalore, India JPMorgan Chase & Co. Full timeWe have an opportunity to impact your career and provide an adventure where you can push the limits of what's possible. As a Lead Software Engineer at JPMorgan Chase within the CCB, CAMP, you are an integral part of an agile team that works to enhance, build, and deliver trusted market-leading technology products in a secure, stable, and scalable way. As...
-
Lead Data Engineer
5 days ago
bangalore, India Encora Inc. Full timeWhat you'll get to do... • Collaborate and partner with Business Analyst teams located in US and EMEA regions. • Interface across our Business Analyst and Data Science teams • Play a key role in integrating new data sources into our data & analytical ecosystem over AWS cloud • Implement data lake solutions while addressing common data...
-
Senior Principal Consultant-Azure Data Lake
1 month ago
bangalore, India Genpact Full timeGenpact (NYSE: G) is a global professional services and solutions firm delivering outcomes that shape the future. Our 125,000+ people across 30+ countries are driven by our innate curiosity, entrepreneurial agility, and desire to create lasting value for clients. Powered by our purpose – the relentless pursuit of a world that works better for people –...
-
Lead Data Engineer
2 days ago
bangalore, India JLL Full timeJob Description Lead Data Engineer About JLL and JLL Technologies JLL is a leading professional services firm that specializes in real estate and investment management. Our vision is to reimagine the world of real estate, creating rewarding opportunities and amazing spaces where people can achieve their ambitions. In doing so, we will build a...
-
Lead GCP Data Engineer
3 weeks ago
Bangalore Urban, India Recro Full timeJob Title: Lead GCP Data Engineer Location: Bengaluru, Karnataka, India Experience: 7-10 years Responsibilities: Cloud Analytics Platform : Build and optimize a cloud analytics platform on Google Cloud Platform (GCP) to meet evolving business needs using lean Agile practices. Design and implement solutions for transformation and modernization on GCP. ...
-
Lead GCP Data Engineer
3 weeks ago
Bangalore Urban, India Recro Full timeJob Title: Lead GCP Data EngineerLocation: Bengaluru, Karnataka, IndiaExperience: 7-10 yearsResponsibilities:Cloud Analytics Platform:Build and optimize a cloud analytics platform on Google Cloud Platform (GCP) to meet evolving business needs using lean Agile practices.Design and implement solutions for transformation and modernization on GCP.Data...
-
bangalore, India NTT DATA Full timeJob Description Azure Data Engineer Requirements 4+ years’ overall experience in data domain (data analysis, database developer) Minimum 3 years’ experience as a cloud-based Data Engineer Minimum 3 years’ experience and strong knowledge of Azure Data Services such as Azure Data Lake Storage, Blob Storage, Azure Data Factory, Minimum 3 years’...
-
Cloud Data Engineer
4 weeks ago
Bangalore/Hyderabad/Chennai/Pune/Anywhere in India/Multiple Locations Amk technologies Full timeJob Description : We are seeking a talented and motivated Cloud Data Engineer to join our dynamic team. As a Cloud Data Engineer, you will be responsible for designing, implementing, and maintaining data pipelines and infrastructure on Azure Cloud Platform. You will work closely with cross-functional teams to ensure efficient data flow and integration...
-
Cloud Data Engineer- Tech Lead
2 months ago
Bangalore, India State Street Full timeRole Summary Role DescriptionWe are looking for a Data Engineer with 8+ years of work experience with hands-on cloud data migration development experience. The candidate should have industry experience (preferably in Financial Services) in supporting enterprise applications and exposure to Cloud based database engineering platforms.⢠Design and...
-
Senior Data Engineer
3 days ago
bangalore, India Resillion Full timeJob DescriptionRole: Senior Data Engineer(Azure) Experience Range: 8+ years location: Bangalore Resillion, a leading quality engineering company with offices around the world, is seeking a talented Data Engineer to join our growing India team. In this role, you will play a critical part in building and maintaining the data infrastructure that supports...
-
Data Engineer
2 weeks ago
bangalore, India Idexcel Full timeExperience: 3 to 10 yearsMode of work - Work from officeLocation: BangaloreNotice period - Immediate to 15 daysShould be available for F2F interviewJob DescriptionCandidate will join our Advance Analytics project.Will be working on Multiple Data Integration projects.Will be working on creating Data Lake in open table format.Will involve in creating Realtime...
-
Data Engineer
6 days ago
Bangalore, India CLOUD RAPTOR INDIA DIGITAL SERVICES Full timeAbout the job:About us :- At Cloud Raptor, we specialise in providing scalable and efficient solutions to businesses across many industries.- Focused on cloud technologies and technical expertise, we help organisations navigate the ever-changing landscape of the digital era.- With dedicated Centres of Excellence across the globe, we are enabled to deliver...
-
Cloud Engineer
3 weeks ago
Bangalore, Karnataka, India Andor Tech Full timeExperience Required: 5+ YearsImmediate Joiners Preferred: Max 15 Design, deploy, and maintain cloud-based solutions on the Azure platform, including Azure Databricks, Azure Data Factory, Azure Data Lake Storage (ADLS), and Azure Synapse Analytics.- Develop and optimize software applications and scripts using Python, SQL, PySpark, and Unix scripting to...
-
Cloud Engineer
3 weeks ago
Bangalore, India Andor Tech Full timeExperience Required: 5+ YearsImmediate Joiners Preferred: Max 15 Design, deploy, and maintain cloud-based solutions on the Azure platform, including Azure Databricks, Azure Data Factory, Azure Data Lake Storage (ADLS), and Azure Synapse Analytics.- Develop and optimize software applications and scripts using Python, SQL, PySpark, and Unix scripting to...
-
Lead Data Engineer
2 weeks ago
bangalore, India TVS Motor Company Full timeRole Title: Lead Data EngineerLocation of job : E City BangaloreEducational Qualification: B.E in Computer science / MBAExperience: 7 - 10 YearsObjective of role:This person will be responsible for overseeing all engineering related activities of the team, ensuring proper execution of duties and alignment with the business’s overall vision.The...
-
Azure Cloud Data Solution Architect
4 weeks ago
Bangalore/Noida/Hyderabad/Pune, IN Nilasu consulting Full timePosition Overview:We are seeking a highly skilled and experienced Azure-Cloud Data Solution Architect to join our team. The Solution Architect will be responsible for designing and implementing end-to-end data solutions, including Data Warehouse, ETL, Data Lake, and Cloud Migration projects. The ideal candidate will have extensive experience in data...
-
Azure Cloud Data Solution Architect
4 weeks ago
Bangalore/Noida/Hyderabad/Pune, India Nilasu consulting Full timePosition Overview:We are seeking a highly skilled and experienced Azure-Cloud Data Solution Architect to join our team. The Solution Architect will be responsible for designing and implementing end-to-end data solutions, including Data Warehouse, ETL, Data Lake, and Cloud Migration projects. The ideal candidate will have extensive experience in data...