Lead Data Engineer

3 weeks ago

delhi, India EXL Full time
Location- Gurgaon/ Bangalore
Experience- 7Yrs-8 Yrs
Job Summary
Looking for a versatile professional to join our team in the role of Hybrid Data Engineer and Database Administrator. This position requires a blend of expertise in Data Engineering and Database Administration, with a strong foundation in Oracle DBA roles and a demonstrated transition into data engineering. The ideal candidate will possess hands-on experience with database systems such as Oracle, Postgres, Teradata, or Starburst (Trino) in an AWS environment, coupled with proficiency in utilizing Git, Jenkins, and Terraform. Additionally, broader AWS experience including S3, Lambda, VPC, and Security Groups would be highly advantageous.
Responsibilities:
possess hands-on experience in working on some of the relational and non-relational databases (Oracle/SQL Server/DB2/PostgreSQL/MySQL/Golden Gate/Data Guard) on AWS and/or on-prem infrastructure.
years’ Experience with AWS Services like AWS RDS, Aurora, EC2, S3, DMS, AWS Backups, and DynamoDB.
years’ Experience with the Design and deployment of Amazon Machine Images (AMI) for Database.
in database migrations from on-prem to AWS Cloud, replication technologies like Oracle Golden Gate/HVR
and maintain database systems to ensure optimal performance, reliability, and security.
develop, and deploy data pipelines and ETL processes for efficient data ingestion, transformation, and analysis.
with cross-functional teams to understand data requirements and develop scalable data solutions.
database performance metrics and proactively address any performance or scalability issues.
version control for database scripts and configurations using Git.
Jenkins for continuous integration and deployment of database changes.
infrastructure provisioning and configuration using Terraform to enhance deployment efficiency.
AWS services such as S3, Lambda, VPC, and Security Groups to support data infrastructure.
guidance on database security best practices, including access control and encryption.
updated on emerging technologies and industry trends in data engineering and database administration.
Required Qualifications:
Years industry implementation experience with Data Engineering tools.
experience of working within AWS and must be capable of working from infrastructure (VPC, EC2, Security groups, S3 etc.) to AWS data platforms (Redshift, RDS, Glue etc). In depth experience of Azure/GCP is also of interest.
with database migrations to AWS Cloud
deploy and support databases on Ec2, AWS RDS and VMware platform
Knowledge of infrastructure automation with Terraform.
of source control management and associated tools such as Git.
and maintain database systems to ensure optimal performance, reliability, and security.
develop, and deploy data pipelines and ETL processes for efficient data ingestion, transformation, and analysis.
with cross-functional teams to understand data requirements and develop scalable data solutions.
database performance metrics and proactively address any performance or scalability issues.
version control for database scripts and configurations using Git.
Jenkins for continuous integration and deployment of database changes.
infrastructure provisioning and configuration using Terraform to enhance deployment efficiency.
AWS services such as S3, Lambda, VPC, and Security Groups to support data infrastructure.
guidance on database security best practices, including access control and encryption.
updated on emerging technologies and industry trends in data engineering and database administration.
years of management experience required
years consulting experience preferred
degree or equivalent experience, master's degree Preferred
data warehousing, OLTP systems, data integration and SDLC
and experience with major Data Architecture philosophies (Dimensional, ODS, Data Vault, etc.)
of modern data warehouse capabilities and technologies such as real-time, cloud, Big Data.
of on premises and cloud infrastructure architectures (e.g. AWS, Azure, GCP)
Preferred Skills & Experience:
experience in Oracle DBA roles, with a solid understanding of database management principles.
in at least one of the following database systems: Oracle, Postgres, Teradata, or Starburst (Trino).
experience with Git, Jenkins, and Terraform for version control and automation.
with AWS cloud services, particularly in an environment involving S3, Lambda, VPC, and Security Groups.
analytical and problem-solving skills with a proactive approach to troubleshooting.
communication and collaboration abilities, with a track record of working effectively in cross-functional teams.
and working experience with Data Integration processes, such as Data Warehousing, EAI, etc.
to analyze business requirements as they relate to the data movement and transformation processes, research, evaluation and recommendation of alternative solutions.
to provide technical direction to other team members including contractors and employees.
to contribute to conceptual data modelling sessions to accurately define business processes, independently of data structures and then combine the two together.
ability to serve as a trusted advisor that builds influence with client management beyond simply EDM.
create documentation and presentations such that they “stand on their own”
on experience with AWS Products (e.g. AWS Lambda, AWS Glue, AWS EMR, AWS S3, AWS Sage maker, etc.)
building, operationalizing, securing, and monitoring data processing systems on AWS Cloud Platform
contribute to internal/external Data Integration proof of concepts.
ability to create new and innovative solutions to problems previously not encountered.
to work independently on projects as well as collaborate effectively across teams
team building, interpersonal, analytical, problem identification and resolution skills
working with multi-level business communities
effectively utilize SQL and/or available BI tool to validate/elaborate business rules.
influences and, at times, oversees business and data analysis activities to ensure sufficient understanding and quality of data.
effectively with all team members and builds strong working relationships/support with them.
Understands modern data warehouse concepts (real-time, cloud, Big Data) and how to enable such capabilities from a reporting and analytic standpoint.

  • Data Engineer Lead

    4 weeks ago

    Delhi, India Booth and Partners Pte Ltd Full time

    Job DescriptionThis is a remote position.About the Client:They understand your pain. In fact, they've been there. It’s the very reason they built the industry’s first automated data analytics and reporting platform for pharmacy benefit organizations.After spending more than 30 years building manual reports for Payers, PBMs, TPAs, Consultants, and...

  • Data Engineer

    4 weeks ago

    Delhi, India dentsu Full time

    The purpose of this role is to maintain, improve, clean and manipulate data in the business’s operational and analytics databases. The Data Engineer works with the business’s software engineers, data analytics teams, data scientists and data warehouse engineers in order to understand and aid in the implementation of database requirements, analyse...

  • Azure Lead Data Engineer

    1 hour ago

    Delhi, India IntraEdge Full time

    As Azure Lead Data Engineer, you will have to take over the key activities of designing, coding, and implementing data solutions in the platform. With a focus on leveraging DBT for data transformation and modelling, as well as expertise in MDM tools, you will play a pivotal role in architecting scalable and performant data pipelines and warehouses. You will...

  • Lead Data Engineer

    4 weeks ago

    delhi, India Solera, Inc. Full time

    About the jobWho We AreSolera, DealerSocket is a global leader in data and software services that strives to transform every touchpoint of the vehicle lifecycle into a connected digital experience. In addition, we provide products and services to protect life’s other most important assets: our homes and digital identities. Today, Solera processes over...

  • Lead Data Engineer

    4 weeks ago

    Delhi, India Solera, Inc. Full time

    About the jobWho We AreSolera, DealerSocketis a global leader in data and software services that strives to transform every touchpoint of the vehicle lifecycle into a connected digital experience. In addition, we provide products and services to protect life’s other most important assets: our homes and digital identities. Today, Solera processes over 300...

  • Azure Lead Data Engineer

    1 hour ago

    Delhi, India IntraEdge Full time

    As Azure Lead Data Engineer, you will have to take over the key activities of designing, coding, and implementing data solutions in the platform. With a focus on leveraging DBT for data transformation and modelling, as well as expertise in MDM tools, you will play a pivotal role in architecting scalable and performant data pipelines and warehouses. You will...

  • Lead Data Engineer

    3 weeks ago

    delhi, India Recro Full time

    Position: Data Engineer(Lead)Location: WFO-BangaloreExperience Level: 8+ yearsJob Description:Summary:We're seeking a highly skilled and experienced Big Data Architect to join our innovative and dynamic team. You'll play a pivotal role in designing, building, and maintaining our scalable big data infrastructure. The ideal candidate will be a passionate...

  • Lead Data Engineer

    1 month ago

    Delhi, India Pro5.ai (formerly Mangtas) Full time

    Job Description :Technical delivery lead on platform and project builds for building and maintaining optimised and highly available data pipelines that facilitate data management and data analytics solutions.The role will drive the development of data processing frameworks and data architectural approaches that scale to handle the business’s growing...

  • Lead Data Engineer

    4 days ago

    delhi, India Akivna Technologies Pvt. Ltd. Full time

    Company DescriptionAkivna Technologies Pvt. Ltd. is an IT company based in Gurugram. We specialize in Data Engineering, Data Science, Data Analytics, DevOps, and Product Development. Our team is passionate about technology and we strive to deliver innovative and high-quality solutions to our clients.Job Description:We are seeking a skilled and experienced...

  • Lead Data Engineer

    2 hours ago

    delhi, India EXL Full time

    Must have:Experience: 5+ years5/6+ years of experience in Data Engineering, Architecture & Solutioning areas in large-scale distributed systems3+ years of experience across Cloud Platforms, AWS preferred.2+ years of experience in creating solutions for clients/productsHands on coding experience in Oracle / Teradata / SQL Server platform.Hands on coding...

  • Tech Lead Data Engineering

    4 weeks ago

    delhi, India [24]7.ai Full time

    Job Role: Tech Lead – Data EngineeringJob Location: BangaloreWorking: HybridSummary of Essential Job FunctionsDesign, develop, and maintain scalable and efficient data pipelines using Python, Pandas, Spark, and Google Dataflow.Strong background in relational databases such as SQL Server and MySQL along with a deep understanding of the Google Cloud...

  • Data Engineer

    3 weeks ago

    delhi, India Joveo Full time

    We are looking for talented Data Engineers who are passionate about data engineering and have strong experience in building scalable data pipelines. As a Data Engineer at Joveo, you will play a leading role in designing and building datasets that power analytics for teams across Joveo. You will also be working closely with Data Analysts, Data Scientists, and...

  • Data Lead Engineer

    1 month ago

    delhi, India Squareroot Consulting Pvt Ltd Full time

    Job Description : We are seeking a highly skilled and motivated Data Lead with expertise in Spark, Scala, Kafka, Big Data, and Batch Processing. As a Data Lead, you will play a key role in leading and managing the end-to-end data processing pipeline, ensuring the reliability, scalability, and efficiency of our data systems.Experience : 6+ YearsLocation :...

  • Lead Data Analyst

    1 month ago

    Delhi, India CES Full time

    Job Role:We are looking for a Lead Data Engineer to join our team.Ideal Candidate:Overall 7+ years of experience.5+ years of experience in Data Engineering / Modelling and SQL.2+ years of experience in in Azure.Design, develop, and maintain data pipelines for ingestion, transformation, and loading of data into Azure Synapse Analytics.Transform and clean the...

  • ▷ (High Salary) Lead Data Engineer

    17 hours ago

    Delhi, India Pro5.ai (formerly Mangtas) Full time

    Job Description:- Technical delivery lead on platform and project builds for building and maintaining optimised and highly available data pipelines that facilitate data management and data analytics solutions.- The role will drive the development of data processing frameworks and data architectural approaches that scale to handle the business’s growing...

  • Lead Data Engineer

    1 hour ago

    Delhi, India EXL Full time

    Must have:Experience: 5+ years5/6+ yearsof experience in Data Engineering, Architecture & Solutioning areas in large-scale distributed systems3+ yearsof experience across Cloud Platforms, AWS preferred.2+ yearsof experience in creating solutions for clients/productsHands on coding experience inOracle / Teradata / SQL Serverplatform.Hands on coding experience...

  • Data Engineer

    4 weeks ago

    Delhi, India ValueLabs Full time

    Role:Data Engineer with AWSExperience:5-9 yearsNotice Period:Immediate - 10 daysLocation:HyderabadWe are seeking a highly skilled Data Engineer to join our dynamic team.Job DescriptionKey Responsibilities:Develop and maintain data models, data flow diagrams, and other documentation to support the organization's data architecture.Collaborate with...

  • Data Engineer

    3 weeks ago

    Delhi, India Cayian India Pvt Limited Full time

    Job DescriptionCayian is a global IT and business service provider that delivers consultancy, capability, and system integration services to our partners. Our unique partner model is optimised to accelerate delivery, continuously improve quality, and drive business growth. Find out more about ushere.The roleAs aData Engineer, you will be a part of our Data...

  • Data Engineer

    2 hours ago

    delhi, India Integrate Full time

    Role: Data Engineer L2Experience: 4-6 yrsSkills required: Snowflake, spark, SQL, pythonWork Location: Global Infocity, ChennaiModel: HybridAbout us :Integrate is the leader in Demand Management, an emerging category to help B2B marketers develop and deliver an omnichannel demand strategy, convert leads to revenue and drive marketing ROI. Over the past...

  • Data Engineer

    3 days ago

    delhi, India EliteRecruitments Full time

    We are hiring data engineers in Pune/Bangalore with global consulting. They are looking for data engineers with 5+ years of relevant experience.Technical and professional skills:We are looking for a flexible, fast learning, technically strong Data Engineer. Expertise is required in the following fields:Proficient in Cloud Services –AzureBuild ETL and data...