Lead Data Engineer

1 month ago

india EXL Full time

Location- Gurgaon/ Bangalore

Experience- 7Yrs-8 Yrs


Job Summary

Looking for a versatile professional to join our team in the role of Hybrid Data Engineer and Database Administrator. This position requires a blend of expertise in Data Engineering and Database Administration, with a strong foundation in Oracle DBA roles and a demonstrated transition into data engineering. The ideal candidate will possess hands-on experience with database systems such as Oracle, Postgres, Teradata, or Starburst (Trino) in an AWS environment, coupled with proficiency in utilizing Git, Jenkins, and Terraform. Additionally, broader AWS experience including S3, Lambda, VPC, and Security Groups would be highly advantageous.


Responsibilities:

  • possess hands-on experience in working on some of the relational and non-relational databases (Oracle/SQL Server/DB2/PostgreSQL/MySQL/Golden Gate/Data Guard) on AWS and/or on-prem infrastructure.
  • years’ Experience with AWS Services like AWS RDS, Aurora, EC2, S3, DMS, AWS Backups, and DynamoDB.
  • years’ Experience with the Design and deployment of Amazon Machine Images (AMI) for Database.
  • in database migrations from on-prem to AWS Cloud, replication technologies like Oracle Golden Gate/HVR
  • and maintain database systems to ensure optimal performance, reliability, and security.
  • develop, and deploy data pipelines and ETL processes for efficient data ingestion, transformation, and analysis.
  • with cross-functional teams to understand data requirements and develop scalable data solutions.
  • database performance metrics and proactively address any performance or scalability issues.
  • version control for database scripts and configurations using Git.
  • Jenkins for continuous integration and deployment of database changes.
  • infrastructure provisioning and configuration using Terraform to enhance deployment efficiency.
  • AWS services such as S3, Lambda, VPC, and Security Groups to support data infrastructure.
  • guidance on database security best practices, including access control and encryption.
  • updated on emerging technologies and industry trends in data engineering and database administration.


Required Qualifications:

  • Years industry implementation experience with Data Engineering tools.
  • experience of working within AWS and must be capable of working from infrastructure (VPC, EC2, Security groups, S3 etc.) to AWS data platforms (Redshift, RDS, Glue etc). In depth experience of Azure/GCP is also of interest.
  • with database migrations to AWS Cloud
  • deploy and support databases on Ec2, AWS RDS and VMware platform
  • Knowledge of infrastructure automation with Terraform.
  • of source control management and associated tools such as Git.
  • and maintain database systems to ensure optimal performance, reliability, and security.
  • develop, and deploy data pipelines and ETL processes for efficient data ingestion, transformation, and analysis.
  • with cross-functional teams to understand data requirements and develop scalable data solutions.
  • database performance metrics and proactively address any performance or scalability issues.
  • version control for database scripts and configurations using Git.
  • Jenkins for continuous integration and deployment of database changes.
  • infrastructure provisioning and configuration using Terraform to enhance deployment efficiency.
  • AWS services such as S3, Lambda, VPC, and Security Groups to support data infrastructure.
  • guidance on database security best practices, including access control and encryption.
  • updated on emerging technologies and industry trends in data engineering and database administration.
  • years of management experience required
  • years consulting experience preferred
  • degree or equivalent experience, master's degree Preferred
  • data warehousing, OLTP systems, data integration and SDLC
  • and experience with major Data Architecture philosophies (Dimensional, ODS, Data Vault, etc.)
  • of modern data warehouse capabilities and technologies such as real-time, cloud, Big Data.
  • of on premises and cloud infrastructure architectures (e.g. AWS, Azure, GCP)


Preferred Skills & Experience:

  • experience in Oracle DBA roles, with a solid understanding of database management principles.
  • in at least one of the following database systems: Oracle, Postgres, Teradata, or Starburst (Trino).
  • experience with Git, Jenkins, and Terraform for version control and automation.
  • with AWS cloud services, particularly in an environment involving S3, Lambda, VPC, and Security Groups.
  • analytical and problem-solving skills with a proactive approach to troubleshooting.
  • communication and collaboration abilities, with a track record of working effectively in cross-functional teams.
  • and working experience with Data Integration processes, such as Data Warehousing, EAI, etc.
  • to analyze business requirements as they relate to the data movement and transformation processes, research, evaluation and recommendation of alternative solutions.
  • to provide technical direction to other team members including contractors and employees.
  • to contribute to conceptual data modelling sessions to accurately define business processes, independently of data structures and then combine the two together.
  • ability to serve as a trusted advisor that builds influence with client management beyond simply EDM.
  • create documentation and presentations such that they “stand on their own”
  • on experience with AWS Products (e.g. AWS Lambda, AWS Glue, AWS EMR, AWS S3, AWS Sage maker, etc.)
  • building, operationalizing, securing, and monitoring data processing systems on AWS Cloud Platform
  • contribute to internal/external Data Integration proof of concepts.
  • ability to create new and innovative solutions to problems previously not encountered.
  • to work independently on projects as well as collaborate effectively across teams
  • team building, interpersonal, analytical, problem identification and resolution skills
  • working with multi-level business communities
  • effectively utilize SQL and/or available BI tool to validate/elaborate business rules.
  • influences and, at times, oversees business and data analysis activities to ensure sufficient understanding and quality of data.
  • effectively with all team members and builds strong working relationships/support with them.

Understands modern data warehouse concepts (real-time, cloud, Big Data) and how to enable such capabilities from a reporting and analytic standpoint.

  • Operations Specialist

    7 days ago

    India Data Engineer Academy Full time

    Job Title: Operations Analyst Location : RemoteCompany Overview:Data Engineering Academy is a pioneering force in data engineering education, founded by FAANG data engineers with extensive industry expertise. Our platform provides comprehensive programs tailored to empower aspiring data engineers, equipping them with the skills and confidence necessary to...

  • Operations Specialist

    7 days ago

    india Data Engineer Academy Full time

    Job Title: Operations Analyst Location : Remote Company Overview: Data Engineering Academy is a pioneering force in data engineering education, founded by FAANG data engineers with extensive industry expertise. Our platform provides comprehensive programs tailored to empower aspiring data engineers, equipping them with the skills and confidence necessary...

  • Operations Specialist

    6 days ago

    india Data Engineer Academy Full time

    Job Title: Operations Analyst Location : Remote Company Overview: Data Engineering Academy is a pioneering force in data engineering education, founded by FAANG data engineers with extensive industry expertise. Our platform provides comprehensive programs tailored to empower aspiring data engineers, equipping them with the skills and confidence necessary...

  • Lead Data Engineer

    5 days ago

    india Orion Innovation Full time

    As a Lead Data Engineer, you will play a crucial role in designing, developing, and maintaining our data infrastructure. You will lead a team of data engineers to ensure the successful delivery of projects and contribute to the overall data strategy. The ideal candidate will have extensive experience in cloud-based data technologies, particularly in Azure,...

  • Data Engineer

    2 months ago

    india dentsu Full time

    The purpose of this role is to maintain, improve, clean and manipulate data in the business’s operational and analytics databases. The Data Engineer works with the business’s software engineers, data analytics teams, data scientists and data warehouse engineers in order to understand and aid in the implementation of database requirements, analyse...

  • Lead data engineer

    17 hours ago

    india USEReady Full time

    Useready is hiring for Lead Data Engineer(Bangalore/Mohali/Gurugram) Job Description Mentor a team of developers in building and maintaining high-quality, scalable, and secure data pipelines and analytics applications on the Databricks platform Work closely with data engineers, business stakeholders to understand their needs and design and develop...

  • Lead Data Engineer

    17 hours ago

    india Digitas India Full time

    Role- Lead Data Engineer Experience - 6 +Years Locations- Mumbai/Pune/Ahmedabad Overview: As a Lead Data Engineer, you will play a pivotal role in designing, implementing, and managing complex data pipelines within Google Cloud Platform (GCP) & AWS . Your expertise in integrating SAP, Salesforce and other cloud databases and marketing platforms , will be...

  • Snowflake Data Engineer

    4 days ago

    india Lapis Data Analytics Full time

    Company Description Lapis Data Analytics is a dynamic and innovative data engineering company founded in 2020 and located in Chennai. Our primary focus is on designing, building, and maintaining robust data pipelines that convert raw data into actionable insights. With a team of seasoned experts and cutting-edge technology, we deliver customized data...

  • Azure Lead Data Engineer

    2 weeks ago

    india IntraEdge Full time

    As Azure Lead Data Engineer, you will have to take over the key activities of designing, coding, and implementing data solutions in the platform. With a focus on leveraging DBT for data transformation and modelling, as well as expertise in MDM tools, you will play a pivotal role in architecting scalable and performant data pipelines and warehouses. You will...

  • Data Engineering Lead

    1 week ago

    india Chryselys Full time

    Job Description: As a Data Engineering Lead, you will play a critical role in driving the delivery for our clients data projects. Leveraging your expertise in data engineering and data operations, you will work closely with clients to ensure that the project delivery on time with quality and meeting the requirements. This role requires a deep understanding...

  • Team Lead- Data Engineering

    3 days ago

    india Concentrix Full time

    Experience: 6 Years - 10 Years Job Location: Bengaluru (Hybrid- currently remote) Notice Period: Immediate/ 30 Days (Looking for someone to start from May or Mid June) Shift Timings: 02:00 PM to 11:00 PM (IST)/ 03:00 PM to 12:00 AM (IST) Job Description: We are seeking an experienced and talented Data Engineering Team Lead who can manage a...

  • Lead Data Engineer

    1 month ago

    india Recro Full time

    Position: Data Engineer(Lead) Location: WFO-Bangalore Experience Level: 8+ years Job Description: Summary: We're seeking a highly skilled and experienced Big Data Architect to join our innovative and dynamic team. You'll play a pivotal role in designing, building, and maintaining our scalable big data infrastructure. The ideal candidate will be a...

  • Lead Data Engineer

    2 months ago

    India Pro5.ai (formerly Mangtas) Full time

    Job Description : Technical delivery lead on platform and project builds for building and maintaining optimised and highly available data pipelines that facilitate data management and data analytics solutions. The role will drive the development of data processing frameworks and data architectural approaches that scale to handle the business’s growing...

  • Lead Data Engineer

    2 weeks ago

    india Coders Connect Full time

    Job Description Coders Connect and Sanofi are joining forces to bring an electrifying twist to the bio pharmaceutical world! Work with a rhythm that suits your style (2 days remote and 3 days onsite magic).Language: Proficiency in English is required for this role to ensure effective communication within our diverse, global team.About Sanofi: We're not...

  • Lead Azure Data Engineer

    17 hours ago

    india EXL Full time

    Position - Lead Data Engineer Work Location – Pune/ Hyderabad / Gurgaon / Hybrid Experience - 9+ Years Must have Skills: Minimum 5+ years on Azure cloud services. Proficiency in using Azure Synapse, Azure Storage, and Azure Data Factory for building data solutions. Strong understanding of metadata-driven approaches and data governance principles....

  • Lead Data Engineer

    1 week ago

    india Pro5.ai (formerly Mangtas) Full time

    Job Description :Technical delivery lead on platform and project builds for building and maintaining optimised and highly available data pipelines that facilitate data management and data analytics solutions. The role will drive the development of data processing frameworks and data architectural approaches that scale to handle the business's growing...

  • Data QA Lead Engineer

    1 week ago

    india Apolis Consulting Pvt Ltd Full time

    Apolis is actively looking to hire a Data QA Lead & Data QA Engineer role to join our team. This will be 4-6 months contractual role. Location: Remote Job description Data QA Testing (1-Lead and 5- Data QA Tester) PST 3 hours overlaps-Rest are flexible. 4-6 months- Contractors. Must have done Data Validation Must have Data QA experience. Working with...

  • Lead Data Engineer

    2 weeks ago

    india EXL Full time

    Must have: Experience: 5+ years 5/6+ years of experience in Data Engineering, Architecture & Solutioning areas in large-scale distributed systems 3+ years of experience across Cloud Platforms, AWS preferred. 2+ years of experience in creating solutions for clients/products Hands on coding experience in Oracle / Teradata / SQL Server platform. Hands on...

  • Lead GCP Data Engineer

    17 hours ago

    india EXL Full time

    As a Lead GCP Data Engineer, you will be responsible for data migration, transformation or modernization on Google Cloud Platform (GCP) integrating native GCP services and other 3rd party data solutions. You will collaborate with cloud partners and our cross-functional teams to enable sector-specific use cases. Your responsibilities will involve technology...

  • Lead Data Engineer

    3 weeks ago

    india Akivna Technologies Pvt. Ltd. Full time

    Company Description Akivna Technologies Pvt. Ltd. is an IT company based in Gurugram. We specialize in Data Engineering, Data Science, Data Analytics, DevOps, and Product Development. Our team is passionate about technology and we strive to deliver innovative and high-quality solutions to our clients. Job Description: We are seeking a skilled and...