Lead Data Engineer

1 month ago

Gurugram, India EXL Full time

Location- Gurgaon/ Bangalore

Experience- 7Yrs-8 Yrs


Job Summary

Looking for a versatile professional to join our team in the role of Hybrid Data Engineer and Database Administrator. This position requires a blend of expertise in Data Engineering and Database Administration, with a strong foundation in Oracle DBA roles and a demonstrated transition into data engineering. The ideal candidate will possess hands-on experience with database systems such as Oracle, Postgres, Teradata, or Starburst (Trino) in an AWS environment, coupled with proficiency in utilizing Git, Jenkins, and Terraform. Additionally, broader AWS experience including S3, Lambda, VPC, and Security Groups would be highly advantageous.


Responsibilities:

  • possess hands-on experience in working on some of the relational and non-relational databases (Oracle/SQL Server/DB2/PostgreSQL/MySQL/Golden Gate/Data Guard) on AWS and/or on-prem infrastructure.
  • years’ Experience with AWS Services like AWS RDS, Aurora, EC2, S3, DMS, AWS Backups, and DynamoDB.
  • years’ Experience with the Design and deployment of Amazon Machine Images (AMI) for Database.
  • in database migrations from on-prem to AWS Cloud, replication technologies like Oracle Golden Gate/HVR
  • and maintain database systems to ensure optimal performance, reliability, and security.
  • develop, and deploy data pipelines and ETL processes for efficient data ingestion, transformation, and analysis.
  • with cross-functional teams to understand data requirements and develop scalable data solutions.
  • database performance metrics and proactively address any performance or scalability issues.
  • version control for database scripts and configurations using Git.
  • Jenkins for continuous integration and deployment of database changes.
  • infrastructure provisioning and configuration using Terraform to enhance deployment efficiency.
  • AWS services such as S3, Lambda, VPC, and Security Groups to support data infrastructure.
  • guidance on database security best practices, including access control and encryption.
  • updated on emerging technologies and industry trends in data engineering and database administration.


Required Qualifications:

  • Years industry implementation experience with Data Engineering tools.
  • experience of working within AWS and must be capable of working from infrastructure (VPC, EC2, Security groups, S3 etc.) to AWS data platforms (Redshift, RDS, Glue etc). In depth experience of Azure/GCP is also of interest.
  • with database migrations to AWS Cloud
  • deploy and support databases on Ec2, AWS RDS and VMware platform
  • Knowledge of infrastructure automation with Terraform.
  • of source control management and associated tools such as Git.
  • and maintain database systems to ensure optimal performance, reliability, and security.
  • develop, and deploy data pipelines and ETL processes for efficient data ingestion, transformation, and analysis.
  • with cross-functional teams to understand data requirements and develop scalable data solutions.
  • database performance metrics and proactively address any performance or scalability issues.
  • version control for database scripts and configurations using Git.
  • Jenkins for continuous integration and deployment of database changes.
  • infrastructure provisioning and configuration using Terraform to enhance deployment efficiency.
  • AWS services such as S3, Lambda, VPC, and Security Groups to support data infrastructure.
  • guidance on database security best practices, including access control and encryption.
  • updated on emerging technologies and industry trends in data engineering and database administration.
  • years of management experience required
  • years consulting experience preferred
  • degree or equivalent experience, master's degree Preferred
  • data warehousing, OLTP systems, data integration and SDLC
  • and experience with major Data Architecture philosophies (Dimensional, ODS, Data Vault, etc.)
  • of modern data warehouse capabilities and technologies such as real-time, cloud, Big Data.
  • of on premises and cloud infrastructure architectures (e.g. AWS, Azure, GCP)


Preferred Skills & Experience:

  • experience in Oracle DBA roles, with a solid understanding of database management principles.
  • in at least one of the following database systems: Oracle, Postgres, Teradata, or Starburst (Trino).
  • experience with Git, Jenkins, and Terraform for version control and automation.
  • with AWS cloud services, particularly in an environment involving S3, Lambda, VPC, and Security Groups.
  • analytical and problem-solving skills with a proactive approach to troubleshooting.
  • communication and collaboration abilities, with a track record of working effectively in cross-functional teams.
  • and working experience with Data Integration processes, such as Data Warehousing, EAI, etc.
  • to analyze business requirements as they relate to the data movement and transformation processes, research, evaluation and recommendation of alternative solutions.
  • to provide technical direction to other team members including contractors and employees.
  • to contribute to conceptual data modelling sessions to accurately define business processes, independently of data structures and then combine the two together.
  • ability to serve as a trusted advisor that builds influence with client management beyond simply EDM.
  • create documentation and presentations such that they “stand on their own”
  • on experience with AWS Products (e.g. AWS Lambda, AWS Glue, AWS EMR, AWS S3, AWS Sage maker, etc.)
  • building, operationalizing, securing, and monitoring data processing systems on AWS Cloud Platform
  • contribute to internal/external Data Integration proof of concepts.
  • ability to create new and innovative solutions to problems previously not encountered.
  • to work independently on projects as well as collaborate effectively across teams
  • team building, interpersonal, analytical, problem identification and resolution skills
  • working with multi-level business communities
  • effectively utilize SQL and/or available BI tool to validate/elaborate business rules.
  • influences and, at times, oversees business and data analysis activities to ensure sufficient understanding and quality of data.
  • effectively with all team members and builds strong working relationships/support with them.

Understands modern data warehouse concepts (real-time, cloud, Big Data) and how to enable such capabilities from a reporting and analytic standpoint.

  • Lead Data Engineer

    2 months ago

    gurugram, India Epam Full time

    Description EPAM is a leading global provider of digital platform engineering and development services. We are committed to having a positive impact on our customers, our employees, and our communities. We embrace a dynamic and inclusive culture. Here you will collaborate with multi-national teams, contribute to a myriad of innovative projects...

  • Lead Data Engineer

    2 months ago

    Gurugram, India MakeMyTrip Full time

    Position: Lead Data Engineer / Principal Data EngineerExperience: Must have 6+ years of experienceAbout Role:We are looking for experienced Data engineers with excellent problem-solving skills to develop machine-learning powered Data Products design to enhance customer experiences.About us:Nurtured from the seed of a single great idea - to empower the...

  • Lead Data Engineer

    2 months ago

    Gurugram, India MakeMyTrip Full time

    Position: Lead Data Engineer / Principal Data Engineer Experience: Must have 6+ years of experience About Role: We are looking for experienced Data engineers with excellent problem-solving skills to develop machine-learning powered Data Products design to enhance customer experiences. About us: Nurtured from the seed of a single great idea - to empower...

  • Lead Data Engineer

    2 months ago

    Gurugram, India MakeMyTrip Full time

    Position: Lead Data Engineer / Principal Data EngineerExperience: Must have 6+ years of experienceAbout Role:We are looking for experienced Data engineers with excellent problem-solving skills to develop machine-learning powered Data Products design to enhance customer experiences.About us:Nurtured from the seed of a single great idea - to empower the...

  • Lead Data Engineer

    3 days ago

    gurugram, India HuQuo Consulting Pvt. Ltd. Full time

    Job Description for this position include :- Provides technical leadership in Big Data space (Hadoop Stack like M/R, HDFS, Pig, Hive, HBase, Flume, Sqoop, .NoSQL stores like Cassandra, HBase etc) across Fractal and contributes to open source Big Data technologies- Write and tune complex Java, MapReduce, Pig and Hive jobs- Adapt quickly to change in...

  • Lead Data Engineer

    4 days ago

    Gurugram, India HuQuo Consulting Pvt. Ltd. Full time

    Job Description for this position include :- Provides technical leadership in Big Data space (Hadoop Stack like M/R, HDFS, Pig, Hive, HBase, Flume, Sqoop, .NoSQL stores like Cassandra, HBase etc) across Fractal and contributes to open source Big Data technologies- Write and tune complex Java, MapReduce, Pig and Hive jobs- Adapt quickly to change in...

  • Eucloid - Data Engineer - Azure Databricks

    4 days ago

    Gurugram, India Eucloid Data Solutions Pvt Ltd Full time

    Job Description - Data Engineer (Databricks)About Eucloid : Eucloid Data Solutions is a fast-growing AI-consulting firm that enables business growth for its clients through advanced Data Analytics, Machine Learning and Data engineering. Eucloid offers bespoke, full stackand datadriven approach to solve highly complex and large-scale business problems for...

  • Eucloid - Senior Data Engineer - Azure Databricks

    4 days ago

    gurugram, India Eucloid Data Solutions Pvt Ltd Full time

    Job Role : Sr. Data Engineer (Databricks) About Eucloid :Eucloid Data Solutions is a fast-growing AI-consulting firm that enables business growth for its clients through advanced Data Analytics, Machine Learning and Data engineering. Eucloid offers bespoke, full stackand datadriven approach to solve highly complex and large-scale business problems for some...

  • Lead Data Engineer

    4 weeks ago

    gurugram, India United Airlines Full time

    Description United's Digital Technology team designs, develops, and maintains massively scaling technology solutions brought to life with innovative architectures, data analytics, and digital solutions. Our Values : At United Airlines, we believe that inclusion propels innovation and is the foundation of all that we do. Our Shared Purpose:...

  • Lead- Data Engineering

    2 weeks ago

    Gurugram, India FNP Full time

    Job Title: Lead- Data Engineering Department: CETLocation: Corporate Office, GurgaonExp Range: 8 to 10 YearsEducational Qualification: Bachelor’s degree in computer science/information technologyKey Skills: Pantaho, Python, MySQL, MongoDB, BigQuery, Apache Kafka, Airflow, Metabase, Datastream, Dataflow, S3 and DMSRole Overview:This position is for the...

  • Lead- Data Engineering

    2 weeks ago

    gurugram, India FNP Full time

    Job Title: Lead- Data Engineering Department: CET Location: Corporate Office, Gurgaon Exp Range: 8 to 10 Years Educational Qualification: Bachelor’s degree in computer science/information technology Key Skills: Pantaho, Python, MySQL, MongoDB, BigQuery, Apache Kafka, Airflow, Metabase, Datastream, Dataflow, S3 and DMS Role Overview: This position...

  • Lead- Data Engineering

    2 weeks ago

    Gurugram, India FNP Full time

    Job Title: Lead- Data Engineering Department: CETLocation: Corporate Office, GurgaonExp Range: 8 to 10 YearsEducational Qualification: Bachelor’s degree in computer science/information technologyKey Skills: Pantaho, Python, MySQL, MongoDB, BigQuery, Apache Kafka, Airflow, Metabase, Datastream, Dataflow, S3 and DMSRole Overview:This position is for the...

  • Lead - Data Engineer

    4 days ago

    Gurugram, India Yum! Digital & Tech India Full time

    Mandatory Experince (4-6) years only& Strong experience in SQL, ETL, Informatica IICS , Informatics Power Center.As a Lead Data Engineer, you will require a wide range of strengths and capabilities including:Partner with KFC, Pizza Hut, & Taco Bell to identify opportunities to leverage company data to drive business outcomes.Play a key role in our advanced...

  • Lead - Data Engineer

    4 days ago

    gurugram, India Yum! Digital & Tech India Full time

    Mandatory Experince (4-6) years only & Strong experience in SQL, ETL, Informatica IICS , Informatics Power Center. As a Lead Data Enginee r, you will require a wide range of strengths and capabilities including :Partner with KFC, Pizza Hut, & Taco Bell to identify opportunities to leverage company data to drive business outcome s.Play a key role in our...

  • Lead - Data Engineer

    4 days ago

    Gurugram, India Yum! Digital & Tech India Full time

    Mandatory Experince (4-6) years only& Strong experience in SQL, ETL, Informatica IICS , Informatics Power Center.As a Lead Data Engineer, you will require a wide range of strengths and capabilities including:Partner with KFC, Pizza Hut, & Taco Bell to identify opportunities to leverage company data to drive business outcomes.Play a key role in our advanced...

  • Lead Data Engineer

    4 days ago

    Gurgaon/Gurugram, India HuQuo Consulting Pvt. Ltd. Full time

    Job Description for this position include :- Provides technical leadership in Big Data space (Hadoop Stack like M/R, HDFS, Pig, Hive, HBase, Flume, Sqoop, .NoSQL stores like Cassandra, HBase etc) across Fractal and contributes to open source Big Data technologies- Write and tune complex Java, MapReduce, Pig and Hive jobs- Adapt quickly to change in...

  • Lead Data Engineer

    1 month ago

    Gurugram, India EXL Full time

    Location- Gurgaon/ BangaloreExperience- 7Yrs-8 YrsJob SummaryLooking for a versatile professional to join our team in the role of Hybrid Data Engineer and Database Administrator. This position requires a blend of expertise in Data Engineering and Database Administration, with a strong foundation in Oracle DBA roles and a demonstrated transition into data...

  • Lead Big Data Software Engineer

    2 months ago

    gurugram, India Epam Full time

    Description EPAM is a leading global provider of digital platform engineering and development services. We are committed to having a positive impact on our customers, our employees, and our communities. We embrace a dynamic and inclusive culture. Here you will collaborate with multi-national teams, contribute to a myriad of innovative projects...

  • Lead Data Engineer

    4 days ago

    Gurugram, India HuQuo Consulting Pvt. Ltd. Full time

    Job brief :We are looking for a Lead Data Engineer to join our Data Engineering Team. In this senior role, you will be responsible for managing our Enterprise Data Warehouse and ensuring the efficient flow and quality of data.Your tasks will include implementing data processes, managing data architecture, designing ETL processes, and analyzing data for...

  • Lead Data Engineer

    4 weeks ago

    gurugram, India United Airlines Full time

    Description United's Digital Technology team designs, develops, and maintains massively scaling technology solutions brought to life with innovative architectures, data analytics, and digital solutions. Our Values : At United Airlines, we believe that inclusion propels innovation and is the foundation of all that we do. Our Shared Purpose:...