Lead Data Engineer/Manager

3 weeks ago

GurgaonGurugramBangalore, India HuQuo Consulting Pvt. Ltd. Full time
Job Title:

Lead Data Engineer/Manager

Job Summary:

HuQuo Consulting Pvt. Ltd. is seeking a highly skilled and experienced Lead Data Engineer/Manager to join our team. The ideal candidate will possess a strong foundation in data engineering and database administration, with a proven track record of designing, deploying, and supporting databases on AWS and on-prem infrastructure.

Key Responsibilities:
  • Design and deploy data pipelines and ETL processes for efficient data ingestion, transformation, and analysis.
  • Collaborate with cross-functional teams to understand data requirements and develop scalable data solutions.
  • Monitor database performance metrics and proactively address any performance or scalability issues.
  • Implement version control for database scripts and configurations using Git.
  • Utilize Jenkins for continuous integration and deployment of database changes.
  • Automate infrastructure provisioning and configuration using Terraform to enhance deployment efficiency.
  • Leverage AWS services such as S3, Lambda, VPC, and Security Groups to support data infrastructure.
  • Provide guidance on database security best practices, including access control and encryption.
  • Stay updated on emerging technologies and industry trends in data engineering and database administration.
Required Qualifications:
  • 8 years of industry implementation experience with data engineering tools.
  • Broad experience of working within AWS and must be capable of working from infrastructure (VPC, EC2, Security groups, S3 etc.) to AWS data platforms (Redshift, RDS, Glue etc). In-depth experience of Azure/GCP is also of interest.
  • Experience with database migrations to AWS Cloud.
  • Design, deploy and support databases on EC2, AWS RDS and VMware platform.
  • Working knowledge of infrastructure automation with Terraform.
  • Understanding of source control management and associated tools such as Git.
  • Manage and maintain database systems to ensure optimal performance, reliability, and security.
  • Design, develop, and deploy data pipelines and ETL processes for efficient data ingestion, transformation, and analysis.
  • Collaborate with cross-functional teams to understand data requirements and develop scalable data solutions.
  • Monitor database performance metrics and proactively address any performance or scalability issues.
  • Implement version control for database scripts and configurations using Git.
  • Utilize Jenkins for continuous integration and deployment of database changes.
  • Automate infrastructure provisioning and configuration using Terraform to enhance deployment efficiency.
  • Leverage AWS services such as S3, Lambda, VPC, and Security Groups to support data infrastructure.
  • Provide guidance on database security best practices, including access control and encryption.
  • Stay updated on emerging technologies and industry trends in data engineering and database administration.
  • 35 years of management experience required.
  • 35 years consulting experience preferred.
  • Bachelor's degree or equivalent experience, master's degree Preferred.
  • Strong data warehousing, OLTP systems, data integration and SDLC.
  • Understanding and experience with major Data Architecture philosophies (Dimensional, ODS, Data Vault, etc.).
  • Understanding of modern data warehouse capabilities and technologies such as real-time, cloud, Big Data.
  • Understanding of on-premises and cloud infrastructure architectures (e.g. AWS, Azure, GCP).
Preferred Skills & Experience:
  • Proven experience in Oracle DBA roles, with a solid understanding of database management principles.
  • Proficiency in at least one of the following database systems: Oracle, Postgres, Teradata, or Starburst (Trino).
  • Hands-on experience with Git, Jenkins, and Terraform for version control and automation.
  • Familiarity with AWS cloud services, particularly in an environment involving S3, Lambda, VPC, and Security Groups.
  • Strong analytical and problem-solving skills with a proactive approach to troubleshooting.
  • Excellent communication and collaboration abilities, with a track record of working effectively in cross-functional teams.
  • Knowledge and working experience with Data Integration processes, such as Data Warehousing, EAI, etc.
  • Ability to analyze business requirements as they relate to the data movement and transformation processes, research, evaluation, and recommendation of alternative solutions.
  • Ability to provide technical direction to other team members including contractors and employees.
  • Ability to contribute to conceptual data modeling sessions to accurately define business processes, independently of data structures and then combine the two together.
  • Demonstrated ability to serve as a trusted advisor that builds influence with client management beyond simply EDM.
  • Can create documentation and presentations such that they 'stand on their own'.
  • Hands-on experience with AWS Products (e.g. AWS Lambda, AWS Glue, AWS EMR, AWS S3, AWS Sage maker, etc.).
  • Designing, building, operationalizing, securing, and monitoring data processing systems on AWS Cloud Platform.
  • Can contribute to internal/external Data Integration proof of concepts.
  • Shows ability to create new and innovative solutions to problems previously not encountered.
  • Ability to work independently on projects as well as collaborate effectively across teams.
  • Strong team building, interpersonal, analytical, problem identification, and resolution skills.
  • Experience working with multilevel business communities.
  • Can effectively utilize SQL and/or available BI tool to validate/elaborate business rules.
  • Effectively influences and, at times, oversees business and data analysis activities to ensure sufficient understanding and quality of data.
  • Deals effectively with all team members and builds strong working relationships/support with them.
  • Understands modern data warehouse concepts (real-time, cloud, Big Data) and how to enable such capabilities from a reporting and analytic standpoint.

  • Data engineer

    3 weeks ago

    Bangalore, India Data Labs - LANDMARK GROUP Full time

    Job Title: Lead Data Engineer Location: Yemalur, Bangalore Your Key Responsibilities: Lead our engineering team successfully build and deploy cutting edge analytics products for consumption by different stakeholders. Lead the architecture, design, and delivery of enterprise grade microservices. Deliver assigned projects within budgeted time, cost...

  • Data Engineer

    3 weeks ago

    Bangalore, India Data Labs - LANDMARK GROUP Full time

    Job Title: Lead Data Engineer Location: Yemalur, Bangalore Your Key Responsibilities: Lead our engineering team successfully build and deploy cutting edge analytics products for consumption by different stakeholders. Lead the architecture, design, and delivery of enterprise grade microservices. Deliver assigned projects within budgeted time, cost and...

  • Data Engineer

    4 days ago

    bangalore, India Data Labs - LANDMARK GROUP Full time

    Job Title: Lead Data EngineerLocation: Yemalur, BangaloreYour Key Responsibilities:Lead our engineering team successfully build and deploy cutting edge analytics products for consumption by different stakeholders.Lead the architecture, design, and delivery of enterprise grade microservices.Deliver assigned projects within budgeted time, cost and agreed...

  • Data Engineer

    3 weeks ago

    bangalore, India Data Labs - LANDMARK GROUP Full time

    Job Title: Lead Data Engineer Location: Yemalur, Bangalore Your Key Responsibilities: Lead our engineering team successfully build and deploy cutting edge analytics products for consumption by different stakeholders.Lead the architecture, design, and delivery of enterprise grade microservices. Deliver assigned projects within budgeted time, cost and agreed...

  • Data Engineer

    1 month ago

    bangalore, India Data Labs - LANDMARK GROUP Full time

    Job Title: Lead Data Engineer Location: Yemalur, Bangalore Your Key Responsibilities: Lead our engineering team successfully build and deploy cutting edge analytics products for consumption by different stakeholders. Lead the architecture, design, and delivery of enterprise grade microservices. Deliver assigned projects within budgeted time, cost and...

  • Data Engineer

    1 month ago

    bangalore, India Data Labs - LANDMARK GROUP Full time

    Job Title: Lead Data Engineer Location: Yemalur, Bangalore Your Key Responsibilities: Lead our engineering team successfully build and deploy cutting edge analytics products for consumption by different stakeholders.Lead the architecture, design, and delivery of enterprise grade microservices. Deliver assigned projects within budgeted time, cost and agreed...

  • Data engineer

    5 days ago

    Bangalore City, India Data Labs - LANDMARK GROUP Full time

    Job Title: Lead Data Engineer Location: Yemalur, Bangalore Your Key Responsibilities: Lead our engineering team successfully build and deploy cutting edge analytics products for consumption by different stakeholders. Lead the architecture, design, and delivery of enterprise grade microservices. Deliver assigned projects within budgeted time, cost and agreed...

  • Lead Data Operations Manager

    3 weeks ago

    Gurgaon/Gurugram/Bangalore, India HuQuo Full time

    Job Title: Lead Assistant Manager/Manager/Senior ManagerAt HuQuo, we are seeking a highly skilled and experienced professional to join our team as a Lead Assistant Manager/Manager/Senior Manager. This role will be responsible for leading the development and deployment of machine learning models in a production environment.Responsibilities:Design, implement,...

  • Data Engineering Manager

    2 weeks ago

    Gurgaon/Gurugram/Bangalore, India HuQuo Consulting Pvt. Ltd. Full time

    About the RoleAt HuQuo Consulting Pvt. Ltd., we are seeking a highly skilled Data Engineering Manager to lead our data engineering efforts. As a key member of our team, you will be responsible for designing and implementing data pipelines, ensuring data accuracy and quality, and collaborating with cross-functional teams to drive business growth.Key...

  • Data Engineer/Manager

    3 weeks ago

    Gurgaon/Gurugram/Bangalore, India HuQuo Consulting Pvt. Ltd. Full time

    Job Title: Principal Data Engineer/ManagerAt HuQuo Consulting Pvt. Ltd., we are seeking a highly skilled Principal Data Engineer/Manager to join our team. As a key member of our data engineering team, you will be responsible for designing, developing, and implementing large-scale data processing systems and architectures.Key Responsibilities:Design and...

  • Data Engineering Manager

    3 weeks ago

    Gurgaon/Gurugram/Bangalore, India HuQuo Consulting Pvt. Ltd. Full time

    Job Title: Principal Data Engineer/ManagerAbout the Role:We are seeking a highly skilled Principal Data Engineer/Manager to join our team at HuQuo Consulting Pvt. Ltd. The ideal candidate will have a strong background in data engineering, cloud technologies, and leadership skills.Key Responsibilities:Design and implement scalable data pipelines using AWS...

  • Lead Data Engineer/Manager

    5 months ago

    Gurgaon/Gurugram/Bangalore, India HuQuo Consulting Pvt. Ltd. Full time

    Job Title: Lead Data EngineerJob SummaryLooking for a versatile professional to join our team in the role of Hybrid Data Engineer and Database Administrator. This position requires a blend of expertise in Data Engineering and Database Administration, with a strong foundation in Oracle DBA roles and a demonstrated transition into data engineering. The ideal...

  • Data Engineering Lead

    3 weeks ago

    Bangalore/Mohali/Gurgaon/Gurugram, India USEReady Technology Pvt. Ltd. Full time

    Lead Data EngineerAt UserReady Technology Pvt. Ltd., we are seeking an experienced Lead Data Engineer to join our team. As a key member of our data engineering team, you will be responsible for designing, developing, and maintaining high-quality, scalable, and secure data pipelines and analytics applications on the Databricks platform.Key...

  • Data Engineer Lead

    3 weeks ago

    Gurgaon/Gurugram/Bangalore, India HuQuo Consulting Pvt. Ltd. Full time

    Job Title: Principal Data EngineerAt HuQuo Consulting Pvt. Ltd., we are seeking a highly skilled Principal Data Engineer to join our team. As a key member of our data engineering team, you will be responsible for designing, developing, and maintaining large-scale data processing systems.Key Responsibilities:Design and implement data pipelines using AWS...

  • Data Engineering Lead

    6 days ago

    Gurgaon, Haryana, India Publicis Sapient Full time

    Data Engineering LeadWe are seeking a highly skilled Data Engineering Lead to join our team at Publicis Sapient. In this role, you will be responsible for defining and executing data strategy for clients.Data Integration, Governance & WranglingData Storage and Computation Frameworks, Performance OptimizationsAnalytics & VisualizationsInfrastructure & Cloud...

  • Data Engineering Team Lead

    2 weeks ago

    Gurgaon/Gurugram/Chennai/Bangalore, India Decision Point Full time

    Key Responsibilities:- Lead and manage the delivery of projects and be responsible for the delivery of project and team goals.- Design, develop, and maintain data ingestion and processing pipelines, leveraging latest data frameworks and technologies.- Collaborate with data scientists to build and maintain machine learning infrastructure and frameworks to...

  • Lead Data Engineer

    6 days ago

    Gurgaon, Haryana, India Elite recruitments Full time

    Job Role: Assistant Vice PresidentAbout the Role:We are seeking an experienced Lead Data Engineer to join our team at Elite Recruitments. As a key member of our data team, you will be responsible for designing, developing, and implementing efficient data pipelines using tools like Spark, Azure Data Factory, and Informatica. Key Responsibilities:- Collaborate...

  • Data Engineering Lead

    3 weeks ago

    Gurgaon, Haryana, India Metyis Full time

    About the RoleWe are seeking a highly skilled Data Engineering Lead to join our team at Metyis. As a key member of our organization, you will be responsible for leading the execution of data engineering projects and driving impactful change at our clients.Key ResponsibilitiesLead and manage the execution of data engineering projects, ensuring timely delivery...

  • Senior Data Engineering Manager

    2 weeks ago

    Gurgaon/Gurugram/Bangalore, India HuQuo Consulting Pvt. Ltd. Full time

    Job SummaryThe ideal candidate for this role will possess a unique blend of data engineering and database administration expertise, with a strong foundation in Oracle DBA roles and a demonstrated transition into data engineering. Proficiency in utilizing Git, Jenkins, and Terraform is highly valued, as well as experience with database systems such as Oracle,...

  • Data Engineering Lead

    3 weeks ago

    Gurgaon, Haryana, India India Infoline Full time

    Job Title: Lead Data EngineerAbout the Role:We are seeking an experienced Lead Data Engineer to join our team at India Infoline. As a key member of our data engineering team, you will be responsible for designing and implementing our data lakehouse architecture using Azure and Databricks.Key Responsibilities:Design and implement data lakehouse architecture...