Lead Data Engineer

1 month ago

india HuQuo Consulting Pvt. Ltd. Full time

Responsibilities :

- Should possess hands-on experience in working on some of the relational and non-relational databases (Oracle/SQL Server/DB2/PostgreSQL/MySQL/Golden Gate/Data Guard) on AWS and/or on-prem infrastructure.

- 3+ years' Experience with AWS Services like AWS RDS, Aurora, EC2, S3, DMS, AWS Backups, and DynamoDB.

- 3+ years' Experience with the Design and deployment of Amazon Machine Images (AMI) for Database.

- Experience in database migrations from on-prem to AWS Cloud, replication technologies like Oracle Golden Gate/HVR

- Manage and maintain database systems to ensure optimal performance, reliability, and security.

- Design, develop, and deploy data pipelines and ETL processes for efficient data ingestion, transformation, and analysis.

- Collaborate with cross-functional teams to understand data requirements and develop scalable data solutions.

- Monitor database performance metrics and proactively address any performance or scalability issues.

- Implement version control for database scripts and configurations using Git.

- Utilize Jenkins for continuous integration and deployment of database changes.

- Automate infrastructure provisioning and configuration using Terraform to enhance deployment efficiency.

- Leverage AWS services such as S3, Lambda, VPC, and Security Groups to support data infrastructure.

- Provide guidance on database security best practices, including access control and encryption.

- Stay updated on emerging technologies and industry trends in data engineering and database administration.

Required Qualifications:

- 7-8 Years industry implementation experience with Data Engineering tools.

- Broad experience of working within AWS and must be capable of working from infrastructure (VPC, EC2, Security groups, S3 etc.) to AWS data platforms (Redshift, RDS, Glue etc). In depth experience of Azure/GCP is also of interest.

- Experience with database migrations to AWS Cloud

- Design, deploy and support databases on Ec2, AWS RDS and VMware platform

- Working Knowledge of infrastructure automation with Terraform.

- Understanding of source control management and associated tools such as Git.

- Manage and maintain database systems to ensure optimal performance, reliability, and security.

- Design, develop, and deploy data pipelines and ETL processes for efficient data ingestion, transformation, and analysis.

- Collaborate with cross-functional teams to understand data requirements and develop scalable data solutions.

- Monitor database performance metrics and proactively address any performance or scalability issues.

- Implement version control for database scripts and configurations using Git.

- Utilize Jenkins for continuous integration and deployment of database changes.

- Automate infrastructure provisioning and configuration using Terraform to enhance deployment efficiency.

- Leverage AWS services such as S3, Lambda, VPC, and Security Groups to support data infrastructure.

- Provide guidance on database security best practices, including access control and encryption.

- Stay updated on emerging technologies and industry trends in data engineering and database administration.

- 3-5 years of management experience required

- 3-5 years consulting experience preferred

- Bachelor's degree or equivalent experience, master's degree Preferred

- Strong data warehousing, OLTP systems, data integration and SDLC

- Understanding and experience with major Data Architecture philosophies (Dimensional, ODS, Data Vault, etc.)

- Understanding of modern data warehouse capabilities and technologies such as real-time, cloud, Big Data.

- Understanding of on premises and cloud infrastructure architectures (e.g. AWS, Azure, GCP)

Preferred Skills & Experience:

- Proven experience in Oracle DBA roles, with a solid understanding of database management principles.

- Proficiency in at least one of the following database systems: Oracle, Postgres, Teradata, or Starburst (Trino).

- Hands-on experience with Git, Jenkins, and Terraform for version control and automation.

- Familiarity with AWS cloud services, particularly in an environment involving S3, Lambda, VPC, and Security Groups.

- Strong analytical and problem-solving skills with a proactive approach to troubleshooting.

- Excellent communication and collaboration abilities, with a track record of working effectively in cross-functional teams.

- Knowledge and working experience with Data Integration processes, such as Data Warehousing, EAI, etc.

- Ability to analyze business requirements as they relate to the data movement and transformation processes, research, evaluation and recommendation of alternative solutions.

- Ability to provide technical direction to other team members including contractors and employees.

- Ability to contribute to conceptual data modelling sessions to accurately define business processes, independently of data structures and then combine the two together.

- Demonstrated ability to serve as a trusted advisor that builds influence with client management beyond simply EDM.

- Can create documentation and presentations such that they "stand on their own"

- Hands on experience with AWS Products (e.g. AWS Lambda, AWS Glue, AWS EMR, AWS S3, AWS Sage maker, etc.)

- Designing, building, operationalizing, securing, and monitoring data processing systems on AWS Cloud Platform

- Can contribute to internal/external Data Integration proof of concepts.

- Shows ability to create new and innovative solutions to problems previously not encountered.

- Ability to work independently on projects as well as collaborate effectively across teams

- Strong team building, interpersonal, analytical, problem identification and resolution skills

- Experience working with multi-level business communities

- Can effectively utilize SQL and/or available BI tool to validate/elaborate business rules.

- Effectively influences and, at times, oversees business and data analysis activities to ensure sufficient understanding and quality of data.

- Deals effectively with all team members and builds strong working relationships/support with them.

- Understands modern data warehouse concepts (real-time, cloud, Big Data) and how to enable such capabilities from a reporting and analytic standpoint.

(ref:hirist.tech)

  • Operations Specialist

    2 weeks ago

    India Data Engineer Academy Full time

    Job Title: Operations Analyst Location : Remote Company Overview: Data Engineering Academy is a pioneering force in data engineering education, founded by FAANG data engineers with extensive industry expertise. Our platform provides comprehensive programs tailored to empower aspiring data engineers, equipping them with the skills and confidence necessary...

  • Data Engineering Lead

    2 weeks ago

    India Chryselys Full time

    Job Description:We are currently seeking a skilled and experienced individual for the position of Data Engineering Lead. As the Data Engineering Lead, you will have a significant impact on the successful implementation of data projects for our clients. Your proficiency in data engineering and data operations will be crucial in ensuring project completion...

  • Lead Data Engineer

    2 weeks ago

    India Decision Foundry Full time

    Lead Data Engineer (Salesforce Cloud):Experience: 5-10 years of experience in data engineering and the Salesforce ecosystem.We are looking for a skilled Senior Data Engineer to join our team and have a key role in creating, constructing, and advising on solutions within the Salesforce ecosystem. The perfect candidate should have a solid background in data...

  • Lead Data Engineer

    2 weeks ago

    India Orion Innovation Full time

    As a Lead Data Engineer, you will play a crucial role in designing, developing, and maintaining our data infrastructure. You will lead a team of data engineers to ensure the successful delivery of projects and contribute to the overall data strategy. The ideal candidate will have extensive experience in cloud-based data technologies, particularly in Azure,...

  • Lead Data Engineer

    1 month ago

    india Orion Innovation Full time

    As a Lead Data Engineer, you will play a crucial role in designing, developing, and maintaining our data infrastructure. You will lead a team of data engineers to ensure the successful delivery of projects and contribute to the overall data strategy. The ideal candidate will have extensive experience in cloud-based data technologies, particularly in Azure,...

  • Lead Data Engineer

    3 weeks ago

    india Orion Innovation Full time

    As a Lead Data Engineer, you will play a crucial role in designing, developing, and maintaining our data infrastructure. You will lead a team of data engineers to ensure the successful delivery of projects and contribute to the overall data strategy. The ideal candidate will have extensive experience in cloud-based data technologies, particularly in Azure,...

  • Lead data engineer

    4 weeks ago

    india USEReady Full time

    Useready is hiring for Lead Data Engineer(Bangalore/Mohali/Gurugram) Job Description Mentor a team of developers in building and maintaining high-quality, scalable, and secure data pipelines and analytics applications on the Databricks platform Work closely with data engineers, business stakeholders to understand their needs and design and develop...

  • Data Engineer

    3 months ago

    india dentsu Full time

    The purpose of this role is to maintain, improve, clean and manipulate data in the business’s operational and analytics databases. The Data Engineer works with the business’s software engineers, data analytics teams, data scientists and data warehouse engineers in order to understand and aid in the implementation of database requirements, analyse...

  • Lead Data Engineer

    4 weeks ago

    india Digitas India Full time

    Role- Lead Data Engineer Experience - 6 +Years Locations- Mumbai/Pune/Ahmedabad Overview: As a Lead Data Engineer, you will play a pivotal role in designing, implementing, and managing complex data pipelines within Google Cloud Platform (GCP) & AWS . Your expertise in integrating SAP, Salesforce and other cloud databases and marketing platforms , will be...

  • Lead Data Engineer

    2 days ago

    india Advance Data Analytics Ltd. Full time

    *Immediate Joiners Preferred* We are hiring for a UK based client Experience: 6 to 10 years Location: Noida (Hybrid) Your main duties & responsibilities: Design, build and unit test of aspects data services, from ingestion, through harmonization and transformation into business usable analytics. Input into High level design and responsibility for low...

  • Software Test Engineer

    3 days ago

    India Lead Masters AI Full time

    Company Description LeadMasters.ai is an innovative AI-driven lead generation and ad optimization platform that empowers businesses to maximize their marketing potential through intelligent lead generation and data-driven ad optimization. Our platform leverages advanced artificial intelligence algorithms to analyze top-performing ads across various social...

  • Software Test Engineer

    2 days ago

    india Lead Masters AI Full time

    Company Description LeadMasters.ai is an innovative AI-driven lead generation and ad optimization platform that empowers businesses to maximize their marketing potential through intelligent lead generation and data-driven ad optimization. Our platform leverages advanced artificial intelligence algorithms to analyze top-performing ads across various social...

  • Lead Data Engineer

    3 weeks ago

    india Helius Technologies Full time

    Work Location: Hyderabad Work Mode : 5 days Work from Office Work Timings : 9 am to 6 pm Client: Singapore based Job Type: 1 year renewable contract (Long Term) Kindly revert with below details in addition to updated resume. Full Name as per the Passport or Aadhar Card : Current Salary Exp Salary Notice period (availability) Reason for Change Ok for 1...

  • Lead Data Engineer

    3 weeks ago

    india Decision Foundry Full time

    Lead Data Engineer (Salesforce Cloud): Experience: 5-10 years of experience in data engineering and the Salesforce ecosystem. We seek an experienced Senior Data Engineer to join our team and play a pivotal role in designing, building, and consulting solutions within the Salesforce ecosystem. The ideal candidate should have a strong background in data...

  • Lead Data Engineer

    4 weeks ago

    india Decision Foundry Full time

    Lead Data Engineer (Salesforce Cloud): Experience: 5-10 years of experience in data engineering and the Salesforce ecosystem. We seek an experienced Senior Data Engineer to join our team and play a pivotal role in designing, building, and consulting solutions within the Salesforce ecosystem. The ideal candidate should have a strong background in data...

  • Azure Lead Data Engineer

    1 month ago

    india IntraEdge Full time

    As Azure Lead Data Engineer, you will have to take over the key activities of designing, coding, and implementing data solutions in the platform. With a focus on leveraging DBT for data transformation and modelling, as well as expertise in MDM tools, you will play a pivotal role in architecting scalable and performant data pipelines and warehouses. You will...

  • Data Engineering Lead

    1 month ago

    india Chryselys Full time

    Job Description: As a Data Engineering Lead, you will play a critical role in driving the delivery for our clients data projects. Leveraging your expertise in data engineering and data operations, you will work closely with clients to ensure that the project delivery on time with quality and meeting the requirements. This role requires a deep understanding...

  • Team Lead- Data Engineering

    1 month ago

    india Concentrix Full time

    Experience: 6 Years - 10 Years Job Location: Bengaluru (Hybrid- currently remote) Notice Period: Immediate/ 30 Days (Looking for someone to start from May or Mid June) Shift Timings: 02:00 PM to 11:00 PM (IST)/ 03:00 PM to 12:00 AM (IST) Job Description: We are seeking an experienced and talented Data Engineering Team Lead who can manage a...

  • Team Lead- Data Engineering

    1 week ago

    India Concentrix Full time

    Experience: 6 Years - 10 Years Job Location: Bengaluru (Hybrid- currently remote) Notice Period: Immediate/ 30 Days (Looking for someone to start from May or Mid June) Shift Timings: 02:00 PM to 11:00 PM (IST)/ 03:00 PM to 12:00 AM (IST) Job Description: We are seeking an experienced and talented Data Engineering Team Lead who can manage a high-performing...

  • Lead Data Engineer

    2 weeks ago

    India SeaCross Recruitment Services Full time

    Job Title: Infrastructural Components Developer at LDHAbout the Company: Join a leading company in the tech industry with a focus on infrastructure development.Job Description:Play a key role in developing infrastructural components for the LDH stack with the following responsibilities:Strong coding skills with expertise in Python, Spark, SQL (Postgres), and...