Lead Data Engineer

1 week ago

Delhi, Delhi, India HuQuo Consulting Pvt. Ltd. Full time

Responsibilities :

  • Must have hands-on experience working with various databases like Oracle, SQL Server, DB2, PostgreSQL, MySQL, etc., both in AWS and on-premises setups.
  • 3+ years' Experience with a range of AWS Services including RDS, Aurora, EC2, S3, DMS, AWS Backups, and DynamoDB.
  • 3+ years' Experience designing and deploying Amazon Machine Images (AMI) for databases.
  • Experience in migrating databases from on-premises to AWS Cloud, utilizing replication technologies such as Oracle Golden Gate/HVR.
  • Manage and optimize database systems for performance, reliability, and security.
  • Design, develop, and implement data pipelines and ETL processes for efficient data management.
  • Collaborate with teams to understand data needs and create scalable data solutions.
  • Monitor and address database performance and scalability issues proactively.
  • Implement version control for database scripts and configurations using Git.
  • Use Jenkins for continuous integration and deployment of database changes.
  • Automate infrastructure setup and configuration with Terraform for improved deployment efficiency.
  • Utilize AWS services like S3, Lambda, VPC, and Security Groups for robust data infrastructure.
  • Provide guidance on best practices for database security, access control, and encryption.
  • Stay updated on the latest technologies and trends in data engineering and database administration.

Required Qualifications:

  • 7-8 years of industry experience with Data Engineering tools.
  • Extensive experience working within AWS and familiarity with infrastructure (VPC, EC2, Security groups, S3, etc.) and data platforms (Redshift, RDS, Glue, etc.). Knowledge of Azure/GCP is a plus.
  • Experience in migrating databases to AWS Cloud.
  • Design, deploy, and support databases on Ec2, AWS RDS, and VMware platforms.
  • Proficiency in infrastructure automation using Terraform.
  • Knowledge of source control management tools like Git.
  • Manage and maintain database systems to ensure optimal performance, reliability, and security.
  • Design, develop, and implement data pipelines and ETL processes for efficient data management.
  • Collaborate with teams to understand data needs and develop scalable data solutions.
  • Monitor database performance metrics and proactively address performance and scalability issues.
  • Implement version control for database scripts and configurations using Git.
  • Use Jenkins for continuous integration and deployment of database changes.
  • Automate infrastructure provisioning and configuration using Terraform for efficient deployment.
  • Leverage AWS services such as S3, Lambda, VPC, and Security Groups to support data infrastructure.
  • Provide guidance on database security practices, including access control and encryption.
  • Stay updated on emerging trends in data engineering and database administration.
  • 3-5 years of management experience required.
  • 3-5 years of consulting experience preferred.
  • Bachelor's degree or equivalent experience, master's degree preferred.
  • Strong expertise in data warehousing, OLTP systems, data integration, and SDLC.
  • Understanding and experience with major Data Architecture philosophies (Dimensional, ODS, Data Vault, etc.).
  • Understanding of modern data warehouse capabilities and technologies like real-time, cloud, Big Data.
  • Understanding of on-premises and cloud infrastructure architectures (e.g., AWS, Azure, GCP).

Preferred Skills & Experience:

  • Proven experience as an Oracle DBA with a strong grasp of database management principles.
  • Proficiency in Oracle, Postgres, Teradata, or Starburst (Trino) database systems.
  • Hands-on experience with Git, Jenkins, and Terraform for version control and automation.
  • Familiarity with AWS cloud services, especially in setups involving S3, Lambda, VPC, and Security Groups.
  • Strong analytical and problem-solving skills with a proactive troubleshooting approach.
  • Excellent communication and collaboration skills with a history of effective cross-functional teamwork.
  • Knowledge and hands-on experience with Data Integration processes such as Data Warehousing and EAI.
  • Ability to analyze business requirements related to data movement and transformation, research alternative solutions, and provide recommendations.
  • Ability to offer technical guidance to team members, including contractors and employees.
  • Ability to contribute to data modeling sessions and combine business processes with data structures effectively.
  • Demonstrated ability to build influence with client management beyond EDM as a trusted advisor.
  • Skilled in creating documentation and presentations that are comprehensive and self-explanatory.
  • Experience with various AWS Products like Lambda, Glue, EMR, S3, SageMaker, etc.
  • Designing, building, securing, and monitoring data processing systems on the AWS Cloud Platform.
  • Contribution to internal/external Data Integration proof of concepts.
  • Ability to devise innovative solutions to unprecedented problems.
  • Independence in project work while maintaining effective collaboration across teams.
  • Strong skills in team-building, interpersonal relations, problem identification, and resolution.
  • Experience working with diverse business communities at different levels.
  • Proficient in using SQL or available BI tools to validate and elaborate on business rules.
  • Ability to oversee business and data analysis activities to ensure data quality and understanding.
  • Effective teamwork and relationship-building with all team members.
  • Understanding modern data warehouse concepts and enabling capabilities for reporting and analytics in real-time, cloud, and Big Data environments.
)

  • Operations Specialist

    1 week ago

    Delhi, Delhi, India Data Engineer Academy Full time

    Job Title: Operations AnalystLocation : RemoteCompany Overview:Data Engineering Academy is a pioneering force in data engineering education, founded by FAANG data engineers with extensive industry expertise. Our platform provides comprehensive programs tailored to empower aspiring data engineers, equipping them with the skills and confidence necessary to...

  • Operations Specialist

    1 week ago

    Delhi, Delhi, India Data Engineer Academy Full time

    Job Title: Operations AnalystLocation : RemoteCompany Overview:Data Engineering Academy is a pioneering force in data engineering education, founded by FAANG data engineers with extensive industry expertise. Our platform provides comprehensive programs tailored to empower aspiring data engineers, equipping them with the skills and confidence necessary to...

  • Lead Data Engineer

    1 week ago

    Delhi, Delhi, India Akivna Technologies Pvt. Ltd. Full time

    Company DescriptionAkivna Technologies Pvt. Ltd. is an IT company based in Gurugram. We specialize in Data Engineering, Data Science, Data Analytics, DevOps, and Product Development. Our team is passionate about technology and we strive to deliver innovative and high-quality solutions to our clients.Job Description:We are seeking a skilled and experienced...

  • Senior Lead Engineer

    1 week ago

    Delhi, Delhi, India NTT DATA Full time

    Job DescriptionReq ID:282068NTT DATA Services strives to hire exceptional, innovative and passionate individuals who want to grow with us. If you want to be part of an inclusive, adaptable, and forward-thinking organization, apply now.We are currently seeking a Senior Lead Engineer to join our team in Delhi, Delhi (IN-DL), India (IN)."Strongly prefer...

  • Lead Engineer

    1 week ago

    Delhi, Delhi, India NTT DATA Full time

    Job DescriptionReq ID:282070NTT DATA Services strives to hire exceptional, innovative and passionate individuals who want to grow with us. If you want to be part of an inclusive, adaptable, and forward-thinking organization, apply now.We are currently seeking a Lead Engineer to join our team in Delhi, Delhi (IN-DL), India (IN)."RPA Consultant (C)Once You Are...

  • Lead Engineer

    1 week ago

    Delhi, Delhi, India NTT DATA Services Full time

    Req ID: NTT DATA Services strives to hire exceptional, innovative and passionate individuals who want to grow with us. If you want to be part of an inclusive, adaptable, and forward-thinking organization, apply now. We are currently seeking a Lead Engineer to join our team in Delhi, Delhi (IN-DL), India (IN). "RPA Consultant (C) Once You Are Here, You Will:...

  • Lead Data Engineer

    1 week ago

    Delhi, Delhi, India Orion Innovation Full time

    As a Lead Data Engineer, you will play a crucial role in designing, developing, and maintaining our data infrastructure. You will lead a team of data engineers to ensure the successful delivery of projects and contribute to the overall data strategy. The ideal candidate will have extensive experience in cloud-based data technologies, particularly in Azure,...

  • Senior Lead Engineer

    1 week ago

    Delhi, Delhi, India NTT DATA Services Full time

    Req ID:283992NTT DATA Services strives to hire exceptional, innovative and passionate individuals who want to grow with us. If you want to be part of an inclusive, adaptable, and forward-thinking organization, apply now.We are currently seeking a Senior Lead Engineer to join our team in Delhi, Delhi (IN-DL), India (IN).Work closely with Enterprise...

  • Senior Lead Engineer

    1 week ago

    Delhi, Delhi, India NTT DATA Services Full time

    Req ID: NTT DATA Services strives to hire exceptional, innovative and passionate individuals who want to grow with us. If you want to be part of an inclusive, adaptable, and forward-thinking organization, apply now.We are currently seeking a Senior Lead Engineer to join our team in Delhi, Delhi (IN-DL), India (IN)."Strongly prefer MuleSoft Developer –...

  • Lead Data Engineer

    1 week ago

    Delhi, Delhi, India Helius Technologies Full time

    Work Location: HyderabadWork Mode : 5 days Work from OfficeWork Timings : 9 am to 6 pmClient: Singapore basedJob Type: 1 year renewable contract (Long Term)Kindly revert with below details in addition to updated resume.Full Name as per the Passport or Aadhar Card :Current SalaryExp SalaryNotice period (availability)Reason for ChangeOk for 1 year renewable...

  • Senior Lead Engineer

    3 weeks ago

    Delhi, Delhi, India NTT DATA Services Full time

    Req ID: NTT DATA Services strives to hire exceptional, innovative and passionate individuals who want to grow with us. If you want to be part of an inclusive, adaptable, and forward-thinking organization, apply now.We are currently seeking a Senior Lead Engineer to join our team in Delhi, Delhi (IN-DL), India (IN).Work closely with Enterprise Integration...

  • Lead Data Engineer

    1 week ago

    Delhi, Delhi, India Helius Technologies Full time

    Work Location:HyderabadWork Mode : 5 days Work from OfficeWork Timings : 9 am to 6 pmClient:Singapore basedJob Type:1 year renewable contract (Long Term)Kindly revert with below details in addition to updated resume.Full Name as per the Passport or Aadhar Card :Current SalaryExp SalaryNotice period (availability)Reason for ChangeOk for 1 year renewable...

  • Lead data engineer

    1 week ago

    Delhi, Delhi, India USEReady Full time

    Userady is currently seeking a Lead Data Engineer for locations in Bangalore, Mohali, and GurugramJob Description:Mentor a team of developers to create and maintain high-quality, scalable, and secure data pipelines and analytics applications on the Databricks platform.Collaborate closely with data engineers and business stakeholders to understand their...

  • Snowflake Data Engineer

    1 week ago

    Delhi, Delhi, India Lapis Data Analytics Full time

    Company DescriptionLapis Data Analytics is a dynamic and innovative data engineering company founded in 2020 and located in Chennai. Our primary focus is on designing, building, and maintaining robust data pipelines that convert raw data into actionable insights. With a team of seasoned experts and cutting-edge technology, we deliver customized data...

  • Senior Lead Engineer

    1 week ago

    Delhi, Delhi, India NTT DATA Services Full time

    Req ID:285016NTT DATA Services strives to hire exceptional, innovative and passionate individuals who want to grow with us. If you want to be part of an inclusive, adaptable, and forward-thinking organization, apply now.We are currently seeking a Senior Lead Engineer to join our team in Delhi, Delhi (IN-DL), India (IN)."The preference here is for a good...

  • Data Lead Engineer

    1 week ago

    Delhi, Delhi, India Squareroot Consulting Pvt Ltd Full time

    Job Description : We are seeking a highly skilled and motivated Data Lead with expertise in Spark, Scala, Kafka, Big Data, and Batch Processing. As a Data Lead, you will play a key role in leading and managing the end-to-end data processing pipeline, ensuring the reliability, scalability, and efficiency of our data systems.Experience : 6+ YearsLocation :...

  • Senior Lead Engineer

    1 week ago

    Delhi, Delhi, India NTT DATA Services Full time

    Req ID: NTT DATA Services strives to hire exceptional, innovative and passionate individuals who want to grow with us. If you want to be part of an inclusive, adaptable, and forward-thinking organization, apply now.We are currently seeking a Senior Lead Engineer to join our team in Delhi, Delhi (IN-DL), India (IN).Note- The preference here is for any good...

  • Senior Lead Engineer

    1 month ago

    Delhi, Delhi, India NTT DATA Services Full time

    Req ID: NTT DATA Services strives to hire exceptional, innovative and passionate individuals who want to grow with us. If you want to be part of an inclusive, adaptable, and forward-thinking organization, apply now.We are currently seeking a Senior Lead Engineer to join our team in Delhi, Delhi (IN-DL), India (IN).Note- The preference here is for any good...

  • Senior Lead Engineer

    3 weeks ago

    Delhi, Delhi, India NTT DATA Services Full time

    Req ID: NTT DATA Services strives to hire exceptional, innovative and passionate individuals who want to grow with us. If you want to be part of an inclusive, adaptable, and forward-thinking organization, apply now.We are currently seeking a Senior Lead Engineer to join our team in Delhi, Delhi (IN-DL), India (IN).Note- The preference here is for any good...

  • Lead Data Engineer

    1 week ago

    Delhi, Delhi, India Coders Connect Full time

    Job DescriptionCoders ConnectandSanofiare joining forces to bring an electrifying twist to the bio pharmaceutical world Work with a rhythm that suits your style (2 days remote and 3 days onsite magic).Language:Proficiency in English is required for this role to ensure effective communication within our diverse, global team.About Sanofi:We're not just a...