Lead Data Engineer

3 weeks ago

PuneHyderabadGurgaonGurugram, IN LnS Infotech Full time

Position : Lead Data Engineer

Location : : 8+ Years

Roles & Responsibilities :

This role is a hybrid across Data Engineering skill sets and DBA.


Ideally someone with a background in Oracle DBA roles who has branched into data engineering.

- 8+ years of hands-on experience in SQL, Py Spark & Python, should be experienced in shell scripting


Job Description :

- Experienced with AWS services (S3, Glue, Lambda, EMR, Boto3, etc.), ETL, Data Warehousing


- Experience using Git, Jenkins, Terraform

- Experienced implementing ETL pipelines & and migration requirements

- Sound knowledge of Data Engineering concepts and tools for Data Ingestion, Integration, and workflow orchestration

- Ability to handle augmentation of both structured, unstructured, and real-time data, and provide best practices for pipeline operations

- Identify, design, and implement internal process improvements : automating manual processes, optimizing data delivery, re-designing infrastructure for greater scalability

- Troubleshoot and remediate data quality issues raised by pipeline alerts or downstream consumers.


- Implement Data Governance best practices.

- Create and maintain clear documentation on data models/schemas as well as transformation /validation rules

- Implement tools that help data consumers extract, analyze, and visualize data faster through data pipelines

- Led the entire software lifecycle including hands-on development, code reviews, testing, deployment, and documentation for batch ETLs.

- Migrate current on-premises data applications and pipelines to the Cloud leveraging technologies in the future

- One of Oracle, Postgres, Teradata, and Starburst (Trino) DBA experience, preferably in an AWS environment

- Wider AWS experience is welcome in S3, Lambda, VPC, and Security Groups

What we provide :

- Opportunities to develop and grow as an engineer.


- We are at the forefront of our industry, always expanding into new areas, and working with open-source and new technologies.

- A set of hardworking and dedicated peers.

- Growth and mentorship.


- We believe in growing engineers through ownership and leadership opportunities.


- We also believe mentors help both sides of the equation.

Education : Bachelor's degree in Computer Science, Software Engineering, MIS or equivalent combination of education and experience

(ref:hirist.tech)

  • Lead Data Engineer

    4 weeks ago

    Gurgaon/Gurugram, IN HuQuo Consulting Pvt. Ltd. Full time

    Job Description for this position include :- Provides technical leadership in Big Data space (Hadoop Stack like M/R, HDFS, Pig, Hive, HBase, Flume, Sqoop, .NoSQL stores like Cassandra, HBase etc) across Fractal and contributes to open source Big Data technologies- Write and tune complex Java, MapReduce, Pig and Hive jobs- Adapt quickly to change in...

  • Lead Data Engineer

    3 weeks ago

    Gurgaon/Gurugram, IN HuQuo Consulting Pvt. Ltd. Full time

    Job Description for this position include :- Provides technical leadership in Big Data space (Hadoop Stack like M/R, HDFS, Pig, Hive, HBase, Flume, Sqoop, .NoSQL stores like Cassandra, HBase etc) across Fractal and contributes to open source Big Data technologies- Write and tune complex Java, MapReduce, Pig and Hive jobs- Adapt quickly to change in...

  • OfBusiness - Lead Engineer - Data Science

    3 weeks ago

    Gurgaon/Gurugram, IN OFB TECH Pvt Ltd Full time

    We are seeking a highly skilled and experienced AI/ML Lead to join our dynamic team. The ideal candidate should have an experience of 5-7 years in artificial intelligence and machine learning, with a proven track record of leading successful projects. As the AI/ML Lead, you will be responsible for driving the development and implementation of cutting-edge AI...

  • OfBusiness - Lead Engineer - Data Science

    3 weeks ago

    Gurgaon/Gurugram, IN OFB TECH Pvt Ltd Full time

    We are seeking a highly skilled and experienced AI/ML Lead to join our dynamic team. The ideal candidate should have an experience of 5-7 years in artificial intelligence and machine learning, with a proven track record of leading successful projects. As the AI/ML Lead, you will be responsible for driving the development and implementation of cutting-edge AI...

  • Lead Data Engineer

    4 weeks ago

    Gurgaon/Gurugram, IN HuQuo Consulting Pvt. Ltd. Full time

    Job brief :We are looking for a Lead Data Engineer to join our Data Engineering Team. In this senior role, you will be responsible for managing our Enterprise Data Warehouse and ensuring the efficient flow and quality of data.Your tasks will include implementing data processes, managing data architecture, designing ETL processes, and analyzing data for...

  • Lead Data Engineer

    3 weeks ago

    Gurgaon/Gurugram, IN HuQuo Consulting Pvt. Ltd. Full time

    Job brief :We are looking for a Lead Data Engineer to join our Data Engineering Team. In this senior role, you will be responsible for managing our Enterprise Data Warehouse and ensuring the efficient flow and quality of data.Your tasks will include implementing data processes, managing data architecture, designing ETL processes, and analyzing data for...

  • Lead GCP Data Engineer

    3 weeks ago

    Pune/Gurgaon/Gurugram, IN IFLOWTECH SOLUTIONS PRIVATE LIMITED Full time

    Location : Pune, GurgaonExperience : 8 to 10 yearNotice period : Immediate to 15 DaysJob Description : Skills :- 8+ years of proven experience as a Lead in Big Data Engineering. - Mandatory Technical Proficiency - Hands-on experience with Python, PySpark, Google Cloud Full Stack, SQL, DevOps, Databricks, DBT & Terraform. - Experience with Google Cloud...

  • Lead Data Engineer

    1 week ago

    Gurgaon/Gurugram, IN Visionyle Solutions Full time

    Role : Lead Data EngineerExp : 7-10 YearsLocation : Gurgaon (Hybrid) - 3 days WFORequirements :- Have a strong technical background, including 8+ years of experience in designing and engineering large scale systems.- At least 3 years of experience working as lead in designing, development and deploying data integration and ETL solutions in a data warehousing...

  • Lead/Senior Azure Data Engineer

    2 months ago

    Pune/Hyderabad/Gurgaon/Gurugram, IN Huquo Full time

    About Clairvoyant :Clairvoyant is a global technology consulting and services company founded in 2012, headquartered in Chandler, US, and has delivery centers across the globe. We help organizations maximize the value of data by providing data engineering, analytics, machine learning, and user experience consulting and development projects to multiple...

  • Lead/Senior Azure Data Engineer

    3 weeks ago

    Pune/Hyderabad/Gurgaon/Gurugram, IN Huquo Full time

    About Clairvoyant :Clairvoyant is a global technology consulting and services company founded in 2012, headquartered in Chandler, US, and has delivery centers across the globe. We help organizations maximize the value of data by providing data engineering, analytics, machine learning, and user experience consulting and development projects to multiple...

  • Lead Python Engineer

    4 weeks ago

    Gurgaon/Gurugram, IN IT Resource Hunter Full time

    Responsibilities Reporting to the Senior Engineer Manager - Risk and data Technology, and working closely with CIO he/she will focus on designing and developing the key frameworks (service engines, API backed business functions) for business process execution as well as work in Data science projects (planning optimization, pricing/scheduling optimization)...

  • Lead Python Engineer

    3 weeks ago

    Gurgaon/Gurugram, IN IT Resource Hunter Full time

    Responsibilities Reporting to the Senior Engineer Manager - Risk and data Technology, and working closely with CIO he/she will focus on designing and developing the key frameworks (service engines, API backed business functions) for business process execution as well as work in Data science projects (planning optimization, pricing/scheduling optimization)...

  • Lead Cognos Data Engineer

    2 months ago

    Pune/Hyderabad/Gurgaon/Gurugram, IN Huquo Full time

    Role : Lead Cognos Data EngineerMust-Have :- 8+ yrs of experience in Cognos Tools such as Cognos BI - Framework manager, Analysis Studio, Report studio, Event Studio, Query studio etc.- Experience in Design and development of enterprise-wide data analysis and reporting solutions with Cognos , Cognos10.2 repor studio and query studio etc.- Excellent Knowledge...

  • Lead Cognos Data Engineer

    3 weeks ago

    Pune/Hyderabad/Gurgaon/Gurugram, IN Huquo Full time

    Role : Lead Cognos Data EngineerMust-Have :- 8+ yrs of experience in Cognos Tools such as Cognos BI - Framework manager, Analysis Studio, Report studio, Event Studio, Query studio etc.- Experience in Design and development of enterprise-wide data analysis and reporting solutions with Cognos , Cognos10.2 repor studio and query studio etc.- Excellent Knowledge...

  • Senior Data Engineer

    4 weeks ago

    Gurgaon/Gurugram, IN Optivalue tek consulting Full time

    Company Description : OptiValueTek is a leading provider of IT solutions specializing in Application & Process Integration, API Management, Data Engineering, Data Science/MLOps, DevOps & SRE, Cloud Solutions, and Web/Mobile & Application Development. With a focus on innovation, we have developed in-house tools/accelerators for Test Automation, API...

  • Senior Data Engineer

    3 weeks ago

    Gurgaon/Gurugram, IN Optivalue tek consulting Full time

    Company Description : OptiValueTek is a leading provider of IT solutions specializing in Application & Process Integration, API Management, Data Engineering, Data Science/MLOps, DevOps & SRE, Cloud Solutions, and Web/Mobile & Application Development. With a focus on innovation, we have developed in-house tools/accelerators for Test Automation, API...

  • Lead Data Engineer

    1 week ago

    Pune/Gurgaon/Gurugram/Noida/Bangalore, IN Pathways Consultant Full time

    Lead Data EngineerLocation : Pune, Gurgaon, Noida, BangaloreExperience : 7 -10 yearsNotice : Early joiners required (0 - 10 Days)Salary : 20 - 25 LPAShift : 12:00 PM-9:00 PM/ 12:30 PM-9:30 PMResponsibilities :- Should possess hands-on experience in working on some of the relational and non-relational databases (Oracle/SQL Server/DB2/PostgreSQL/MySQL/Golden...

  • Data Engineer

    4 weeks ago

    Gurgaon/Gurugram, IN HuQuo Consulting Pvt. Ltd. Full time

    Role & Responsibilities Overview :- A seasoned data team member with a good grasp of both business and technical aspects. - Good familiarity with data stack- Interact with the other members of the data governance team, business teams to understand requirements and also collaborate with stewards / data custodians / end users etc- Demonstrated experience of...

  • Data Engineer

    3 weeks ago

    Gurgaon/Gurugram, IN HuQuo Consulting Pvt. Ltd. Full time

    Role & Responsibilities Overview :- A seasoned data team member with a good grasp of both business and technical aspects. - Good familiarity with data stack- Interact with the other members of the data governance team, business teams to understand requirements and also collaborate with stewards / data custodians / end users etc- Demonstrated experience of...

  • Lead Data Engineer/Manager

    4 weeks ago

    Gurgaon/Gurugram/Bangalore, IN HuQuo Consulting Pvt. Ltd. Full time

    Job Title: Lead Data EngineerJob SummaryLooking for a versatile professional to join our team in the role of Hybrid Data Engineer and Database Administrator. This position requires a blend of expertise in Data Engineering and Database Administration, with a strong foundation in Oracle DBA roles and a demonstrated transition into data engineering. The ideal...