Lead Data Engineer

3 weeks ago


PuneHyderabadGurgaonGurugram, IN LnS Infotech Full time

Position : Lead Data Engineer

Location : : 8+ Years

Roles & Responsibilities :

This role is a hybrid across Data Engineering skill sets and DBA.


Ideally someone with a background in Oracle DBA roles who has branched into data engineering.

- 8+ years of hands-on experience in SQL, Py Spark & Python, should be experienced in shell scripting


Job Description :

- Experienced with AWS services (S3, Glue, Lambda, EMR, Boto3, etc.), ETL, Data Warehousing


- Experience using Git, Jenkins, Terraform

- Experienced implementing ETL pipelines & and migration requirements

- Sound knowledge of Data Engineering concepts and tools for Data Ingestion, Integration, and workflow orchestration

- Ability to handle augmentation of both structured, unstructured, and real-time data, and provide best practices for pipeline operations

- Identify, design, and implement internal process improvements : automating manual processes, optimizing data delivery, re-designing infrastructure for greater scalability

- Troubleshoot and remediate data quality issues raised by pipeline alerts or downstream consumers.


- Implement Data Governance best practices.

- Create and maintain clear documentation on data models/schemas as well as transformation /validation rules

- Implement tools that help data consumers extract, analyze, and visualize data faster through data pipelines

- Led the entire software lifecycle including hands-on development, code reviews, testing, deployment, and documentation for batch ETLs.

- Migrate current on-premises data applications and pipelines to the Cloud leveraging technologies in the future

- One of Oracle, Postgres, Teradata, and Starburst (Trino) DBA experience, preferably in an AWS environment

- Wider AWS experience is welcome in S3, Lambda, VPC, and Security Groups

What we provide :

- Opportunities to develop and grow as an engineer.


- We are at the forefront of our industry, always expanding into new areas, and working with open-source and new technologies.

- A set of hardworking and dedicated peers.

- Growth and mentorship.


- We believe in growing engineers through ownership and leadership opportunities.


- We also believe mentors help both sides of the equation.

Education : Bachelor's degree in Computer Science, Software Engineering, MIS or equivalent combination of education and experience

(ref:hirist.tech)

  • Pune/Hyderabad/Gurgaon/Gurugram, IN Huquo Full time

    About Clairvoyant :Clairvoyant is a global technology consulting and services company founded in 2012, headquartered in Chandler, US, and has delivery centers across the globe. We help organizations maximize the value of data by providing data engineering, analytics, machine learning, and user experience consulting and development projects to multiple...


  • Pune/Hyderabad/Gurgaon/Gurugram, IN Huquo Full time

    Role : Lead Cognos Data EngineerMust-Have :- 8+ yrs of experience in Cognos Tools such as Cognos BI - Framework manager, Analysis Studio, Report studio, Event Studio, Query studio etc.- Experience in Design and development of enterprise-wide data analysis and reporting solutions with Cognos , Cognos10.2 repor studio and query studio etc.- Excellent Knowledge...

  • Manager/Data Engineer

    4 weeks ago


    Gurgaon/Gurugram, IN HuQuo Consulting Pvt. Ltd. Full time

    Job Description :The Data Engineering Team primarily work with the lead data engineer, product owners, architects, engineering teams and BI developers to implement and drive forward data & analytics goals within Risk.This is an opportunity to work as a "hands on" data engineer, engaging with a variety of stakeholders in engineering teams and the business to...

  • Lead Data Engineer

    4 weeks ago


    Bangalore/Hyderabad/Pune, IN iMind Your Business Solutions Private Limited Full time

    Job Description :We are hiring Lead Data Engineers for the leaders In Analytics & Cloud Applications, headquartered in San Francisco and have offices in India (Bangalore, Hyderabad and Pune)Our client provides strategic guidance and technology systems for clients wishing to solve their most complex and interesting business challenges involving cloud...


  • Gurgaon/Gurugram, IN OFB Tech Pvt Ltd Full time

    We are currently seeking a talented and motivated Data Engineer to join our dynamic team and play a crucial role in shaping the future of our data : - Design, develop, and maintain robust data pipelines for efficient and scalable data processing.- Implement data integration solutions using Python and Java programming languages.- Utilize Airflow for...

  • Lead Data Scientist

    4 weeks ago


    Gurgaon/Gurugram, IN CerebrumX Labs Pvt Ltd Full time

    Position - Data Scientist LeadExperience : 6-8 years Job Responsibilities : - Tech-savvy, passionate about automotive as an industry with the ability to make complex technical matters easy-to understand even for non-technical people - We are looking for a reliable Data Scientist/Machine Learning Engineer to ensure development with Machine Learning to...

  • AWS Data Engineer

    4 weeks ago


    Gurgaon/Gurugram, IN HuQuo Consulting Pvt. Ltd. Full time

    Job Description : Responsibilities :- Proficient in designing and implementing data ingestion pipelines from various sources.- Build and enhance Python and PySpark-based frameworks for efficient and scalable data ingestion processes.- Collaborate with cross-functional teams to understand requirements and tailor frameworks to meet specific business needs.-...

  • Data Engineer

    4 weeks ago


    Gurgaon/Gurugram, IN HuQuo Consulting Pvt. Ltd. Full time

    As Data Engineer, your specific responsibilities include the following :- Create and maintain optimal data pipeline architecture- Assemble large, complex data sets that meet functional / non-functional business requirements- Identify, design, and implement internal process improvements: automating manual processes, optimizing data delivery, re-designing...


  • Gurgaon/Gurugram, IN COFORGE Full time

    Job Description :As a Senior Data Engineer, you'll be at the forefront of developing and optimizing data pipelines, ensuring the seamless flow of data across our systems. Bring your expertise in Java, Python, and a range of big data technologies including Hadoop, Cassandra, Kafka, Spark, HBase, and MySQL to drive innovation and efficiency in our data...

  • Data Engineer

    4 weeks ago


    Gurgaon/Gurugram, IN HuQuo Consulting Pvt. Ltd. Full time

    Job Description :Role Overview :We are looking for a go-getter person who can define :- Data strategies to meet the demands of business requirements- Technical requirements of the organizational data needs from diverse teams- Data architecture, models and go-forward data solutions for various teams of the organization- The person will be part of the Data...

  • Data Engineer

    4 weeks ago


    Gurgaon/Gurugram, IN Huquo Consulting Full time

    Role : Data EngineerLocation : GurgaonDesignation : AM- AVP (as per interview performance & EXL fitment)Work Timings : 1pm- 10pmRole Overview :We are looking for a go getter person who can define :1. Analytic strategies to meet the demands of business requirements2. Technical requirements of the analytic solutions3. Data requirements of the analytic solution...

  • Data Engineer

    2 weeks ago


    Gurgaon/Gurugram, IN Upnotch Consulting Full time

    Position Summary :In the Data Engineer role, you will assist on data retrieval from multiple source systems, data processing and cleansing. You will be responsible for constructing automated data pipelines and updating the serving layer for analytics and insights. Your Role Responsibilities and Duties : - Monitor and troubleshoot operational or data issues...


  • Gurgaon/Gurugram, IN Bigfoot Retail Solutions Pvt. Ltd Full time

    Job Description :- Design and build data pipelines from various cloud data sources for the enterprise data warehouse- Partner with Data Engineers, Data architects, domain experts, data analysts and other teams to build foundational data sets that are trusted, well understood, aligned with business strategy and enable self-service- Own and document data...

  • Lead Data Architect

    4 weeks ago


    Gurgaon/Gurugram/Mumbai, IN Huquo Full time

    Job Description :While working closely with users and providing a high level of customer service in a friendly, professional manner, the successful candidate must be able to :- Design multi-year IT data-driven transformation/delivery roadmaps qualifying strategic business opportunities - Define long-term strategic goals for data architecture vision,...

  • Data Engineer

    4 weeks ago


    Gurgaon/Gurugram, IN True Tech Professionals Private Limited Full time

    Location : Gurgaon (Hybrid Mode)Experience : 5 years and above. (Less than 5 years will not be considered)Immediate Joiners Preferred (Notice Period: 7 to 10 days)We are seeking a skilled Senior Data Engineer to join our dynamic team. The ideal candidate should have a strong background in data engineering with expertise in Python, Pyspark, AWS Glue, Athena,...

  • Lead Data Engineer

    2 days ago


    Chennai/Cochin/Kochi/Coimbatore/Hyderabad, IN DigiMoksha Solutions Full time

    Position : Lead Data EngineerExperience : 10-15 YearsLocation : Period : Immediate Description :As a Lead Data Engineer, you will play a crucial role in designing, developing, and maintaining our data infrastructure. You will lead a team of data engineers to ensure the successful delivery of projects and contribute to the overall data strategy. The ideal...

  • Data Engineer

    4 weeks ago


    Hyderabad/Gurgaon/Gurugram, IN TOTLRPO Full time

    Qualifications :a. 11+ years of overall technology experience that includes at least 4+ years of hands-on software development, data engineering, and systems architecture.b. 4+ years of experience with Data Lake Infrastructure, Data Warehousing, and Data Analytics tools.c. 4+ years of experience in SQL optimization and performance tuning, and development...

  • Azure Data Engineer

    3 weeks ago


    Gurgaon/Gurugram, IN Conneqtcorp Full time

    Role - Azure Data EngineerLocation - GurugramWork Mode - HybridSkills - Databricks, Azure, Python, SQLNotice Period - May JoinersRole Overview :We are seeking a skilled Data Engineer to join our team. The successful candidate will be responsible for maintaining and optimizing data pipelines, implementing robust data checks, and ensuring the accuracy and...

  • Data Engineer

    4 weeks ago


    Pune/Gurgaon/Gurugram, IN Huquo Full time

    Position : Snowflake DELocation : Pune, GurgaonExperience : 6-9 YearsClairvoyant is a global technology consulting and services company founded in 2012, headquartered in Chandler, US, and have delivery centers across the globe. We help organizations maximize the value of data by providing data engineering, analytics, machine learning, and user experience...

  • Senior Data Engineer

    4 weeks ago


    Hyderabad/Chennai/Pune/Mumbai/Gurgaon/Gurugram, IN Hub Work Full time

    We are looking for a data engineer who has experience in building data pipelines for large data platforms. This role will be working with a team building a large data platform catering to the needs of a wealth manager for their application and analytics needs. This role will be augmented with a customer of Intellect and other third parties in delivering...