Lead Data Engineer

2 weeks ago

Gurgaon, Haryana, India TransOrg Analytics Full time

Job Description - Lead - Data Engineering

Why would you like to join us?

TransOrg Analytics is a Big Data and Machine Learning solutions and services company which offers advanced analytics solutions to industry leaders and Fortune 500 companies across India, US, APAC and the Middle East. Our Automated Machine Learning product - 'Clonizo' has yielded significant incremental benefits to our clients. TransOrg has won accolades such as 'Top 50 Employers' by the Silicon Review magazine, 'Predictive Analytics Company of the Year' and 'Top 50 Big Data Companies' by the CIO Review magazine.

Overview :

You will have to work with data to help the organization make better business decisions. Using techniques from a range of disciplines, including computer programming, mathematics, and statistics to draw conclusions from data to describe, predict, and improve business performance.

Key Responsibilities [Functional] :

- Analyzing data using statistical techniques and providing reports.

- Developing and implementing databases and data collection systems.

- Acquiring data from primary and secondary sources and maintain data systems.

- Identifying, analyzing, and interpreting trends or patterns in complex data sets

- Lead the Data Engineering through its next phase of growth.

- Design/Implementation/Consulting experience of large-scale data solutions, including data

- Ingestion, Data Modelling, Design & Architecture. The projects may include development, deployment, and infrastructure with complexity around technology, cross-functional dependencies, and multiple stakeholders across various divisions and departments?

Identifying data sources

- Collecting data, Sourcing missing data, Organizing data in to usable formats, Analyzing data to find answers to specific questions, Setting up data infrastructure, Developing, implementing and maintaining databases

- Assessing quality of data and removing or cleaning data

- Generating information and insights from data sets and identifying trends and patterns

- Preparing reports for executive and project teams

- Creating visualizations of data

- A single point contact for all type of data and data related issues. Work closely with vendors, functional, operational, and technical teams across the business to understand their data needs and develop solutions that allow various functions to make data-informed decision.

- Will be responsible for data consistency and accuracy in timely manner pertaining to all data providers/vendors.

- Solid experience leading data teams in developing data fabric platforms.

- Have an eye for Data Quality and understanding of data completeness.

- Understanding different market data used in current business processes and the impact of making changes.

- Ability to build scale and performance as part of development.

- Ability to troubleshoot scale and performance issues, data validation issues

- Expert in implementing security best practices.

- Should know various tolls and techniques to ensure data is accurate and verified.

- Develop, document, maintain and support nimble data solutions that are able to both provide ready access to existing data features and incorporate new features in a timely manner.

- Develop the data roadmap using the most appropriate technologies and manage and expand in house data teams to support growth.

- Work cross-functionally across multiple locations so communication, collaboration, and organization are key to your success.

- Automation of multi-step repetitive tasks.

Skills, Qualifications and Experience required :

- Bachelor's degree in Computer Science, Information Systems (B.Tech/B.E./MCA)

- 6-8 years' experience in building analytics solutions with about 4+ years' experience in Hadoop, Spark and Data Analytics using cloud technologies

- Experience in delivering data pipelines using Cloudera or Hortonworks distributions

- Experience is delivering data pipelines on AWS or Google Cloud

- Good knowledge on frameworks like Spark, Beam, Flink, HDFS, HIVE, HBASE

- Must have knowledge of tools like Sqoop, Flume, Talend, and Kafka

- Candidates having knowledge on Machine Learning will be preferred

- Hands on experience on R or Python-Statistical Programming

- Extraction, Transformation and Loading (ETL) (Microsoft SSIS)

- Analytics / OLAP Cube Development (Microsoft SSAS and MDX), Report Development (Microsoft SSRS)

Good to have :

- Big Data, Hadoop and analytics knowledge

- Data Warehouse knowledge

- Problem-solving and troubleshooting.

- Strong knowledge & experience in Relational databases like Sybase, SQL Server and Oracle

- Experience working with Visualization tools: Power BI, Tableau, Looker, Qlickview, etc.

- Good analytical skills

- Excellent communication skills - both written and verbal.

(ref:hirist.tech)

  • Lead Data Engineer

    6 hours ago

    Gurgaon, Haryana, India Pacific Data Integrators Full time

    Job Title: Lead Data Engineer (IDMC-CDI) Location: Remote Mode of Work: Work from Office Working Hours: US Shift (5 PM to 2 AM IST) Primary Skills: SQL, IDMC (CDI), ETL Concepts Experience: 8+ Years About the Job Are you someone with a deep understanding of ETL and a strong background in developing IDMC ETL-based solutions, capable of developing,...

  • Data Engineering Lead

    4 days ago

    Gurgaon, Haryana, India Eptura Full time

    About the Role:We are seeking a highly skilled Data Team Lead to join our team at Eptura. As a key member of our data engineering group, you will be responsible for designing and developing complex ETL processes that meet the needs of our stakeholders.You will work closely with cross-functional teams to analyze requirements, create data models, and implement...

  • Data Engineering Lead

    3 weeks ago

    Gurgaon, Haryana, India Metyis Full time

    What we offer   Interact with C-level at our clients on regular basis to drive their business towards impactful change Lead your team in creating new business solutions Seize opportunities at the client and at Metyis in our entrepreneurial environment Become part of a fast-growing international and diverse team What you will do Independently...

  • Lead Data Engineer

    3 weeks ago

    Gurgaon, Haryana, India Antal International Full time

    Job Description Lead Data engineer helps to architect, design, implement, and optimise our data ingestion, transformation pipelines and processes. He or she develops data models, processing pipelines, and back-end services supporting the data science teams, automates processes, builds integrations, and builds analytics. Desired skills: · A...

  • Data Engineering Lead

    24 hours ago

    Gurgaon, Haryana, India Eptura Full time

    Job Title: Data Engineering LeadEptura is a global worktech company that provides software solutions for people, workplaces, and assets to enable everyone to reach their full potential.We have 16 million users across 115 countries and are trusted by over 16,000 of the world's leading companies to realize a better future at work.About EpturaWe promote a...

  • Lead Data Engineer

    3 weeks ago

    Gurgaon, Haryana, India Falcon Full time

    Key Responsibilities : Data Engineering & Architecture :- Design and implement scalable, high-performance data pipelines on AWS.- Optimize ETL/ELT processes using AWS Glue, Apache Spark, EMR, and Lambda.- Build and maintain data lakes and warehouses (Redshift, Snowflake).- Ensure data governance, security, and compliance best practices. Technical Leadership...

  • Lead Data Engineer

    2 weeks ago

    Gurgaon, Haryana, India Falcon Full time

    Key Responsibilities : Data Engineering & Architecture :- Design and implement scalable, high-performance data pipelines on AWS.- Optimize ETL/ELT processes using AWS Glue, Apache Spark, EMR, and Lambda.- Build and maintain data lakes and warehouses (Redshift, Snowflake).- Ensure data governance, security, and compliance best practices. Technical Leadership...

  • Data Engineering Lead

    4 days ago

    Gurgaon, Haryana, India Metyis Full time

    Job DescriptionWho We AreThe next step of your career starts here, where you can bring your own unique mix of skills and perspectives to a fast-growing team.Metyis is a global and forward-thinking firm operating across a wide range of industries, developing and delivering AI & Data, Digital Commerce, Marketing & Design solutions and Advisory services. At...

  • Lead Data Engineer

    3 weeks ago

    Gurgaon, Haryana, India IGT Solutions Full time

    Role: Lead Data Engineer Primary Skills: Python, Pyspark, AWS Glue, EMR, Lambda, Snowflake, ETL, PLSQL Experience: - 7+ Years Location: - Remote Notice period: - Immediate Joiner Job Overview : We are seeking a skilled and experienced Lead Data Engineer to join our data engineering team. The ideal candidate will have over 8 years of hands-on experience...

  • Lead Data Engineer

    3 weeks ago

    Gurgaon, Haryana, India IGT Solutions Full time

    Role: Lead Data Engineer Primary Skills: Python, Pyspark, AWS Glue, EMR, Lambda, Snowflake, ETL, PLSQL Experience: - 7+ Years Location: - Remote Notice period: - Immediate Joiner Job Overview : We are seeking a skilled and experienced Lead Data Engineer to join our data engineering team. The ideal candidate will have over 8 years of hands-on experience...

  • Lead Data Engineer

    3 weeks ago

    Gurgaon, Haryana, India Fidelity International Full time

    Job DescriptionAbout the OpportunityJob Type: PermanentApplication Deadline: 01 March 2025Job DescriptionTitle: Lead Data EngineerDepartment: ISSLocation: Gurgaon, India or Dalian, ChinaReports To: Head of Data Platform - ISSGrade : 7We're proud to have been helping our clients build better financial futures for over 50 years. How have we achieved this By...

  • Lead Data Engineer

    4 weeks ago

    Gurgaon, Haryana, India TALENTOLA SOLUTIONS PRIVATE LIMITED Full time

    Job Description :Key Responsibilities :- Team Leadership : Lead, mentor, and grow a team of data engineers, fostering a culture of excellence, collaboration, and continuous improvement.- Data Pipeline Development : Oversee the design, development, and maintenance of robust ETL and ELT pipelines to ingest, transform, and process data efficiently.- Cloud Data...

  • Lead Data Engineer

    3 weeks ago

    Gurgaon, Haryana, India TALENTOLA SOLUTIONS PRIVATE LIMITED Full time

    Job Description :Key Responsibilities :- Team Leadership : Lead, mentor, and grow a team of data engineers, fostering a culture of excellence, collaboration, and continuous improvement.- Data Pipeline Development : Oversee the design, development, and maintenance of robust ETL and ELT pipelines to ingest, transform, and process data efficiently.- Cloud Data...

  • Data Engineering Team Lead

    4 days ago

    Gurgaon, Haryana, India Metyis Full time

    Required Skills and Qualifications7-10 years of professional hands-on experience in software engineering.A broad practice in multiple software engineering fields.Experience in managing and leading data engineering/warehousing projects.The ideal candidate will have a strong background in software engineering and experience in managing and leading data...

  • Lead Data Engineer

    3 weeks ago

    Gurgaon, Haryana, India IGT Solutions Full time

    Role: Lead Data EngineerPrimary Skills: Python, Pyspark, AWS Glue, EMR, Lambda, Snowflake, ETL, PLSQL Experience: - 7+ YearsLocation: - RemoteNotice period: - Immediate JoinerJob Overview: We are seeking a skilled and experienced Lead Data Engineer to join our data engineering team. The ideal candidate will have over 8 years of hands-on experience designing,...

  • Lead Data Engineer

    3 weeks ago

    Gurgaon, Haryana, India IGT Solutions Full time

    Role: Lead Data EngineerPrimary Skills: Python, Pyspark, AWS Glue, EMR, Lambda, Snowflake, ETL, PLSQL Experience: - 7+ YearsLocation: - RemoteNotice period: - Immediate JoinerJob Overview: We are seeking a skilled and experienced Lead Data Engineer to join our data engineering team. The ideal candidate will have over 8 years of hands-on experience designing,...

  • Lead Data Engineer

    2 weeks ago

    Gurgaon, Haryana, India Antal International Full time

    Job Title - Lead Data Engineer Key Skills - Azure Data Factory Data Warehousing SQL SSIS Experience - 8 to 12 Years Location - Gurugram Gurgaon Industry - Insurance NP - Immediate to 30 Days Education B Tech or equivalent qualificationTechnical Expertise Should have experience of working on Microsoft Azure tools like Spark Databrick Synapse ...

  • Lead Data Engineer

    3 weeks ago

    Gurgaon, Haryana, India Sound of the Sun Full time

    Job Title : Data Engineer. Contract Duration : 12 months. Total Experience Required : 5-9 years. Relevant Experience Required : 5+ years. Job Description :We are seeking experienced Data Engineers to join our team for a 12-month contract position. As a Data Engineer, you will play a key role in the development, deployment, and management of data engineering...

  • Lead Data Engineer

    2 weeks ago

    Gurgaon, Haryana, India Sound of the Sun Full time

    Job Title : Data Engineer. Contract Duration : 12 months. Total Experience Required : 5-9 years. Relevant Experience Required : 5+ years. Job Description :We are seeking experienced Data Engineers to join our team for a 12-month contract position. As a Data Engineer, you will play a key role in the development, deployment, and management of data engineering...

  • Lead Data Engineer

    2 weeks ago

    Gurgaon, Haryana, India MakeMyTrip Full time

    Position: Lead Data Engineer Experience: Must have 6+ years of experience About Role: We are looking for experienced Data engineers with excellent problem-solving skills to develop machine-learning powered Data Products designed to enhance customer experiences. About us: Nurtured from the seed of a single great idea - to empower the traveler - MakeMyTrip...