Lead Data Engineer

1 week ago

Delhi, Delhi, India QuEST Global Full time
Applicants can submit CV direct to Email : Sunil Chandran ;

Experience :
Years

Responsibilities:


Design, develop, and maintain scalable and efficient data pipelines to extract, transform, and load (ETL) data from various sources into data lakes and data warehouses.

Design and develop microservices toCollaborate with data scientists, analysts, and cross functional teams to design data models, database schemas and data storage solutions.

Implement data integration and data quality processes to ensure the accuracy and reliability of data for analytics and reporting.
Optimize data storage, processing, and querying performance for large-scale datasets.
Enable advanced analytics and machine learning capabilities on the data platform.
Continuously monitor and improve data quality and data governance practices.
Stay up to date with the latest data engineering trends, technologies, and best practices.

Requirements:


Bachelor's degree in computer science, Engineering, or a related field.8+ of proven experience in data engineering, data warehousing, and ETL processes.

Proficiency in data engineering tools and technologies such as SQL, Python, Spark, Hadoop, DBT, Airflow, Apache Kafka and Presto.

Solid experience with table formats such as Delta Lake or Apache IcebergDesign and development experience with batch and real time streaming infrastructure and workloads.

Solid experience with implementing data lineage, data quality and data observability for Big data workflows.
Solid experience designing and developing microservices and distributed architecture.
Hands-on experience with GCP ecosystem and data lakehouse architectures.
Strong experience with implementing Databricks.
Strong experience with container technologies such as Docker, Kubernetes.
Strong understanding of data modeling, data architecture, and data governance principles.
Excellent experience with DataOps principles and test automation.
Familiarity with data processing and querying using distributed systems and NoSQL databases.
Ability to optimize and tune data processing and storage for performance and cost-efficiency.
Excellent problem-solving skills and the ability to work on complex data engineering challenges.
Strong communication and collaboration skills to work effectively with cross-functional teams.
Previous experience mentoring and guiding junior data engineers is a plus.
Relevant certifications in data engineering or cloud technologies are desirable.

Nice to have:
Experience working in a Data Mesh architecture.
Supply Chain domain experience.

Special requirements

Support US Data platform teamsMonitor and manage platform infrastructureAssist with platform deployment and maintenanceSupport Insights, Control Tower, and other production needsFor Data pipeline automation and efficient data integration

Skills required:
Strong experience with platform support and operations, cloud infrastructure management. Strong understanding of Insights, Control Tower and other products that data platform supports. Expertise with data engineering.

  • Operations Specialist

    1 week ago

    Delhi, Delhi, India Data Engineer Academy Full time

    Job Title: Operations AnalystLocation : RemoteCompany Overview:Data Engineering Academy is a pioneering force in data engineering education, founded by FAANG data engineers with extensive industry expertise. Our platform provides comprehensive programs tailored to empower aspiring data engineers, equipping them with the skills and confidence necessary to...

  • Operations Specialist

    1 week ago

    Delhi, Delhi, India Data Engineer Academy Full time

    Job Title: Operations AnalystLocation : RemoteCompany Overview:Data Engineering Academy is a pioneering force in data engineering education, founded by FAANG data engineers with extensive industry expertise. Our platform provides comprehensive programs tailored to empower aspiring data engineers, equipping them with the skills and confidence necessary to...

  • Lead Data Engineer

    1 week ago

    Delhi, Delhi, India Akivna Technologies Pvt. Ltd. Full time

    Company DescriptionAkivna Technologies Pvt. Ltd. is an IT company based in Gurugram. We specialize in Data Engineering, Data Science, Data Analytics, DevOps, and Product Development. Our team is passionate about technology and we strive to deliver innovative and high-quality solutions to our clients.Job Description:We are seeking a skilled and experienced...

  • Senior Lead Engineer

    1 week ago

    Delhi, Delhi, India NTT DATA Full time

    Job DescriptionReq ID:282068NTT DATA Services strives to hire exceptional, innovative and passionate individuals who want to grow with us. If you want to be part of an inclusive, adaptable, and forward-thinking organization, apply now.We are currently seeking a Senior Lead Engineer to join our team in Delhi, Delhi (IN-DL), India (IN)."Strongly prefer...

  • Lead Engineer

    1 week ago

    Delhi, Delhi, India NTT DATA Full time

    Job DescriptionReq ID:282070NTT DATA Services strives to hire exceptional, innovative and passionate individuals who want to grow with us. If you want to be part of an inclusive, adaptable, and forward-thinking organization, apply now.We are currently seeking a Lead Engineer to join our team in Delhi, Delhi (IN-DL), India (IN)."RPA Consultant (C)Once You Are...

  • Lead Engineer

    1 week ago

    Delhi, Delhi, India NTT DATA Services Full time

    Req ID: NTT DATA Services strives to hire exceptional, innovative and passionate individuals who want to grow with us. If you want to be part of an inclusive, adaptable, and forward-thinking organization, apply now. We are currently seeking a Lead Engineer to join our team in Delhi, Delhi (IN-DL), India (IN). "RPA Consultant (C) Once You Are Here, You Will:...

  • Lead Data Engineer

    1 week ago

    Delhi, Delhi, India Orion Innovation Full time

    As a Lead Data Engineer, you will play a crucial role in designing, developing, and maintaining our data infrastructure. You will lead a team of data engineers to ensure the successful delivery of projects and contribute to the overall data strategy. The ideal candidate will have extensive experience in cloud-based data technologies, particularly in Azure,...

  • Senior Lead Engineer

    1 week ago

    Delhi, Delhi, India NTT DATA Services Full time

    Req ID:283992NTT DATA Services strives to hire exceptional, innovative and passionate individuals who want to grow with us. If you want to be part of an inclusive, adaptable, and forward-thinking organization, apply now.We are currently seeking a Senior Lead Engineer to join our team in Delhi, Delhi (IN-DL), India (IN).Work closely with Enterprise...

  • Senior Lead Engineer

    1 week ago

    Delhi, Delhi, India NTT DATA Services Full time

    Req ID: NTT DATA Services strives to hire exceptional, innovative and passionate individuals who want to grow with us. If you want to be part of an inclusive, adaptable, and forward-thinking organization, apply now.We are currently seeking a Senior Lead Engineer to join our team in Delhi, Delhi (IN-DL), India (IN)."Strongly prefer MuleSoft Developer –...

  • Lead Data Engineer

    1 week ago

    Delhi, Delhi, India Helius Technologies Full time

    Work Location: HyderabadWork Mode : 5 days Work from OfficeWork Timings : 9 am to 6 pmClient: Singapore basedJob Type: 1 year renewable contract (Long Term)Kindly revert with below details in addition to updated resume.Full Name as per the Passport or Aadhar Card :Current SalaryExp SalaryNotice period (availability)Reason for ChangeOk for 1 year renewable...

  • Senior Lead Engineer

    4 weeks ago

    Delhi, Delhi, India NTT DATA Services Full time

    Req ID: NTT DATA Services strives to hire exceptional, innovative and passionate individuals who want to grow with us. If you want to be part of an inclusive, adaptable, and forward-thinking organization, apply now.We are currently seeking a Senior Lead Engineer to join our team in Delhi, Delhi (IN-DL), India (IN).Work closely with Enterprise Integration...

  • Lead Data Engineer

    1 week ago

    Delhi, Delhi, India Helius Technologies Full time

    Work Location:HyderabadWork Mode : 5 days Work from OfficeWork Timings : 9 am to 6 pmClient:Singapore basedJob Type:1 year renewable contract (Long Term)Kindly revert with below details in addition to updated resume.Full Name as per the Passport or Aadhar Card :Current SalaryExp SalaryNotice period (availability)Reason for ChangeOk for 1 year renewable...

  • Lead data engineer

    1 week ago

    Delhi, Delhi, India USEReady Full time

    Userady is currently seeking a Lead Data Engineer for locations in Bangalore, Mohali, and GurugramJob Description:Mentor a team of developers to create and maintain high-quality, scalable, and secure data pipelines and analytics applications on the Databricks platform.Collaborate closely with data engineers and business stakeholders to understand their...

  • Snowflake Data Engineer

    1 week ago

    Delhi, Delhi, India Lapis Data Analytics Full time

    Company DescriptionLapis Data Analytics is a dynamic and innovative data engineering company founded in 2020 and located in Chennai. Our primary focus is on designing, building, and maintaining robust data pipelines that convert raw data into actionable insights. With a team of seasoned experts and cutting-edge technology, we deliver customized data...

  • Senior Lead Engineer

    1 week ago

    Delhi, Delhi, India NTT DATA Services Full time

    Req ID:285016NTT DATA Services strives to hire exceptional, innovative and passionate individuals who want to grow with us. If you want to be part of an inclusive, adaptable, and forward-thinking organization, apply now.We are currently seeking a Senior Lead Engineer to join our team in Delhi, Delhi (IN-DL), India (IN)."The preference here is for a good...

  • Data Lead Engineer

    1 week ago

    Delhi, Delhi, India Squareroot Consulting Pvt Ltd Full time

    Job Description : We are seeking a highly skilled and motivated Data Lead with expertise in Spark, Scala, Kafka, Big Data, and Batch Processing. As a Data Lead, you will play a key role in leading and managing the end-to-end data processing pipeline, ensuring the reliability, scalability, and efficiency of our data systems.Experience : 6+ YearsLocation :...

  • Senior Lead Engineer

    1 week ago

    Delhi, Delhi, India NTT DATA Services Full time

    Req ID: NTT DATA Services strives to hire exceptional, innovative and passionate individuals who want to grow with us. If you want to be part of an inclusive, adaptable, and forward-thinking organization, apply now.We are currently seeking a Senior Lead Engineer to join our team in Delhi, Delhi (IN-DL), India (IN).Note- The preference here is for any good...

  • Senior Lead Engineer

    1 month ago

    Delhi, Delhi, India NTT DATA Services Full time

    Req ID: NTT DATA Services strives to hire exceptional, innovative and passionate individuals who want to grow with us. If you want to be part of an inclusive, adaptable, and forward-thinking organization, apply now.We are currently seeking a Senior Lead Engineer to join our team in Delhi, Delhi (IN-DL), India (IN).Note- The preference here is for any good...

  • Senior Lead Engineer

    4 weeks ago

    Delhi, Delhi, India NTT DATA Services Full time

    Req ID: NTT DATA Services strives to hire exceptional, innovative and passionate individuals who want to grow with us. If you want to be part of an inclusive, adaptable, and forward-thinking organization, apply now.We are currently seeking a Senior Lead Engineer to join our team in Delhi, Delhi (IN-DL), India (IN).Note- The preference here is for any good...

  • Lead Data Engineer

    1 week ago

    Delhi, Delhi, India Coders Connect Full time

    Job DescriptionCoders ConnectandSanofiare joining forces to bring an electrifying twist to the bio pharmaceutical world Work with a rhythm that suits your style (2 days remote and 3 days onsite magic).Language:Proficiency in English is required for this role to ensure effective communication within our diverse, global team.About Sanofi:We're not just a...