Lead Data Engineer

4 weeks ago


Delhi, India NorthBay Solutions Full time
Northbay Solutions is presently in search of a Cloud Data Lead with 8 to 10 years of experience, possessing expertise in AWS, to become a valuable addition to our growing team of analytics specialists. The ideal candidate enjoys tackling intricate problems across a wide range of technologies, is passionate about experimentation, and is seeking a new challenge that pushes the boundaries of their skills. The selected candidate should possess the capability to create and uphold data analytic roadmaps and structures that align with business and technology goals. Demonstrating a natural inquisitiveness and a willingness to delve into underlying data for valuable insights, the candidate will collaborate with functional areas to drive actionable outcomes. Responsibilities for the selected candidate include leading and enhancing both data architecture and pipelines, with a substantial demand for their vital role in optimizing data flow and collection across various teams and products. Objectives of this role Develop and implement pipelines that extract, transform, and load data into an information product that helps the organization reach its strategic goals Focus on ingesting, storing, processing, and analyzing large datasets Create scalable, high-performance web services for tracking data Translate complex technical and functional requirements into detailed designs

Investigate alternatives for data storing and processing to ensure the implementation of the most streamlined solutions Responsibilities Develop and maintain data pipelines using ETL processes Ensure conformity with data security and privacy best practices, access control, data-versioning, and regulatory compliance within AWS environments. Work closely with the data science team to implement data analytics pipelines

Work closely with DevOps professionals to incorporate and deploy solutions based on AWS, guaranteeing reliability, scalability, and optimizing performance. Analyze the vast number of data stores to uncover insights Focus on ingesting, storing, processing, and analyzing large datasets Investigate alternatives for data storing and processing to ensure the implementation of the most streamlined solutions Capability to comprehend and express requirements to both technical and non-technical audiences. Proficient in stakeholder management and communication, involving prioritization, problem-solving, and building interpersonal relationships. Convert business requirements into technical specifications and supervise the implementation of solutions based on AWS, collaborating closely with cross-functional teams. Create and deploy scalable, secure, and efficient AWS architectures to facilitate machine learning initiatives. Required skills and qualifications Strong SQL writing skills Experience with Python, PySpark, Delta Lake(Must) Experience with streaming frameworks such as Kafka Experience with specialized data architecture (e.g., data lake, lake house, data fabric, data mesh, etc.) Strong data engineering skills with the Amazon cloud platform Demonstrated expertise with AWS services like S3, Lambda, EC2, Redshift/Redshift Spectrum, Glue, EMR, Athena, MSK, DMS, SSM, EventBus, Lake Formation, SageMaker, etc . A strong understanding of data warehousing and data modelling techniques, and ETL processes An in-depth understanding of large-scale data sets, including both structured and unstructured data Knowledge and experience of delivering CI/CD and DevOps capabilities in a data environment Be motivated and passionate about technology. Team player with strong integrity and professionalism who can work well with others in the group. Self-starter with a proven ability to take initiative and strong problem-solving skills. Knowledge of industry-wide visualization and analytics tools (ex: Tableau, etc.) Good interpersonal skills and a positive attitude Should have experience in Jira and Agile development methodologies. Must be open to learning and have the ability to grasp new technologies quickly. Be motivated and passionate about technology. Powered by JazzHR
  • Data Engineer Lead

    4 weeks ago


    Delhi, India Booth and Partners Pte Ltd Full time

    Job DescriptionThis is a remote position.About the Client:They understand your pain. In fact, they've been there. It’s the very reason they built the industry’s first automated data analytics and reporting platform for pharmacy benefit organizations.After spending more than 30 years building manual reports for Payers, PBMs, TPAs, Consultants, and...

  • Data Engineer

    4 weeks ago


    Delhi, India dentsu Full time

    The purpose of this role is to maintain, improve, clean and manipulate data in the business’s operational and analytics databases. The Data Engineer works with the business’s software engineers, data analytics teams, data scientists and data warehouse engineers in order to understand and aid in the implementation of database requirements, analyse...

  • Lead Data Engineer

    4 weeks ago


    delhi, India Solera, Inc. Full time

    About the jobWho We AreSolera, DealerSocket is a global leader in data and software services that strives to transform every touchpoint of the vehicle lifecycle into a connected digital experience. In addition, we provide products and services to protect life’s other most important assets: our homes and digital identities. Today, Solera processes over...

  • Lead Data Engineer

    4 weeks ago


    Delhi, India Solera, Inc. Full time

    About the jobWho We AreSolera, DealerSocketis a global leader in data and software services that strives to transform every touchpoint of the vehicle lifecycle into a connected digital experience. In addition, we provide products and services to protect life’s other most important assets: our homes and digital identities. Today, Solera processes over 300...

  • Lead Data Engineer

    3 weeks ago


    delhi, India Recro Full time

    Position: Data Engineer(Lead)Location: WFO-BangaloreExperience Level: 8+ yearsJob Description:Summary:We're seeking a highly skilled and experienced Big Data Architect to join our innovative and dynamic team. You'll play a pivotal role in designing, building, and maintaining our scalable big data infrastructure. The ideal candidate will be a passionate...

  • Lead Data Engineer

    4 weeks ago


    Delhi, India Pro5.ai (formerly Mangtas) Full time

    Job Description :Technical delivery lead on platform and project builds for building and maintaining optimised and highly available data pipelines that facilitate data management and data analytics solutions.The role will drive the development of data processing frameworks and data architectural approaches that scale to handle the business’s growing...

  • Lead Data Engineer

    4 days ago


    delhi, India Akivna Technologies Pvt. Ltd. Full time

    Company DescriptionAkivna Technologies Pvt. Ltd. is an IT company based in Gurugram. We specialize in Data Engineering, Data Science, Data Analytics, DevOps, and Product Development. Our team is passionate about technology and we strive to deliver innovative and high-quality solutions to our clients.Job Description:We are seeking a skilled and experienced...


  • delhi, India [24]7.ai Full time

    Job Role: Tech Lead – Data EngineeringJob Location: BangaloreWorking: HybridSummary of Essential Job FunctionsDesign, develop, and maintain scalable and efficient data pipelines using Python, Pandas, Spark, and Google Dataflow.Strong background in relational databases such as SQL Server and MySQL along with a deep understanding of the Google Cloud...

  • Lead Data Engineer

    3 weeks ago


    delhi, India EXL Full time

    Location- Gurgaon/ BangaloreExperience- 7Yrs-8 YrsJob SummaryLooking for a versatile professional to join our team in the role of Hybrid Data Engineer and Database Administrator. This position requires a blend of expertise in Data Engineering and Database Administration, with a strong foundation in Oracle DBA roles and a demonstrated transition into data...

  • Data Engineer

    3 weeks ago


    delhi, India Joveo Full time

    We are looking for talented Data Engineers who are passionate about data engineering and have strong experience in building scalable data pipelines. As a Data Engineer at Joveo, you will play a leading role in designing and building datasets that power analytics for teams across Joveo. You will also be working closely with Data Analysts, Data Scientists, and...

  • Data Lead Engineer

    1 month ago


    delhi, India Squareroot Consulting Pvt Ltd Full time

    Job Description : We are seeking a highly skilled and motivated Data Lead with expertise in Spark, Scala, Kafka, Big Data, and Batch Processing. As a Data Lead, you will play a key role in leading and managing the end-to-end data processing pipeline, ensuring the reliability, scalability, and efficiency of our data systems.Experience : 6+ YearsLocation :...

  • Lead Data Analyst

    4 weeks ago


    Delhi, India CES Full time

    Job Role:We are looking for a Lead Data Engineer to join our team.Ideal Candidate:Overall 7+ years of experience.5+ years of experience in Data Engineering / Modelling and SQL.2+ years of experience in in Azure.Design, develop, and maintain data pipelines for ingestion, transformation, and loading of data into Azure Synapse Analytics.Transform and clean the...

  • Data Engineer

    4 weeks ago


    Delhi, India ValueLabs Full time

    Role:Data Engineer with AWSExperience:5-9 yearsNotice Period:Immediate - 10 daysLocation:HyderabadWe are seeking a highly skilled Data Engineer to join our dynamic team.Job DescriptionKey Responsibilities:Develop and maintain data models, data flow diagrams, and other documentation to support the organization's data architecture.Collaborate with...


  • Delhi, India Pro5.ai (formerly Mangtas) Full time

    Job Description:- Technical delivery lead on platform and project builds for building and maintaining optimised and highly available data pipelines that facilitate data management and data analytics solutions.- The role will drive the development of data processing frameworks and data architectural approaches that scale to handle the business’s growing...

  • Data Engineer

    3 days ago


    delhi, India EliteRecruitments Full time

    We are hiring data engineers in Pune/Bangalore with global consulting. They are looking for data engineers with 5+ years of relevant experience.Technical and professional skills:We are looking for a flexible, fast learning, technically strong Data Engineer. Expertise is required in the following fields:Proficient in Cloud Services –AzureBuild ETL and data...

  • Data Engineer

    3 weeks ago


    Delhi, India Cayian India Pvt Limited Full time

    Job DescriptionCayian is a global IT and business service provider that delivers consultancy, capability, and system integration services to our partners. Our unique partner model is optimised to accelerate delivery, continuously improve quality, and drive business growth. Find out more about ushere.The roleAs aData Engineer, you will be a part of our Data...

  • Data Engineer

    1 week ago


    delhi, India NAB Full time

    Consultant - Data Engineer role exists to ensure the delivery of the Right data to the Right customer at the Right time and at the Right Cost using the Right tools and the Right Technology on NAB’s target state Marketing Platforms.You will enable the move, flow and processing of reusable data assets in the Technology and Enterprise Operations space for...

  • Data Lead Engineer

    2 weeks ago


    Bangalore/Delhi, India Squareroot Consulting Pvt Ltd Full time

    Job Description : We are seeking a highly skilled and motivated Data Lead with expertise in Spark, Scala, Kafka, Big Data, and Batch Processing. As a Data Lead, you will play a key role in leading and managing the end-to-end data processing pipeline, ensuring the reliability, scalability, and efficiency of our data systems.Experience : 6+ YearsLocation :...

  • Data Lead Engineer

    4 weeks ago


    Bangalore/Delhi, IN Squareroot Consulting Pvt Ltd Full time

    Job Description :We are seeking a highly skilled and motivated Data Lead with expertise in Spark, Scala, Kafka, Big Data, and Batch Processing. As a Data Lead, you will play a key role in leading and managing the end-to-end data processing pipeline, ensuring the reliability, scalability, and efficiency of our data systems.Experience : 6+ YearsLocation :...


  • Delhi, India NTT DATA Full time

    The role of Critical Facilities Maintenance Engineer is responsible for working with all major systems within a facility or building such as electrical and HVAC systems and performs regular maintenance on all systems. This position performs hands-on operations and maintenance which includes all physical and administrative operations tasks, service, and...