Lead Data Engineer

1 month ago


delhi, India Recro Full time
Position: Data Engineer(Lead)
Location: WFO-Bangalore
Experience Level: 8+ years
Job Description:
Summary:
We're seeking a highly skilled and experienced Big Data Architect to join our innovative and dynamic team. You'll play a pivotal role in designing, building, and maintaining our scalable big data infrastructure. The ideal candidate will be a passionate problem-solver with a proven track record of developing robust data pipelines and architecting data products across diverse architectures.
Responsibilities:
Design and architect big data solutions leveraging distributed platforms (e.g., Spark, EMR) to meet complex business needs.
Partner with data scientists, analysts, and software engineers to understand data requirements and propose innovative data solutions.
Develop, implement, and manage high-performing data pipelines for ingesting, transforming, and delivering data into our data warehouse and data lake.
Champion data quality by implementing robust data cleansing, transformation, and enrichment processes.
Continuously monitor and optimize data pipelines for peak performance, scalability, and cost-effectiveness.
Integrate security best practices into data pipelines and ensure data protection measures are in place.
Troubleshoot and debug complex data pipeline issues, performance bottlenecks, and data quality problems.
Advocate for and contribute to improvements in the overall data engineering process.
Foster a collaborative environment by mentoring and developing other data engineers in adopting best practices.
Attributes & Qualifications:
Technical Skills:
8+ years of experience in developing and architecting scalable big data applications or solutions.
Expertise in distributed processing frameworks like Spark (Python, Scala).
Experience with cloud platforms for data engineering (AWS S3, Managed Airflow, EMR/EC2, IAM etc. preferred).
Experience with data pipeline orchestration tools (Airflow, Jenkins) and CI/CD practices.
Proficiency in SQL databases (Presto, Snowflake) and data warehousing concepts.
Experience architecting data products in streaming, serverless, and microservices architectures.
Experience with Data Lakehouse architecture (e.g., Databricks Delta Lake, Medallion).
Strong understanding of data governance, data modeling, and data quality frameworks.
Familiarity with reporting and analytical tools (Tableau, Quicksight).
Soft Skills:
Excellent problem-solving skills with a keen eye for detail.
Strong communication and collaboration skills across technical and non-technical audiences.
Ability to work independently and as part of a fast-paced, Agile/Scrum development team.
Passion for data, a continuous learning mindset, and a willingness to learn new technologies.

  • Delhi, India Data Engineer Academy Full time

    Job Title: Operations AnalystLocation : RemoteCompany Overview:Data Engineering Academy is a pioneering force in data engineering education, founded by FAANG data engineers with extensive industry expertise. Our platform provides comprehensive programs tailored to empower aspiring data engineers, equipping them with the skills and confidence necessary to...


  • Delhi, India Data Engineer Academy Full time

    Job Title: Operations AnalystLocation : RemoteCompany Overview:Data Engineering Academy is a pioneering force in data engineering education, founded by FAANG data engineers with extensive industry expertise. Our platform provides comprehensive programs tailored to empower aspiring data engineers, equipping them with the skills and confidence necessary to...


  • Delhi, India Data Engineer Academy Full time

    Job Title: Operations AnalystLocation : RemoteCompany Overview:Data Engineering Academy is a pioneering force in data engineering education, founded by FAANG data engineers with extensive industry expertise. Our platform provides comprehensive programs tailored to empower aspiring data engineers, equipping them with the skills and confidence necessary to...

  • Lead data engineer

    3 hours ago


    delhi, India USEReady Full time

    Useready is hiring for Lead Data Engineer(Bangalore/Mohali/Gurugram)Job DescriptionMentor a team of developers in building and maintaining high-quality, scalable, and secure data pipelines and analytics applications on the Databricks platformWork closely with data engineers, business stakeholders to understand their needs and design and develop solutions...

  • Lead Data Engineer

    4 days ago


    Delhi, India Orion Innovation Full time

    As a Lead Data Engineer, you will play a crucial role in designing, developing, and maintaining our data infrastructure. You will lead a team of data engineers to ensure the successful delivery of projects and contribute to the overall data strategy. The ideal candidate will have extensive experience in cloud-based data technologies, particularly in Azure,...

  • Lead Data Engineer

    3 hours ago


    delhi, India Digitas India Full time

    Role- Lead Data EngineerExperience - 6 +YearsLocations- Mumbai/Pune/AhmedabadOverview: As a Lead Data Engineer, you will play a pivotal role in designing, implementing, and managing complex data pipelines within Google Cloud Platform (GCP) & AWS . Your expertise in integrating SAP, Salesforce and other cloud databases and marketing platforms , will be...

  • Data Engineer

    1 month ago


    Delhi, India dentsu Full time

    The purpose of this role is to maintain, improve, clean and manipulate data in the business’s operational and analytics databases. The Data Engineer works with the business’s software engineers, data analytics teams, data scientists and data warehouse engineers in order to understand and aid in the implementation of database requirements, analyse...


  • delhi, India Lapis Data Analytics Full time

    Company DescriptionLapis Data Analytics is a dynamic and innovative data engineering company founded in 2020 and located in Chennai. Our primary focus is on designing, building, and maintaining robust data pipelines that convert raw data into actionable insights. With a team of seasoned experts and cutting-edge technology, we deliver customized data...


  • Delhi, India Chryselys Full time

    Job Description:As a Data Engineering Lead, you will play a critical role in driving the delivery for our clients data projects. Leveraging your expertise in data engineering and data operations, you will work closely with clients to ensure that the project delivery on time with quality and meeting the requirements. This role requires a deep understanding of...


  • Delhi, Delhi, India NTT DATA Services Full time

    Req ID: NTT DATA Services strives to hire exceptional, innovative and passionate individuals who want to grow with us. If you want to be part of an inclusive, adaptable, and forward-thinking organization, apply now.We are currently seeking a Senior Lead Engineer to join our team in Delhi, Delhi (IN-DL), India (IN).Note- The preference here is for any good...


  • Delhi, India IntraEdge Full time

    As Azure Lead Data Engineer, you will have to take over the key activities of designing, coding, and implementing data solutions in the platform. With a focus on leveraging DBT for data transformation and modelling, as well as expertise in MDM tools, you will play a pivotal role in architecting scalable and performant data pipelines and warehouses. You will...


  • Delhi, India NTT DATA Services Full time

    Req ID: 272900  NTT DATA Services strives to hire exceptional, innovative and passionate individuals who want to grow with us. If you want to be part of an inclusive, adaptable, and forward-thinking organization, apply now. We are currently seeking a Senior Lead Engineer to join our team in Delhi, Delhi (IN-DL), India (IN). Note- The...

  • Lead Data Engineer

    1 month ago


    Delhi, India Pro5.ai (formerly Mangtas) Full time

    Job Description :Technical delivery lead on platform and project builds for building and maintaining optimised and highly available data pipelines that facilitate data management and data analytics solutions.The role will drive the development of data processing frameworks and data architectural approaches that scale to handle the business’s growing...


  • new delhi, India Concentrix Full time

    Experience: 6 Years - 10 YearsJob Location: Bengaluru (Hybrid- currently remote)Notice Period: Immediate/ 30 Days (Looking for someone to start from May or Mid June)Shift Timings: 02:00 PM to 11:00 PM (IST)/ 03:00 PM to 12:00 AM (IST)Job Description:We are seeking an experienced and talented Data Engineering Team Lead who can manage a high-performing...


  • delhi, India EXL Full time

    Position - Lead Data EngineerWork Location – Pune/ Hyderabad / Gurgaon / HybridExperience - 9+ YearsMust have Skills:Minimum 5+ years on Azure cloud services.Proficiency in using Azure Synapse, Azure Storage, and Azure Data Factory for building data solutions.Strong understanding of metadata-driven approaches and data governance principles.Excellent...

  • Lead Data Engineer

    2 weeks ago


    Delhi, India Coders Connect Full time

    Job DescriptionCoders ConnectandSanofiare joining forces to bring an electrifying twist to the bio pharmaceutical world! Work with a rhythm that suits your style (2 days remote and 3 days onsite magic).Language:Proficiency in English is required for this role to ensure effective communication within our diverse, global team.About Sanofi:We're not just a...


  • Delhi, India Apolis Consulting Pvt Ltd Full time

    Apolis is actively looking to hire a Data QA Lead & Data QA Engineer role to join our team. This will be 4-6 months contractual role. Location: RemoteJob descriptionData QA Testing (1-Lead and 5- Data QA Tester)PST 3 hours overlaps-Rest are flexible.4-6 months- Contractors.Must have done Data ValidationMust have Data QA experience.Working with high volumes...


  • delhi, India EXL Full time

    As a Lead GCP Data Engineer, you will be responsible for data migration, transformation or modernization on Google Cloud Platform (GCP) integrating native GCP services and other 3rd party data solutions. You will collaborate with cloud partners and our cross-functional teams to enable sector-specific use cases. Your responsibilities will involve technology...

  • Lead Data Engineer

    2 weeks ago


    delhi, India EXL Full time

    Must have:Experience: 5+ years5/6+ years of experience in Data Engineering, Architecture & Solutioning areas in large-scale distributed systems3+ years of experience across Cloud Platforms, AWS preferred.2+ years of experience in creating solutions for clients/productsHands on coding experience in Oracle / Teradata / SQL Server platform.Hands on coding...

  • Lead Data Engineer

    2 weeks ago


    delhi, India Akivna Technologies Pvt. Ltd. Full time

    Company DescriptionAkivna Technologies Pvt. Ltd. is an IT company based in Gurugram. We specialize in Data Engineering, Data Science, Data Analytics, DevOps, and Product Development. Our team is passionate about technology and we strive to deliver innovative and high-quality solutions to our clients.Job Description:We are seeking a skilled and experienced...