Lead Data Engineer

6 days ago

India BlueByte Technologies Full time

Job Description : - Lead and mentor a team while remaining hands-on with development and problem-solving. - Work closely with stakeholders to understand business requirements and translate them into technical solutions. - Design, develop, and optimize complex SQL queries for data extraction, transformation, and analysis. - Utilize Python for automation, scripting, and data processing. - Leverage Google Cloud Platform (GCP) services for data storage, processing, and analytics. - Participate in code reviews, ensure best practices, and optimize data workflows. - Troubleshoot and resolve performance bottlenecks in SQL queries and data pipelines. Required Skills : - Strong communication skills - ability to interact with stakeholders, lead discussions, and present insights. - Expertise in SQL - deep understanding of database design, query optimization, and performance tuning. - Hands-on leadership - ability to guide the team while contributing actively to development. - Proficiency in Python - for scripting, data processing, and automation tasks. - Good to have Knowledge of GCP services - BigQuery, Cloud Storage, Dataflow, Pub/Sub, etc. - Experience in migration projects (preferred) - especially from on-prem to cloud. Responsibilities : - Lead and manage the design, development, and implementation of scalable data pipelines and data models for both batch and real-time processing. - Develop and optimize ETL processes to collect, transform, and store data from multiple sources into the company's data warehouse or data lake. - Work with teams to ensure the efficient integration of data sources, providing end-to-end solutions that support analytics and reporting needs. - Design and implement strategies for data governance, security, and quality assurance to ensure compliance and data integrity. - Build and manage data infrastructure (data lakes, data warehouses, cloud platforms like AWS, GCP, Azure) ensuring optimal performance, scalability, and cost-efficiency. - Mentor and guide a team of data engineers, fostering a collaborative environment and promoting best practices in coding, architecture, and development. - Optimize database queries and data processing pipelines to enhance performance and reduce costs. - Troubleshoot and resolve data issues, collaborating with data scientists, product managers, and IT teams. - Implement and maintain continuous integration/continuous deployment (CI/CD) pipelines for data engineering projects. - Stay up to date with industry trends and best practices, driving innovation in data engineering practices. Requirements : - 8 years of experience in data engineering, data architecture, or a related field. - Strong proficiency in programming languages such as Python, Java, or Scala. - Expertise in designing and optimizing large-scale data pipelines and ETL processes. - Hands-on experience with cloud platforms (AWS, Google Cloud, Azure) and big data technologies (e.g., Hadoop, Spark, Kafka). - Advanced knowledge of relational databases (e.g., PostgreSQL, MySQL) and NoSQL databases (e.g., MongoDB, Cassandra). - Familiarity with data warehousing solutions (e.g., Snowflake, Redshift, BigQuery). - Strong understanding of data modeling, data governance, and data security practices. - Experience with version control systems (e.g., Git) and CI/CD tools. - Proven leadership experience, with the ability to mentor junior team members and collaborate effectively with cross-functional teams. - Excellent problem-solving, analytical, and communication skills. (ref:hirist.tech)

  • Data Engineering Lead

    7 days ago

    India ENABLE DATA TECHNOLOGIES PRIVATE LIMITED Full time

    **Job Description:**We're looking for a seasoned Senior Spark/Java Developer to join our team at Enable Data Technologies Private Limited.This role requires a deep understanding of software engineering principles, particularly in designing and developing large-scale data processing systems using Spark-based frameworks.As a member of our team, you'll work...

  • Data Engineering Lead

    6 days ago

    India HNM Solutions Full time

    Data Engineering LeadHNM Solutions is seeking a highly experienced Data Engineering Lead to lead our data engineering team. As a key member of our leadership team, you will be responsible for leading the design, development, and deployment of our data engineering pipelines.The successful candidate will have a strong background in data engineering, including...

  • Data Engineering Lead

    1 day ago

    India D2N Solutions Full time

    Data Engineering Lead Job SummaryWe are seeking a Data Engineering Lead to lead our team in designing and implementing data engineering solutions on Google Cloud Platform (GCP). As a Data Engineering Lead, you will be responsible for leading a team of engineers in developing and deploying data engineering solutions that meet the organization's technical and...

  • Data Engineering Lead

    4 days ago

    India Dhwani Rural Information Systems Full time

    Dhwani Rural Information Systems is on the lookout for an experienced Data Engineering Lead to spearhead our data engineering efforts. This role will involve designing and implementing scalable data architectures, leading a team of data engineers, and collaborating with cross-functional teams to drive business growth.About the Role:Design and implement...

  • Lead Data Engineer

    1 week ago

    India Founding Teams Full time

    Company DescriptionFoundingTeams.ai is an AI accelerator and talent platform. We enable AI and Tech founders to hire commercial and technical teams for their startups. We also hold a demo day in front of Angel and VC investors.We work with startups from top accelerators like Ycombinator and TechStars. We are currently hiring for avsolutions.org.uk . This is...

  • Lead Data Engineer

    1 week ago

    India Founding Teams Full time

    Company Overview Founding Teams.ai is an AI accelerator and talent platform. We enable AI and tech founders to hire commercial and technical teams for their startups, as well as host demo days in front of angel and VC investors. We work with startups from top accelerators like Y Combinator and TechStars, and are currently partnering with avsolutions.org.uk,...

  • Data Engineering Lead

    6 days ago

    India Quadrangle Full time

    **Job Overview at Quadrangle**We are seeking a highly skilled Data Engineering Manager to lead our data engineering team and drive the design, development, and implementation of our data models.Maintain and improve existing systemsDevelop new solutions to meet business needsCollaborate with stakeholders to identify data requirementsEnsure data quality and...

  • Data Engineering Lead

    5 days ago

    India TALENTOLA SOLUTIONS PRIVATE LIMITED Full time

    Job OverviewTalentola Solutions Private Limited is seeking an experienced Data Engineering Lead to spearhead the design, development, and maintenance of robust ETL and ELT pipelines. The ideal candidate will have a strong background in cloud-based data platforms like Snowflake and a passion for building scalable data solutions.As a Data Engineering Lead, you...

  • Data Engineering Lead

    6 days ago

    India AMBIENCE HR LLP Full time

    About the RoleWe are looking for an experienced Data Engineer to lead our data engineering efforts. As a Data Engineer Lead, you will be responsible for designing and implementing data architecture and infrastructure to support business needs.You will develop and maintain scalable data pipelines, ensuring high-quality data delivery and supporting advanced...

  • Data Engineering Lead

    7 days ago

    India MindBrain Full time

    Job Title: Data Engineering LeadMindBrain is seeking a seasoned Data Engineering Lead to spearhead the development and maintenance of our data pipelines and ETL processes in cloud environments.Key Responsibilities:Design, develop, and optimize ETL/ELT pipelines using Informatica IICS and Snowflake.Implement data integration solutions ensuring high...

  • Data Engineering Lead

    6 days ago

    India SMARTWORK IT SERVICES Full time

    About the RoleWe are seeking an experienced Data Engineering Lead to join our team at SMARTWORK IT SERVICES. This role will involve driving innovation, operational excellence, and strategic growth within Data Engineering & Analytics programs.Manage large and complex programs encompassing multiple Data, BI, and AI/ML solutions.Lead the design, development,...

  • Lead Data Engineer

    5 days ago

    India Decision Point Full time

    Job Description : What would a typical day at your work be like? - You will lead and manage the delivery of projects and be responsible for the delivery of project and team goals. - Build & support data ingestion and processing pipelines. - This will entail extract, load and transform of data from a wide variety of sources using latest data frameworks and...

  • Data Engineering Lead

    5 days ago

    India Nexionpro Full time

    Nexionpro is seeking a highly skilled Data Engineering Lead to join our team. As a key member of our data engineering group, you will be responsible for designing and developing efficient and scalable ETL pipelines on AWS EMR using Python and PySpark.We are looking for an experienced professional with a strong background in data engineering and a proven...

  • Data Engineering Lead

    6 days ago

    India Orion Innovation Full time

    Orion Innovation is a leading digital transformation and product development services firm. Our global team of 6,000 associates delivers transformative business solutions rooted in digital strategy, experience design, and engineering. We empower our clients to operate with agility on a scale.Job DescriptionLead the design, architecture, and implementation of...

  • Lead Data Engineer

    3 days ago

    India Falcon Full time

    Key Responsibilities : Data Engineering & Architecture : - Design and implement scalable, high-performance data pipelines on AWS. - Optimize ETL/ELT processes using AWS Glue, Apache Spark, EMR, and Lambda. - Build and maintain data lakes and warehouses (Redshift, Snowflake). - Ensure data governance, security, and compliance best practices. Technical...

  • Lead Data Engineer

    5 days ago

    India TALENTOLA SOLUTIONS PRIVATE LIMITED Full time

    Title - Sr. Engineering Manager - Data Engineering Overview : We are looking for an experienced Engineering Manager with a strong background in Data Engineering - ETL / ELT processes, cloud-based data platforms like Snowflake, and have a passion for building scalable data solutions. As an Engineering Manager, you will guide the team, oversee data...

  • Lead Data Engineer

    6 days ago

    India Orion Innovation Full time

    Work Location : Kochi, Chennai, Coimbatore Who are we : Orion is a leading digital transformation and product development services firm. Headquarters in Edison, NJ, we have a global team of 6,000 associates, with engineers in 12 major delivery centers across North America, Europe, Asia and Latin America. For over 25 years. In India, our delivery centers are...

  • Lead Data Engineer

    6 days ago

    India Kadel Labs Private Limited Full time

    Role : Lead Data Engineer Kadel Labs is a first-of-its-kind Venture Studio in India. It is a global software technology system incubator with synergistic blend of IT Services and SaaS products under its portfolio. Since 2017, KL has grown organically (180 employees and expanding) and served 200 Customers. At the core, KL is a people's company. We serve...

  • Data Engineer Lead

    6 days ago

    India Hunarstreet Technologies Full time

    Job DescriptionHunarstreet Technologies is seeking a highly skilled Data Engineer Lead to join our team. As a key member of our data engineering team, you will be responsible for designing and building parts of our data pipeline architecture using the latest Big Data technologies.Key Responsibilities:- Design and build scalable data pipelines for extraction,...

  • Data Engineering Leader for BI Solutions

    5 days ago

    India NTT DATA Full time

    Position Summary:We are looking for a talented Cloud Engineer to join our team at NTT DATA. The successful candidate will be responsible for designing and implementing data warehousing solutions using Redshift, Airflow, and Python. Responsibilities:Design and implement data warehousing solutions using Redshift and Airflow.Develop and maintain complex data...