Data Engineering Lead

5 days ago


India Nexionpro Full time
Nexionpro is seeking a highly skilled Data Engineering Lead to join our team. As a key member of our data engineering group, you will be responsible for designing and developing efficient and scalable ETL pipelines on AWS EMR using Python and PySpark.

We are looking for an experienced professional with a strong background in data engineering and a proven track record of delivering high-quality solutions. The ideal candidate will have hands-on experience with frameworks such as PySpark, and be proficient in leveraging Python for complex data processing tasks.

The role requires an expert understanding of SAS SQL logic, along with the ability to convert it into Python code effectively. Key Responsibilities:
  • Design and Develop ETL Pipelines: Lead the development of efficient and scalable ETL pipelines on AWS EMR using Python and PySpark.
  • SAS to Python Translation: Convert and optimize complex SAS SQL logic into Python code, ensuring high performance and maintainability.
  • Data Transformation: Work with large data sets to transform raw data into meaningful insights and ensure the integrity and accuracy of the transformed data.

Required Skills & Experience:
  • Experience: 8 years of hands-on experience in Python development, particularly in data engineering and building ETL pipelines.
  • Strong knowledge of AWS EMR, PySpark, and related cloud technologies.
  • Experience working with large datasets and data warehouses.
  • Proficiency in converting SAS SQL logic into Python code.
  • In-depth knowledge of SQL, including complex data queries and optimization.


  • India ENABLE DATA TECHNOLOGIES PRIVATE LIMITED Full time

    **Job Description:**We're looking for a seasoned Senior Spark/Java Developer to join our team at Enable Data Technologies Private Limited.This role requires a deep understanding of software engineering principles, particularly in designing and developing large-scale data processing systems using Spark-based frameworks.As a member of our team, you'll work...


  • India HNM Solutions Full time

    Data Engineering LeadHNM Solutions is seeking a highly experienced Data Engineering Lead to lead our data engineering team. As a key member of our leadership team, you will be responsible for leading the design, development, and deployment of our data engineering pipelines.The successful candidate will have a strong background in data engineering, including...


  • India D2N Solutions Full time

    Data Engineering Lead Job SummaryWe are seeking a Data Engineering Lead to lead our team in designing and implementing data engineering solutions on Google Cloud Platform (GCP). As a Data Engineering Lead, you will be responsible for leading a team of engineers in developing and deploying data engineering solutions that meet the organization's technical and...


  • India Dhwani Rural Information Systems Full time

    Dhwani Rural Information Systems is on the lookout for an experienced Data Engineering Lead to spearhead our data engineering efforts. This role will involve designing and implementing scalable data architectures, leading a team of data engineers, and collaborating with cross-functional teams to drive business growth.About the Role:Design and implement...

  • Lead Data Engineer

    1 week ago


    India Founding Teams Full time

    Company DescriptionFoundingTeams.ai is an AI accelerator and talent platform. We enable AI and Tech founders to hire commercial and technical teams for their startups. We also hold a demo day in front of Angel and VC investors.We work with startups from top accelerators like Ycombinator and TechStars. We are currently hiring for avsolutions.org.uk . This is...

  • Lead Data Engineer

    1 week ago


    India Founding Teams Full time

    Company Overview Founding Teams.ai is an AI accelerator and talent platform. We enable AI and tech founders to hire commercial and technical teams for their startups, as well as host demo days in front of angel and VC investors. We work with startups from top accelerators like Y Combinator and TechStars, and are currently partnering with avsolutions.org.uk,...


  • India Quadrangle Full time

    **Job Overview at Quadrangle**We are seeking a highly skilled Data Engineering Manager to lead our data engineering team and drive the design, development, and implementation of our data models.Maintain and improve existing systemsDevelop new solutions to meet business needsCollaborate with stakeholders to identify data requirementsEnsure data quality and...


  • India TALENTOLA SOLUTIONS PRIVATE LIMITED Full time

    Job OverviewTalentola Solutions Private Limited is seeking an experienced Data Engineering Lead to spearhead the design, development, and maintenance of robust ETL and ELT pipelines. The ideal candidate will have a strong background in cloud-based data platforms like Snowflake and a passion for building scalable data solutions.As a Data Engineering Lead, you...


  • India AMBIENCE HR LLP Full time

    About the RoleWe are looking for an experienced Data Engineer to lead our data engineering efforts. As a Data Engineer Lead, you will be responsible for designing and implementing data architecture and infrastructure to support business needs.You will develop and maintain scalable data pipelines, ensuring high-quality data delivery and supporting advanced...


  • India MindBrain Full time

    Job Title: Data Engineering LeadMindBrain is seeking a seasoned Data Engineering Lead to spearhead the development and maintenance of our data pipelines and ETL processes in cloud environments.Key Responsibilities:Design, develop, and optimize ETL/ELT pipelines using Informatica IICS and Snowflake.Implement data integration solutions ensuring high...


  • India SMARTWORK IT SERVICES Full time

    About the RoleWe are seeking an experienced Data Engineering Lead to join our team at SMARTWORK IT SERVICES. This role will involve driving innovation, operational excellence, and strategic growth within Data Engineering & Analytics programs.Manage large and complex programs encompassing multiple Data, BI, and AI/ML solutions.Lead the design, development,...

  • Lead Data Engineer

    5 days ago


    India Decision Point Full time

    Job Description : What would a typical day at your work be like? - You will lead and manage the delivery of projects and be responsible for the delivery of project and team goals. - Build & support data ingestion and processing pipelines. - This will entail extract, load and transform of data from a wide variety of sources using latest data frameworks and...


  • India Orion Innovation Full time

    Orion Innovation is a leading digital transformation and product development services firm. Our global team of 6,000 associates delivers transformative business solutions rooted in digital strategy, experience design, and engineering. We empower our clients to operate with agility on a scale.Job DescriptionLead the design, architecture, and implementation of...

  • Lead Data Engineer

    3 days ago


    India Falcon Full time

    Key Responsibilities : Data Engineering & Architecture : - Design and implement scalable, high-performance data pipelines on AWS. - Optimize ETL/ELT processes using AWS Glue, Apache Spark, EMR, and Lambda. - Build and maintain data lakes and warehouses (Redshift, Snowflake). - Ensure data governance, security, and compliance best practices. Technical...

  • Lead Data Engineer

    5 days ago


    India TALENTOLA SOLUTIONS PRIVATE LIMITED Full time

    Title - Sr. Engineering Manager - Data Engineering Overview : We are looking for an experienced Engineering Manager with a strong background in Data Engineering - ETL / ELT processes, cloud-based data platforms like Snowflake, and have a passion for building scalable data solutions. As an Engineering Manager, you will guide the team, oversee data...

  • Lead Data Engineer

    6 days ago


    India Orion Innovation Full time

    Work Location : Kochi, Chennai, Coimbatore Who are we : Orion is a leading digital transformation and product development services firm. Headquarters in Edison, NJ, we have a global team of 6,000 associates, with engineers in 12 major delivery centers across North America, Europe, Asia and Latin America. For over 25 years. In India, our delivery centers are...


  • India NTT DATA Full time

    Position Summary:We are looking for a talented Cloud Engineer to join our team at NTT DATA. The successful candidate will be responsible for designing and implementing data warehousing solutions using Redshift, Airflow, and Python. Responsibilities:Design and implement data warehousing solutions using Redshift and Airflow.Develop and maintain complex data...

  • Lead Data Engineer

    6 days ago


    India Kadel Labs Private Limited Full time

    Role : Lead Data Engineer Kadel Labs is a first-of-its-kind Venture Studio in India. It is a global software technology system incubator with synergistic blend of IT Services and SaaS products under its portfolio. Since 2017, KL has grown organically (180 employees and expanding) and served 200 Customers. At the core, KL is a people's company. We serve...

  • Lead Data Engineer

    6 days ago


    India BlueByte Technologies Full time

    Job Description : - Lead and mentor a team while remaining hands-on with development and problem-solving. - Work closely with stakeholders to understand business requirements and translate them into technical solutions. - Design, develop, and optimize complex SQL queries for data extraction, transformation, and analysis. - Utilize Python for automation,...

  • Data Engineer Lead

    6 days ago


    India Hunarstreet Technologies Full time

    Job DescriptionHunarstreet Technologies is seeking a highly skilled Data Engineer Lead to join our team. As a key member of our data engineering team, you will be responsible for designing and building parts of our data pipeline architecture using the latest Big Data technologies.Key Responsibilities:- Design and build scalable data pipelines for extraction,...