Lead Data Engineer

4 weeks ago


BangaloreAnywhere in IndiaMultiple Locations Live Connections Full time

Role : Lead Data Engineer


Job Description :


Lead Data Engineer, you will play a pivotal role in designing, implementing, and managing complex data pipelines within Google Cloud Platform (GCP) & AWS .


Your expertise in integrating SAP, Salesforce and other cloud databases and marketing platforms , will be crucial in enabling data-driven decision-making processes.

You should have been responsible for the end-to-end execution of at least 1-2 projects, demonstrating a profound ability to navigate through challenges and deliver solutions that drive our business objectives.

Key Responsibilities :

- Design and implement robust, scalable data engineering pipelines within GCP, tailored for web analytics.

- Integrate a variety of marketing & enterprise data sources, including AWS Aurora , SAP and Salesforce ensuring seamless data flow and accessibility.

- Execute at least 1-2 end-to-end data engineering projects, from conceptualization to deployment, demonstrating project management and technical prowess.

- Employ advanced SQL, Python, and Bash scripting to optimize data processing, analysis, and automation tasks.

- Collaborate with cross-functional teams to identify data needs, design solutions, and enhance data-driven decision-making capabilities.

- Maintain and ensure the integrity and reliability of data pipelines, implementing best practices in data security and compliance.

Qualifications :

- Bachelors/ Masters in computer/allied stem engineering fields with relevant 4-6 years of proven experience as a Data Engineer, with a focus on web analytics data engineering pipelines.

- Hands-on experience with GCP & AWS , including its data processing and analytics services (Pubsub , Dataflow, Bigquery , Cloud functions , Cloud run , Bigtable , Glue , Redshift , S3 , SQS etc)

- Strong proficiency in integrating data from diverse sources using API's.

- Advanced knowledge of SQL, Python, and Bash scripting is essential.

- Demonstrated ability to execute end-to-end projects, showcasing effective project management and technical skills.

- Excellent problem-solving abilities, with a keen eye for detail and a commitment to high-quality outcomes.

- Strong communication skills, with the ability to convey complex technical concepts in a clear, concise manner.

(ref:hirist.tech)
  • Lead Data Engineer

    5 days ago


    Anywhere in India/Multiple Locations Pro5.ai (formerly Mangtas) Full time

    Job Description :Technical delivery lead on platform and project builds for building and maintaining optimised and highly available data pipelines that facilitate data management and data analytics solutions. The role will drive the development of data processing frameworks and data architectural approaches that scale to handle the business's growing...

  • Sigmoid Analytics

    2 months ago


    Anywhere in India,Multiple Locations ASTAR DATA LLP Full time

    Job Description : This position will be part of a growing team working towards building world-class large scale Big Data architectures.Responsibilities : Good Development Practices :- Hands-on coder with good experience in programming languages like Python or Scala.- Good Understanding of programming principles and development practices like checkin policy,...

  • Aptus Data Labs

    2 weeks ago


    Anywhere in India/Multiple Locations Aptus Data Labs Full time

    Role - Data Architect/Data Engineer Lead- AWSExp - 8+ YearsLocation - RemoteSkills - Data architecture, Data modelling & design, Data Governance, MDM, Python, SQL, ETL, AWS CloudWe are seeking a highly skilled and experienced Data Architect to join our team. The ideal candidate will have 8+ years of experience in data architecture, with a focus on AWS cloud...

  • Sigmoid Analytics

    2 months ago


    Anywhere in India,Multiple Locations ASTAR DATA LLP Full time

    This position will be part of a growing team working towards building world-class large scale Big Data Good Development Practices:- Hands-on coder with good experience in programming languages like Python or Scala.- Good Understanding of programming principles and development practices like checkin policy, unit testing, code deployment- Self-starter to be...

  • Data Engineering Lead

    4 weeks ago


    Anywhere in India/Multiple Locations VAST Consulting Full time

    Job Description : - Should have 8+ years of working experience.- Bachelor's or Master's degree in Computer Science, Engineering, or related field.- Demonstrated leadership experience leading cross-functional teams in the design and implementation of complex data solutions.- Experience in a data engineering role with strong understanding of graph...


  • Bangalore/Anywhere in India/Multiple Locations TalentPulse Consultant Full time

    Lead ML Engineer Job Description : We are seeking a dynamic Lead ML Engineer to join our team in a remote capacity, operating within the UK shift timings of 2pm to 11pm IST. As the Lead ML Engineer, you will be responsible for leading the development and implementation of machine learning solutions to address complex business challenges.Responsibilities :-...


  • Anywhere in India,Multiple Locations Grownex HR Solution Full time

    Role : Lead Big Data Engineer Work Mode : Remote(5 Days working) The Opportunity - Development team is establishing a new offshore product development team for its partner , that is building next-generation Big Data, Cloud-Based Business Operation Support technology for utilities, retail energy suppliers and Community Choice Aggregators (CCA). The...

  • MLOps Engineer

    2 weeks ago


    Anywhere in India/Multiple Locations GOOGNU DATA SERVICES PRIVATE LIMITED Full time

    Job Description :- Design and Implement MLOps Infrastructure: Build and maintain robust MLOps workflows using Azure Machine Learning and other Azure services to automate machine learning lifecycle from data preparation to model deployment and monitoring.- Collaborate with Cross-Functional Teams: Work closely with data scientists, software developers, and IT...

  • Lead Data Engineer

    3 weeks ago


    Anywhere in India/Multiple Locations Vista Full time

    About you : - Passionate about both Data Engineering and Machine Learning Engineering, you can likewise wear one or the other hat according to what you need to accomplish- Passionate about GenAI an excited to join a Team working on state of the art GenAI topics- Ideate and build data products that drive value for internal and external customers- Write...

  • MAF Group

    22 hours ago


    Anywhere in India/Multiple Locations MAF Group Full time

    Role : Lead Data Analyst (3+ Years) Job Description : We are seeking a highly skilled Lead Data Analyst with extensive experience in Digital Data Analytics, including expertise in Web Analytics using Google and Adobe platforms, as well as proficiency in handling Salesforce data and survey datasets. The ideal candidate should have a solid background in data...

  • Data Engineer

    4 weeks ago


    Anywhere in India/Multiple Locations Paralleldots Full time

    Job Description : As a Senior Data Engineer at ParallelDots, you will be responsible for overseeing the design and development of advanced data solutions. You will work closely with data scientists, analysts, and other stakeholders to ensure that our data infrastructure meets the highest standards of scalability, reliability, and : - Lead the design,...

  • Lead Data Engineer

    3 weeks ago


    Anywhere in India/Multiple Locations SeaCross Recruitment Services Full time

    Job Description : - Ability to support the development of infrastructural components of the LDH stack- Strong coding experience and knowledge of cloud infrastructure, expertise in Python, Spark, SQL (Postgres)- Strong expertise in Azure, Databricks, Gen2 Storage, Terraform- Strong experience working with restful APIs and Event-Driven Architecture - Pub/Sub...

  • PySpark Tech Lead

    2 months ago


    Anywhere in India,Multiple Locations TD Newton & Associates Full time

    Technical Skills :- Extensive experience working on software engineering projects and SDLC- Have worked on various development project as developer and/or lead developer.- Capability to understand and comprehend the solution and create a development framework where all the developers will be contributing.- Should be able to create a Test driven development...

  • Lead Data Engineer

    4 weeks ago


    Bangalore/Anywhere in India/Multiple Locations Boyen Haddin Full time

    Job Description: - 8 - 10+ years' experience in developing scalable Big Data applications or solutions on distributed platforms.- Able to partner with others in solving complex problems by taking a broad perspective to identify.- innovative solutions.- Strong skills building positive relationships across Product and Engineering.- Able to influence and...

  • Data Migration Lead

    4 weeks ago


    Anywhere in India/Multiple Locations Prerak Life Sciences PVT. LTD Full time

    Job Position/Title: Data Migration Lead Job Location: Hyderabad (possibility of remote work) Role: This profile requires the incumbent to have a strong data migration, SQL, API and ETL knowledge and experience. The DM lead will work with technical and non-technical associates in defining business and technical requirements for data migration and design and...

  • Data Engineer

    4 weeks ago


    Anywhere in India/Multiple Locations XANDER CONSULTING AND ADVISORY PRIVATE LIMITED Full time

    Primary Roles and Responsibilities:- Developing Modern Data Warehouse solutions using Databricks and AWS/ Azure Stack- Ability to provide solutions that are forward-thinking in data engineering and analytics space- Collaborate with DW/BI leads to understand new ETL pipeline development requirements.- Triage issues to find gaps in existing pipelines and fix...

  • Lead Data Engineer

    1 month ago


    Bangalore/Anywhere in India/Multiple Locations, IN Lorven Technologies Full time

    Job Description :- Primary skills as Azure ADF, Databricks- Secondary skills as Snowflake and other data engineering technologies.- Proficient in basic and advanced SQL programming concepts (Procedures, Analytical functions etc.)- Good Knowledge and Understanding of Data warehouse concepts (Dimensional Modeling, change data capture, slowly changing...

  • Lead Data Engineer

    1 month ago


    Bangalore,Anywhere in India,Multiple Locations Lorven Technologies Full time

    Job Description : - Primary skills as Azure ADF, Databricks - Secondary skills as Snowflake and other data engineering technologies.- Proficient in basic and advanced SQL programming concepts (Procedures, Analytical functions etc.) - Good Knowledge and Understanding of Data warehouse concepts (Dimensional Modeling, change data capture, slowly changing...


  • Bangalore/Anywhere in India/Multiple Locations Harmony Data Integration Technologies Pvt. Ltd. Full time

    We are looking for Technical Lead to join our OPTIC development team.If you thrive on pushing the boundaries of technology, possess a wealth of experience in full-stack development, and have a knack for turning complex challenges into elegant solutions, then we want to hear from you.As a Lead, you will play a pivotal role in the design, development, and...

  • Lead DevOps Engineer

    4 weeks ago


    Anywhere in India/Multiple Locations Corpxcel Consulting Full time

    Job Description :Our Lead DevOps Engineer - Service Reliability (SRE) will work with key organizational leaders and product owners to identify opportunities and drive technical vision of this SRE team. They will be responsible for technical roadmap and strategies with strong focus to drive operational excellence, improve performance and efficiency of both...