Lead Data Engineer

4 weeks ago


BangaloreAnywhere in IndiaMultiple Locations, IN Live Connections Full time

Role : Lead Data Engineer


Job Description :


Lead Data Engineer, you will play a pivotal role in designing, implementing, and managing complex data pipelines within Google Cloud Platform (GCP) & AWS .


Your expertise in integrating SAP, Salesforce and other cloud databases and marketing platforms , will be crucial in enabling data-driven decision-making processes.

You should have been responsible for the end-to-end execution of at least 1-2 projects, demonstrating a profound ability to navigate through challenges and deliver solutions that drive our business objectives.

Key Responsibilities :

- Design and implement robust, scalable data engineering pipelines within GCP, tailored for web analytics.

- Integrate a variety of marketing & enterprise data sources, including AWS Aurora , SAP and Salesforce ensuring seamless data flow and accessibility.

- Execute at least 1-2 end-to-end data engineering projects, from conceptualization to deployment, demonstrating project management and technical prowess.

- Employ advanced SQL, Python, and Bash scripting to optimize data processing, analysis, and automation tasks.

- Collaborate with cross-functional teams to identify data needs, design solutions, and enhance data-driven decision-making capabilities.

- Maintain and ensure the integrity and reliability of data pipelines, implementing best practices in data security and compliance.

Qualifications :

- Bachelors/ Masters in computer/allied stem engineering fields with relevant 4-6 years of proven experience as a Data Engineer, with a focus on web analytics data engineering pipelines.

- Hands-on experience with GCP & AWS , including its data processing and analytics services (Pubsub , Dataflow, Bigquery , Cloud functions , Cloud run , Bigtable , Glue , Redshift , S3 , SQS etc)

- Strong proficiency in integrating data from diverse sources using API's.

- Advanced knowledge of SQL, Python, and Bash scripting is essential.

- Demonstrated ability to execute end-to-end projects, showcasing effective project management and technical skills.

- Excellent problem-solving abilities, with a keen eye for detail and a commitment to high-quality outcomes.

- Strong communication skills, with the ability to convey complex technical concepts in a clear, concise manner.

(ref:hirist.tech)
  • Sigmoid Analytics

    4 weeks ago


    Anywhere in India/Multiple Locations, IN ASTAR DATA LLP Full time

    Job Description :This position will be part of a growing team working towards building world-class large scale Big Data architectures.Responsibilities : Good Development Practices :- Hands-on coder with good experience in programming languages like Python or Scala.- Good Understanding of programming principles and development practices like checkin policy,...

  • Aptus Data Labs

    7 hours ago


    Anywhere in India/Multiple Locations, IN Aptus Data Labs Full time

    Role - Data Architect/Data Engineer Lead- AWSExp - 8+ YearsLocation - RemoteSkills - Data architecture, Data modelling & design, Data Governance, MDM, Python, SQL, ETL, AWS CloudWe are seeking a highly skilled and experienced Data Architect to join our team. The ideal candidate will have 8+ years of experience in data architecture, with a focus on AWS cloud...

  • Sigmoid Analytics

    4 weeks ago


    Anywhere in India/Multiple Locations, IN ASTAR DATA LLP Full time

    This position will be part of a growing team working towards building world-class large scale Big Data Good Development Practices:- Hands-on coder with good experience in programming languages like Python or Scala.- Good Understanding of programming principles and development practices like checkin policy, unit testing, code deployment- Self-starter to be...


  • Bangalore/Anywhere in India/Multiple Locations, IN TalentPulse Consultant Full time

    Lead ML EngineerJob Description :We are seeking a dynamic Lead ML Engineer to join our team in a remote capacity, operating within the UK shift timings of 2pm to 11pm IST.As the Lead ML Engineer, you will be responsible for leading the development and implementation of machine learning solutions to address complex business challenges.Responsibilities :- Lead...

  • MLOps Engineer

    7 hours ago


    Anywhere in India/Multiple Locations, IN GOOGNU DATA SERVICES PRIVATE LIMITED Full time

    Job Description :- Design and Implement MLOps Infrastructure: Build and maintain robust MLOps workflows using Azure Machine Learning and other Azure services to automate machine learning lifecycle from data preparation to model deployment and monitoring.- Collaborate with Cross-Functional Teams: Work closely with data scientists, software developers, and IT...


  • Anywhere in India/Multiple Locations, IN Grownex HR Solution Full time

    Role : Lead Big Data EngineerWork Mode : Remote(5 Days working)The Opportunity - Development team is establishing a new offshore product development team for its partner , that is building next-generation Big Data, Cloud-Based Business Operation Support technology for utilities, retail energy suppliers and Community Choice Aggregators (CCA). The candidate...

  • Lead Data Engineer

    4 days ago


    Anywhere in India/Multiple Locations, IN Vista Full time

    About you :- Passionate about both Data Engineering and Machine Learning Engineering, you can likewise wear one or the other hat according to what you need to accomplish- Passionate about GenAI an excited to join a Team working on state of the art GenAI topics- Ideate and build data products that drive value for internal and external customers- Write quality...

  • Data Engineer

    4 weeks ago


    Anywhere in India/Multiple Locations, IN Paralleldots Full time

    Job Description :As a Senior Data Engineer at ParallelDots, you will be responsible for overseeing the design and development of advanced data solutions. You will work closely with data scientists, analysts, and other stakeholders to ensure that our data infrastructure meets the highest standards of scalability, reliability, and :- Lead the design,...

  • Data Engineer

    4 weeks ago


    Anywhere in India/Multiple Locations, IN Lancesoft India Pvt Ltd Full time

    Hiring for an experienced data engineer to join our team. You will use various methods to transform raw data into useful data systems. For example, you'll create algorithms and conduct statistical analysis. Overall, you'll strive for efficiency by aligning data systems with business goals. To succeed in this data engineering position, you should have...

  • Lead Data Engineer

    1 week ago


    Anywhere in India/Multiple Locations, IN SeaCross Recruitment Services Full time

    Job Description :- Ability to support the development of infrastructural components of the LDH stack- Strong coding experience and knowledge of cloud infrastructure, expertise in Python, Spark, SQL (Postgres)- Strong expertise in Azure, Databricks, Gen2 Storage, Terraform- Strong experience working with restful APIs and Event-Driven Architecture - Pub/Sub or...

  • PySpark Tech Lead

    4 weeks ago


    Anywhere in India/Multiple Locations, IN TD Newton & Associates Full time

    Technical Skills :- Extensive experience working on software engineering projects and SDLC- Have worked on various development project as developer and/or lead developer.- Capability to understand and comprehend the solution and create a development framework where all the developers will be contributing.- Should be able to create a Test driven development...

  • Data Migration Lead

    4 weeks ago


    Anywhere in India/Multiple Locations, IN Prerak Life Sciences PVT. LTD Full time

    Job Position/Title: Data Migration LeadJob Location: Hyderabad (possibility of remote work)Role: This profile requires the incumbent to have a strong data migration, SQL, API and ETL knowledge and experience. The DM lead will work with technical and non-technical associates in defining business and technical requirements for data migration and design and...

  • Data Engineer

    4 weeks ago


    Anywhere in India/Multiple Locations, IN XANDER CONSULTING AND ADVISORY PRIVATE LIMITED Full time

    Primary Roles and Responsibilities:- Developing Modern Data Warehouse solutions using Databricks and AWS/ Azure Stack- Ability to provide solutions that are forward-thinking in data engineering and analytics space- Collaborate with DW/BI leads to understand new ETL pipeline development requirements.- Triage issues to find gaps in existing pipelines and fix...


  • Bangalore/Anywhere in India/Multiple Locations, IN Harmony Data Integration Technologies Pvt. Ltd. Full time

    We are looking for Technical Lead to join our OPTIC development team.If you thrive on pushing the boundaries of technology, possess a wealth of experience in full-stack development, and have a knack for turning complex challenges into elegant solutions, then we want to hear from you.As a Lead, you will play a pivotal role in the design, development, and...

  • Lead Data Engineer

    3 weeks ago


    Bangalore/Anywhere in India/Multiple Locations, IN Lorven Technologies Full time

    Job Description :- Primary skills as Azure ADF, Databricks- Secondary skills as Snowflake and other data engineering technologies.- Proficient in basic and advanced SQL programming concepts (Procedures, Analytical functions etc.)- Good Knowledge and Understanding of Data warehouse concepts (Dimensional Modeling, change data capture, slowly changing...


  • Bangalore/Anywhere in India/Multiple Locations, IN Aptus Data Labs Full time

    ML Engineer-Video AnalyticsLocation- Bangalore/RemoteWe are seeking a talented and experienced ML Engineer worked on Video Analytics to join our Data Science team. The ideal candidate will be responsible for developing and implementing machine learning algorithms to analyze and extract insights from video data. This role offers the opportunity to work on...

  • Lead DevOps Engineer

    3 weeks ago


    Anywhere in India/Multiple Locations, IN Corpxcel Consulting Full time

    Job Description :Our Lead DevOps Engineer - Service Reliability (SRE) will work with key organizational leaders and product owners to identify opportunities and drive technical vision of this SRE team. They will be responsible for technical roadmap and strategies with strong focus to drive operational excellence, improve performance and efficiency of both...

  • Data Engineer

    2 weeks ago


    Bangalore/Anywhere in India/Multiple Locations, IN Talent Socio Full time

    Job Description :The Data Engineer will be responsible for designing, developing, and maintaining data pipelines, data warehouses, and databases. The Data Engineer will also be responsible for data integration, data modeling, ETL processes, and data analytics.Requirements :- Data Engineering, ETL, Data Warehousing, and Data Modeling skills.- Experience in...

  • Azure Data Engineer

    4 weeks ago


    Anywhere in India/Multiple Locations, IN Live Connections Full time

    Azure Data Engineer - Python/PySpark We are seeking a skilled and experienced Azure Data Engineer with expertise in PySpark and Python coding. The ideal candidate should have a strong background in data engineering, with a focus on developing solutions using PySpark and Python within the Azure Databricks environment.Key Responsibilities :- PySpark...

  • Data Lead

    2 weeks ago


    Anywhere in India/Multiple Locations, IN goZeal Full time

    Job Description : Responsibilities & Duties :- Serve as a data resource expert for the organization - Conceptualize and own the Analytics services which will involve - Market research - Scoping - Release planning - Stakeholder management - Project management - Business interpretation of analytics results - Productionisation - Lead & build teams of Data...