Lead Data Engineer

3 weeks ago

Thiruvananthapuram, India Quantiphi Full time

Roles and Responsibilities


➔ Review and analyze existing data collection systems, and make recommendations on improvement, maintenance, or other factors to improve the system

➔ Supervising junior data engineering teams to ensure they carry out their duties in line with the business's goals

➔ Responsible for designing, deploying, and maintaining the organization's data platforms

➔ Identifying opportunities for improving the performance and efficiency of data platforms and implementing enhancements to meet service-level agreements (SLAs)

➔ Collaborating with clients to understand their data-related needs, providing recommendations, and delivering solutions that meet their requirements and expectations.


Skillsets Requirements Technical Skills

➔ Proficient in cloud platforms such as AWS, Azure, or Google Cloud Platform for deploying and managing data solutions in the cloud. Exposure to GCP is preferable.

➔ Strong expertise in building and optimizing ETL processes to efficiently move and transform data between various systems and storage solutions.

➔ Knowledge of data warehousing concepts and experience working with data warehouse solutions like Amazon Redshift, Snowflake, or Google BigQuery.

➔ Extensive understanding of Python and advanced SQL, with the skill to create efficient queries. ➔ Familiarity with big data technologies such as Apache Hadoop, Apache Spark, and related tools for processing and analyzing large volumes of data.

➔ Experience in managing and optimizing relational databases (e.G., MySQL, PostgreSQL) and NoSQL databases (e.G., MongoDB, Cassandra).

➔ Identification, analysis, and resolution of infrastructure vulnerabilities and application deployment issues.

➔ Capable of resolving code errors and finding solutions for any issues in the pipeline.


Soft Skills


➔ Skilled in handling numerous projects simultaneously.

➔ Engage directly with end users to collect requirements and advise on data integration solutions ➔ Leadership qualities to guide and mentor junior team members, contributing to their professional development.

➔ Strong analytical and problem-solving skills to address challenges and troubleshoot issues in data engineering processes.

➔ A meticulous approach to ensure data accuracy, quality, and adherence to best practices in data engineering processes.

➔ Enthusiasm for continuous learning to stay updated on industry trends, emerging technologies, and best practices in data engineering.

➔ Excellent verbal and written communication skills is a must.

  • Lead Data Engineer

    2 weeks ago

    Thiruvananthapuram, India Velodata Global Pvt Ltd Full time

    Were Hiring : Lead Data Engineer - MS FabricExperience : 8+ yearsWork Location : Trivandrum / KochiBudget : Up to 28 LPANotice Period : Immediate to 30 daysAbout the Role :We are looking for a highly skilled Lead Data Engineer with strong expertise in MS Fabric and the Azure Data stack. The ideal candidate will play a key role in designing, building, and...

  • Data Engineer

    2 weeks ago

    Thiruvananthapuram, India AAA Global Full time

    Data Engineer | MumbaiLocation: IndiaIndustry: Proprietary Trading / Financial MarketsExperience: 4+ yearsEmployment Terms: Full-time, PermanentCompensation: Competitive, market-alignedIntroductionWe are seeking an experienced Data Engineer to strengthen our core Data Engineering team. In this key role, you will ensure the secure, scalable, and efficient...

  • Lead Ii

    1 week ago

    Thiruvananthapuram, Kerala, India UST Full time

    Job Summary We are looking for a highly skilled Senior Data Engineer with over 6 years of experience in data engineering and a strong focus on data migration projects The ideal candidate will have deep expertise in Azure Data Factory ADF ETL ELT processes and Python PySpark with proven experience building scalable and efficient data pipelines across diverse...

  • GCP Data Engineer

    5 days ago

    Thiruvananthapuram, Kerala, India VME Vhire Solutions Full time ₹ 10,00,000 - ₹ 25,00,000 per year

    Permanent with Client - MNCContact - About ClientBeing the leading provider of Warehouse logistics solutions, we are gearing up to revolutionize our datalandscape by building a cutting-edge Enterprise Data Lakehouse Platform. We are forming multiple teams thatwill spearhead the creation of the platform's foundational components. These teams go beyond...

  • Data Science Team Lead

    1 week ago

    Thiruvananthapuram, India CONNECTING 2 WORK Full time

    Responsibilities:Team Leadership: ● Lead and mentor a team of data scientists, providing guidance and supportfor their professional development. ● Foster a collaborative and innovative team culture that encouragesknowledge sharing and continuous improvement.Project Management: ● Oversee the planning, execution, and delivery of data science projects...

  • Data Engineer

    38 minutes ago

    Thiruvananthapuram, Kerala, India Equifax Full time ₹ 4,00,000 - ₹ 12,00,000 per year

    *What you'll do*Perform general application development activities, including unit testing, code deployment to development environment and technical documentation. Works on one or more projects, making contributions to unfamiliar code written by team members.Participates in estimation process, use case specifications, reviews of test plans and test cases,...

  • Lead Data Engineer

    5 days ago

    Kochi, Thiruvananthapuram, India Place Elements Hr Full time ₹ 1,04,000 - ₹ 1,30,878 per year

    Manadatory skills : Strong in MS SQL and SSIS , Data Lake, Azure SQL, SSIS, ADF , Lead experience , Good communicationNotice period : immediate - 20 days

  • Data Science Team Lead

    4 weeks ago

    Thiruvananthapuram, India CONNECTING 2 WORK Full time

    Responsibilities: Team Leadership: Lead and mentor a team of data scientists, providing guidance and supportfor their professional development. Foster a collaborative and innovative team culture that encouragesknowledge sharing and continuous improvement.Project Management: Oversee the planning, execution, and delivery of data science projects tomeet...

  • Data Science Team Lead

    4 weeks ago

    Thiruvananthapuram, India CONNECTING 2 WORK Full time

    Responsibilities: Team Leadership: ● Lead and mentor a team of data scientists, providing guidance and supportfor their professional development. ● Foster a collaborative and innovative team culture that encouragesknowledge sharing and continuous improvement.Project Management: ● Oversee the planning, execution, and delivery of data science...

  • Data Science Team Lead

    4 weeks ago

    Thiruvananthapuram, India CONNECTING 2 WORK Full time

    Responsibilities: Team Leadership: ● Lead and mentor a team of data scientists, providing guidance and supportfor their professional development. ● Foster a collaborative and innovative team culture that encouragesknowledge sharing and continuous improvement.Project Management: ● Oversee the planning, execution, and delivery of data science...